Sep 10 20:34:19.792839 ip-10-0-143-160 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 20:34:19.792849 ip-10-0-143-160 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 20:34:19.792858 ip-10-0-143-160 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 20:34:19.793161 ip-10-0-143-160 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 20:34:29.443146 ip-10-0-143-160 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Sep 10 20:34:29.443159 ip-10-0-143-160 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3e9d62228a654b8f93b0ebad65a53f35 --
Sep 10 20:36:14.853937 ip-10-0-143-160 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 20:36:15.284788 ip-10-0-143-160 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:36:15.284788 ip-10-0-143-160 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 20:36:15.284788 ip-10-0-143-160 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:36:15.284788 ip-10-0-143-160 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 20:36:15.284788 ip-10-0-143-160 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:36:15.287532 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.287441    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 20:36:15.290580 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290564    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290581    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290585    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290589    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290592    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290596    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290599    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290601    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290605    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290608    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290611    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290614    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290617    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290620    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290623    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:36:15.290618 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290639    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290642    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290645    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290648    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290651    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290654    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290658    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290662    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290670    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290673    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290675    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290678    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290681    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290684    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290686    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290689    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290692    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290695    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290698    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:36:15.290999 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290701    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290703    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290706    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290709    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290711    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290714    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290717    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290719    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290721    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290724    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290726    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290729    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290731    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290733    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290736    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290740    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290743    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290746    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290748    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290750    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:36:15.291468 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290753    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290756    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290758    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290761    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290763    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290766    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290768    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290771    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290774    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290776    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290778    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290781    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290784    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290786    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290788    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290792    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290794    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290797    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290800    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290803    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:36:15.291965 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290805    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290808    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290810    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290813    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290816    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290820    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290823    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290826    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290829    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290831    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290834    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290836    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290839    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290841    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290844    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290846    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290850    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290853    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290856    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:36:15.292450 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290858    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290861    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290864    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290866    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290869    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.290871    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291566    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291573    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291576    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291578    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291581    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291584    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291586    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291589    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291592    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291594    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291597    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291600    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291602    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291605    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:36:15.293265 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291608    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291611    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291614    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291616    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291619    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291622    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291624    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291639    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291642    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291645    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291648    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291652    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291656    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291659    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291662    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291665    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291668    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291670    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291673    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:36:15.294173 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291675    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291678    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291681    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291683    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291686    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291688    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291691    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291694    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291696    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291699    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291702    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291705    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291710    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291714    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291717    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291719    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291722    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291725    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291728    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:36:15.294722 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291731    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291734    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291736    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291739    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291741    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291744    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291746    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291749    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291753    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291758    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291760    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291763    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291766    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291769    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291772    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291774    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291777    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291779    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291781    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:36:15.295227 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291785    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291788    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291791    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291793    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291796    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291799    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291802    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291805    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291807    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291810    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291812    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291815    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291817    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291820    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291822    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291825    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291828    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291830    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291833    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291835    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:36:15.295773 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291838    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291840    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291843    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291845    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291848    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291850    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291853    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.291855    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292209    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292214    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292216    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292219    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292223    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292226    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292229    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292231    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292234    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292237    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292239    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292242    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292245    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:36:15.296419 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292247    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292252    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292256    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292258    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292261    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292264    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292267    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292271    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292275    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292278    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292281    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292283    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292286    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292289    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292292    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292294    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292297    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292300    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292303    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:36:15.296968 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292306    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292309    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292312    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292315    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292318    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292321    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292323    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292327    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292330    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292332    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292335    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292337    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292340    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292342    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292345    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292347    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292350    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292352    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292355    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:36:15.297501 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292358    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292360    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292363    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292365    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292367    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292370    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292372    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292375    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292377    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292381    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292383    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292386    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292388    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292391    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292394    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292397    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292401    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292404    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292406    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:36:15.297991 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292410    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292412    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292417    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292420    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292422    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292425    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292427    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292430    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292432    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292436    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292438    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292441    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292443    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292446    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292449    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292451    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292454    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292457    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292459    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292462    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:36:15.298472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292465    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292468    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292471    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292473    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292475    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292478    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292480    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292483    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.292486    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292558    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292639    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292667    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292675    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292682    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292687    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292695    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292702    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292707    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292712    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292717    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292723    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292728    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292733    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 10 20:36:15.299004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292738    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292743    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292748    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292752    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292758    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292763    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292768    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292773    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292779    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292785    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292790    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292795    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292800    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292805    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292810    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292814    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292819    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292824    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292835    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292841    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292847    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292852    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292857    2579 flags.go:64] FLAG: --enable-server="true"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292862    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292870    2579 flags.go:64] FLAG: --event-burst="100"
Sep 10 20:36:15.299578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292875    2579 flags.go:64] FLAG: --event-qps="50"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292880    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292884    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292889    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292895    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292899    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292904    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292909    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292914    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292918    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292923    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292929    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292933    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292938    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292943    2579 flags.go:64] FLAG: --feature-gates=""
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292949    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292954    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292959    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292964    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292970    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292974    2579 flags.go:64] FLAG: --help="false"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292979    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292984    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292989    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 20:36:15.300199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.292994    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293000    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293007    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293012    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293017    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293022    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293027    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293032    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293037    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293042    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293046    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293051    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293056    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293061    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293065    2579 flags.go:64] FLAG: --lock-file=""
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293070    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293074    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293080    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293089    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293094    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293098    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293103    2579 flags.go:64] FLAG: --logging-format="text"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293107    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293113    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 20:36:15.300897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293117    2579 flags.go:64] FLAG: --manifest-url=""
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293122    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293129    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293134    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293140    2579 flags.go:64] FLAG: --max-pods="110"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293145    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293149    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293154    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293160    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293165    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293175    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293182    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293195    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293200    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293205    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293210    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293214    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293223    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293228    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293233    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293238    2579 flags.go:64] FLAG: --port="10250"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293243    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293248    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-085016cff6419d407"
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293252    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 10 20:36:15.301507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293257    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293262    2579 flags.go:64] FLAG: --register-node="true"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293266    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293271    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293276    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293280    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293284    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293290    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293295    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293300    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293305    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293309    2579 flags.go:64] FLAG: --runonce="false"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293314    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293319    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293324    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293329    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293333    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293339    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293345    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293350    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293354    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293360    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293365    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293370    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293375    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 20:36:15.302107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293380    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293384    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293395    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293400    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293404    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293411    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293416    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293420    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293425    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293430    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293434    2579 flags.go:64] FLAG: --v="2"
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293440    2579 flags.go:64] FLAG: --version="false"
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293447    2579 flags.go:64] FLAG: --vmodule=""
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293452    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.293458    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293664    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293673    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293677    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293682    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293686    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293690    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293694    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:36:15.302767 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293701    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293708    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293715    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293720    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293724    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293729    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293733    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293737    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293743    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293749    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293753    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293757    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293762    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293766    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293770    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293775    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293779    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293784    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293788    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293792    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:36:15.303304 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293797    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293801    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293805    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293809    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293813    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293817    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293822    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293826    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293830    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293834    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293838    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293843    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293847    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293851    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293855    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293860    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293864    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293868    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293873    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293877    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:36:15.303937 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293881    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293887    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293891    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293895    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293899    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293905    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293909    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293913    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293917    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293922    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293926    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293929    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293933    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293938    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293942    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293947    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293951    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293955    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293959    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293966    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:36:15.304428 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293972    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293977    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293981    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293986    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293990    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.293997    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294001    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294006    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294010    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294014    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294018    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294022    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294027    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294031    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294036    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294043    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294049    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294054    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294058    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294063    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:36:15.304944 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294067    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294072    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294076    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294080    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294084    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294089    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294093    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294097    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294101    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294105    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294109    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.294114    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.294123    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.302001    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.302014    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 20:36:15.305435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.302033    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.302039    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302099    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302104    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302108    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302111    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302115    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302117    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302121    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302124    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302126    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302130    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302133    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302136    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302139    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302142    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302144    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302147    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302150    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:36:15.305834 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302152    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302155    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302157    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302160    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302163    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302165    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302168    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302170    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302173    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302176    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302178    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302182    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302185    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302187    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302190    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302193    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302195    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302198    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302200    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302203    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:36:15.306336 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302206    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302208    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302211    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302213    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302216    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302219    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302221    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302224    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302226    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302229    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302231    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302234    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302236    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302239    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302241    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302244    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302247    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302250    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302252    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302255    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:36:15.306954 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302257    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302261    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302265    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302268    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302271    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302274    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302278    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302281    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302284    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302287    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302290    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302292    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302295    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302298    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302300    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302303    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302306    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302309    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:36:15.307475 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302312    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302314    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302317    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302319    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302322    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302325    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302327    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302330    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302333    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302335    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302338    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302340    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302343    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302345    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302348    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302350    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302353    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302357    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302361    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:36:15.307934 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302364    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302367    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302370    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302372    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302375    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.302380    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302489    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302494    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302497    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302500    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302503    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302506    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302509    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302511    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302515    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:36:15.308399 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302517    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302520    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302523    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302525    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302528    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302530    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302533    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302536    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302539    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302542    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302544    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302547    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302549    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302552    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302554    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302557    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302560    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302564    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302566    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302569    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:36:15.308775 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302571    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302574    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302576    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302579    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302581    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302584    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302587    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302589    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302592    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302594    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302597    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302600    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302604    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302606    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302609    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302640    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302645    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302648    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302651    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:36:15.309267 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302654    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302657    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302660    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302663    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302666    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302668    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302671    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302673    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302676    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302679    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302682    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302685    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302687    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302690    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302692    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302695    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302698    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302701    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302703    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302706    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:36:15.309741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302708    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302711    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302713    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302716    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302718    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302721    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302725    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302727    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302730    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302733    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302735    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302738    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302740    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302743    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302745    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302748    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302751    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302753    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302755    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302758    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:36:15.310230 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302763    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302765    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302768    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302771    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302774    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302776    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302779    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302782    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302784    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302787    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:15.302790    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.302794    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.302898    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.307197    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 20:36:15.310735 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.308302    2579 server.go:1019] "Starting client certificate rotation"
Sep 10 20:36:15.311075 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.308400    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:36:15.311075 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.308431    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:36:15.311075 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.311013    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:36:15.313405 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.313379    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:36:15.323819 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.323799    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 10 20:36:15.327191 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.327173    2579 log.go:25] "Validated CRI v1 image API"
Sep 10 20:36:15.328017 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.327996    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 20:36:15.330760 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.330738    2579 fs.go:135] Filesystem UUIDs: map[3c653423-6b35-4971-ba39-9792a3d96118:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 96cf62f3-5d78-4c80-a7a9-e5bbf303f56f:/dev/nvme0n1p3]
Sep 10 20:36:15.330819 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.330759    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 20:36:15.335615 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.335504    2579 manager.go:216] Machine: {Timestamp:2026-09-10 20:36:15.334099828 +0000 UTC m=+0.371001332 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100274 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26744270ad2665b8f2ef3fac3ad899 SystemUUID:ec267442-70ad-2665-b8f2-ef3fac3ad899 BootID:3e9d6222-8a65-4b8f-93b0-ebad65a53f35 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:94:1c:7f:82:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:94:1c:7f:82:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:fc:70:13:2f:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 20:36:15.335615 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.335608    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 20:36:15.335784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.335768    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 20:36:15.337681 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.337660    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 20:36:15.337830 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.337685    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 20:36:15.339182 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.339171    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 20:36:15.339221 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.339184    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 20:36:15.339221 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.339192    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:36:15.340051 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.340041    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:36:15.341252 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.341243    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 20:36:15.345712 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.345699    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:36:15.345823 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.345813    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 20:36:15.345892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.345846    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 20:36:15.345892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.345856    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 20:36:15.345892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.345871    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 20:36:15.345892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.345880    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 10 20:36:15.345892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.345888    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 20:36:15.346279 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.346267    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:36:15.346324 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.346286    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:36:15.349831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.349508    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:36:15.349831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.349689    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 20:36:15.352182 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.352166    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 20:36:15.352254 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.352198    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 20:36:15.355028 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355014    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 20:36:15.355087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355034    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 20:36:15.355087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355041    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 20:36:15.355087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355047    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 20:36:15.355087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355056    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 20:36:15.355087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355061    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 20:36:15.355087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355075    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 20:36:15.355087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355080    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 20:36:15.355087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355087    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 20:36:15.355305 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355093    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 20:36:15.355305 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355102    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 20:36:15.355305 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355107    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 20:36:15.355875 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355859    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 20:36:15.355875 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.355873    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 20:36:15.359512 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.359496    2579 server.go:1268] "Started kubelet"
Sep 10 20:36:15.359623 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.359597    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 20:36:15.359717 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.359595    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 20:36:15.359717 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.359684    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 20:36:15.360247 ip-10-0-143-160 systemd[1]: Started Kubernetes Kubelet.
Sep 10 20:36:15.361883 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.361864    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 20:36:15.363015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.361988    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 20:36:15.363015 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.362063    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 20:36:15.363015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.362118    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 20:36:15.363015 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.362942    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 20:36:15.365056 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.365029    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 20:36:15.367604 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.367587    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 20:36:15.368322 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.368307    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 20:36:15.368457 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.368437    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:15.369046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369031    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 20:36:15.369046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369034    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 20:36:15.369175 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369069    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 20:36:15.369175 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369133    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 20:36:15.369175 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369143    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 20:36:15.369273 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369224    2579 factory.go:55] Registering systemd factory
Sep 10 20:36:15.369273 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369239    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 10 20:36:15.369466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369447    2579 factory.go:153] Registering CRI-O factory
Sep 10 20:36:15.369466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369465    2579 factory.go:223] Registration of the crio container factory successfully
Sep 10 20:36:15.369571 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369560    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 20:36:15.369603 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369580    2579 factory.go:103] Registering Raw factory
Sep 10 20:36:15.369603 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.369591    2579 manager.go:1196] Started watching for new ooms in manager
Sep 10 20:36:15.370589 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.370578    2579 manager.go:349] Starting recovery of all containers
Sep 10 20:36:15.373599 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.373564    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 20:36:15.373750 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.373726    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 20:36:15.377035 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.373535    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-160.ec2.internal.18d4100743b1c63e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-160.ec2.internal,UID:ip-10-0-143-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-160.ec2.internal,},FirstTimestamp:2026-09-10 20:36:15.359469118 +0000 UTC m=+0.396370623,LastTimestamp:2026-09-10 20:36:15.359469118 +0000 UTC m=+0.396370623,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-160.ec2.internal,}"
Sep 10 20:36:15.384320 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.384301    2579 manager.go:354] Recovery completed
Sep 10 20:36:15.385174 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.385151    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kfbp"
Sep 10 20:36:15.388703 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.388691    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:36:15.390680 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.390658    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:36:15.390773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.390692    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:36:15.390773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.390707    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:36:15.391353 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.391334    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 20:36:15.391353 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.391353    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 20:36:15.391507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.391374    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:36:15.391507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.391392    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:36:15.392104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.392088    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:36:15.392179 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.392114    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:36:15.392179 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.392123    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:36:15.393183 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.393123    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-160.ec2.internal.18d41007458df93c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-160.ec2.internal,UID:ip-10-0-143-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-160.ec2.internal,},FirstTimestamp:2026-09-10 20:36:15.390677308 +0000 UTC m=+0.427578813,LastTimestamp:2026-09-10 20:36:15.390677308 +0000 UTC m=+0.427578813,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-160.ec2.internal,}"
Sep 10 20:36:15.393418 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.393403    2579 policy_none.go:49] "None policy: Start"
Sep 10 20:36:15.393418 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.393419    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 20:36:15.393532 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.393429    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 20:36:15.393584 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.393552    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kfbp"
Sep 10 20:36:15.404806 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.404747    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-160.ec2.internal.18d41007458e4f4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-160.ec2.internal,UID:ip-10-0-143-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-160.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-160.ec2.internal,},FirstTimestamp:2026-09-10 20:36:15.39069934 +0000 UTC m=+0.427600848,LastTimestamp:2026-09-10 20:36:15.39069934 +0000 UTC m=+0.427600848,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-160.ec2.internal,}"
Sep 10 20:36:15.411813 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.411758    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-160.ec2.internal.18d41007458e8498  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-160.ec2.internal,UID:ip-10-0-143-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-160.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-160.ec2.internal,},FirstTimestamp:2026-09-10 20:36:15.390712984 +0000 UTC m=+0.427614490,LastTimestamp:2026-09-10 20:36:15.390712984 +0000 UTC m=+0.427614490,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-160.ec2.internal,}"
Sep 10 20:36:15.422059 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.422002    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-160.ec2.internal.18d41007458df93c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-160.ec2.internal.18d41007458df93c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-160.ec2.internal,UID:ip-10-0-143-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-160.ec2.internal,},FirstTimestamp:2026-09-10 20:36:15.390677308 +0000 UTC m=+0.427578813,LastTimestamp:2026-09-10 20:36:15.392102605 +0000 UTC m=+0.429004109,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-160.ec2.internal,}"
Sep 10 20:36:15.434453 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.434381    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-160.ec2.internal.18d41007458e4f4c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-160.ec2.internal.18d41007458e4f4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-160.ec2.internal,UID:ip-10-0-143-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-160.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-160.ec2.internal,},FirstTimestamp:2026-09-10 20:36:15.39069934 +0000 UTC m=+0.427600848,LastTimestamp:2026-09-10 20:36:15.392118902 +0000 UTC m=+0.429020406,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-160.ec2.internal,}"
Sep 10 20:36:15.451903 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.444176    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-160.ec2.internal.18d41007458e8498\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-160.ec2.internal.18d41007458e8498  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-160.ec2.internal,UID:ip-10-0-143-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-160.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-160.ec2.internal,},FirstTimestamp:2026-09-10 20:36:15.390712984 +0000 UTC m=+0.427614490,LastTimestamp:2026-09-10 20:36:15.392127353 +0000 UTC m=+0.429028856,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-160.ec2.internal,}"
Sep 10 20:36:15.469352 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.469326    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:15.479348 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.479318    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 20:36:15.480527 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.480510    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 20:36:15.480593 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.480565    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 20:36:15.480593 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.480592    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 20:36:15.480701 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.480653    2579 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 10 20:36:15.493099 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.493075    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 10 20:36:15.535026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.534937    2579 policy_none.go:47] "Start"
Sep 10 20:36:15.567174 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.567156    2579 manager.go:337] "Starting Device Plugin manager"
Sep 10 20:36:15.567266 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.567254    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 20:36:15.567308 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.567269    2579 server.go:87] "Starting device plugin registration server"
Sep 10 20:36:15.567545 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.567531    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 20:36:15.567609 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.567546    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 20:36:15.567701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.567682    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 20:36:15.567869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.567848    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 20:36:15.567869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.567862    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 20:36:15.570163 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.570141    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 20:36:15.570239 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.570200    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:15.580755 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.580735    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"]
Sep 10 20:36:15.580831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.580801    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:36:15.581467 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.581453    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:36:15.581527 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.581483    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:36:15.581527 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.581496    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:36:15.583826 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.583812    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:36:15.583972 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.583959    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.584026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.583988    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:36:15.584532 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.584518    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:36:15.584594 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.584545    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:36:15.584594 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.584548    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:36:15.584594 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.584570    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:36:15.584594 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.584575    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:36:15.584594 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.584588    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:36:15.585652 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.585620    2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-160.ec2.internal\" not found" node="ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.586798 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.586781    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.586886 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.586802    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:36:15.587820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.587805    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:36:15.587893 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.587834    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:36:15.587893 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.587847    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:36:15.612283 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.612266    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-160.ec2.internal\" not found" node="ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.616449 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.616435    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-160.ec2.internal\" not found" node="ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.667822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.667804    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:36:15.668647 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.668615    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:36:15.668718 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.668657    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:36:15.668718 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.668668    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:36:15.668718 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.668689    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.670879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.669667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de650f0c6b3437c5758879ed16ef7713-config\") pod \"kube-apiserver-proxy-ip-10-0-143-160.ec2.internal\" (UID: \"de650f0c6b3437c5758879ed16ef7713\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.670879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.669713    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71145f74aff83e7911b20b9c8bf3b610-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"71145f74aff83e7911b20b9c8bf3b610\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.670879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.669749    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71145f74aff83e7911b20b9c8bf3b610-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"71145f74aff83e7911b20b9c8bf3b610\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.677059 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.677043    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.677106 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.677065    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-160.ec2.internal\": node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:15.697457 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.697439    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:15.770309 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.770279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de650f0c6b3437c5758879ed16ef7713-config\") pod \"kube-apiserver-proxy-ip-10-0-143-160.ec2.internal\" (UID: \"de650f0c6b3437c5758879ed16ef7713\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.770309 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.770313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71145f74aff83e7911b20b9c8bf3b610-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"71145f74aff83e7911b20b9c8bf3b610\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.770426 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.770331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71145f74aff83e7911b20b9c8bf3b610-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"71145f74aff83e7911b20b9c8bf3b610\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.770426 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.770388    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de650f0c6b3437c5758879ed16ef7713-config\") pod \"kube-apiserver-proxy-ip-10-0-143-160.ec2.internal\" (UID: \"de650f0c6b3437c5758879ed16ef7713\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.770426 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.770413    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71145f74aff83e7911b20b9c8bf3b610-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"71145f74aff83e7911b20b9c8bf3b610\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.770426 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.770395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71145f74aff83e7911b20b9c8bf3b610-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal\" (UID: \"71145f74aff83e7911b20b9c8bf3b610\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.798428 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.798382    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:15.899131 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.899100    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:15.914263 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.914245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.919297 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:15.918954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:15.999662 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:15.999503    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:16.100017 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:16.099999    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:16.200333 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:16.200301    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:16.300760 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:16.300732    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:16.307840 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.307820    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 20:36:16.401338 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:16.401309    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:16.411964 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.411944    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:36:16.416227 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.416206    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:36:16.417024 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.417010    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:36:16.418392 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.418376    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:36:16.418478 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.418398    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:36:16.418478 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.418407    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:36:16.501603 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:16.501578    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-160.ec2.internal\" not found"
Sep 10 20:36:16.510250 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.510235    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:36:16.528296 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:16.528264    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde650f0c6b3437c5758879ed16ef7713.slice/crio-720de5b1ba7afc87a88496342c808c735137497b4e35daf8124349a94281a618 WatchSource:0}: Error finding container 720de5b1ba7afc87a88496342c808c735137497b4e35daf8124349a94281a618: Status 404 returned error can't find the container with id 720de5b1ba7afc87a88496342c808c735137497b4e35daf8124349a94281a618
Sep 10 20:36:16.528586 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:16.528569    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71145f74aff83e7911b20b9c8bf3b610.slice/crio-bb059af5d0c3285fe9180f778d6658d2dc165276401c2763da76e87a8de4119c WatchSource:0}: Error finding container bb059af5d0c3285fe9180f778d6658d2dc165276401c2763da76e87a8de4119c: Status 404 returned error can't find the container with id bb059af5d0c3285fe9180f778d6658d2dc165276401c2763da76e87a8de4119c
Sep 10 20:36:16.532255 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.532240    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 20:36:16.538845 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.538821    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 20:31:15 +0000 UTC" deadline="2028-06-12 15:00:35.456618038 +0000 UTC"
Sep 10 20:36:16.538907 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.538845    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15378h24m18.917776481s"
Sep 10 20:36:16.557124 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.557104    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:36:16.569284 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.569268    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:16.579401 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.579383    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:36:16.579969 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.579958    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal"
Sep 10 20:36:16.589973 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:16.589955    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:36:17.347172 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.347148    2579 apiserver.go:52] "Watching apiserver"
Sep 10 20:36:17.357066 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.357045    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 20:36:17.357427 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.357406    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-hs4zw","openshift-network-diagnostics/network-check-target-bdgjw","openshift-network-operator/iptables-alerter-258w7","openshift-ovn-kubernetes/ovnkube-node-52jzs","kube-system/global-pull-secret-syncer-b8mq6","kube-system/konnectivity-agent-5klwv","openshift-cluster-node-tuning-operator/tuned-fm7gl","openshift-dns/node-resolver-rwh9z","openshift-image-registry/node-ca-zrqqq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal","openshift-multus/multus-rqfdv","openshift-multus/network-metrics-daemon-qs4rm","kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"]
Sep 10 20:36:17.359739 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.359715    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.361598 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.361580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.362553 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.362517    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kt447\""
Sep 10 20:36:17.362553 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.362522    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 20:36:17.362553 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.362525    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:36:17.363556 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.363526    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.365502 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.364797    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 20:36:17.365502 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.365068    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 20:36:17.365502 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.365319    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 20:36:17.365502 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.365478    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 20:36:17.365769 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.365753    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gdq2c\""
Sep 10 20:36:17.366933 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.366780    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 20:36:17.367206 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.367186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.367831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.367802    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:36:17.368198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.367808    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4qltg\""
Sep 10 20:36:17.368198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.367851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 20:36:17.368198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.367901    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 20:36:17.369172 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.369154    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.369253 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.369219    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:17.369748 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.369730    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 20:36:17.370957 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.370940    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 20:36:17.371062 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.370983    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 20:36:17.371062 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.370986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kvbqz\""
Sep 10 20:36:17.371062 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.370941    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 20:36:17.371176 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.370998    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 20:36:17.371176 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.371118    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 20:36:17.371430 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.371416    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:17.373557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.373543    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.375787 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.375772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.377666 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-sysctl-conf\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.377763 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-run-k8s-cni-cncf-io\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.377763 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-etc-openvswitch\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.377763 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-modprobe-d\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.377763 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-system-cni-dir\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c66f4397-d953-471c-a4cd-cffe164dab6c-iptables-alerter-script\") pod \"iptables-alerter-258w7\" (UID: \"c66f4397-d953-471c-a4cd-cffe164dab6c\") " pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-run-netns\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-var-lib-cni-bin\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-run-ovn-kubernetes\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb077d28-c480-4c8d-87ea-524fbd67a571-agent-certs\") pod \"konnectivity-agent-5klwv\" (UID: \"eb077d28-c480-4c8d-87ea-524fbd67a571\") " pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-sys\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2rz\" (UniqueName: \"kubernetes.io/projected/489001a7-8558-49d1-8649-da9d993bfedf-kube-api-access-gd2rz\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhmzm\" (UniqueName: \"kubernetes.io/projected/de4cb875-83a4-41ac-85d7-0aff074ccaf8-kube-api-access-qhmzm\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.377949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-cni-bin\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-sysconfig\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.377990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhhdb\" (UniqueName: \"kubernetes.io/projected/c66f4397-d953-471c-a4cd-cffe164dab6c-kube-api-access-bhhdb\") pod \"iptables-alerter-258w7\" (UID: \"c66f4397-d953-471c-a4cd-cffe164dab6c\") " pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-slash\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-run-systemd\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-var-lib-openvswitch\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44fe6670-ad43-49cb-9174-65dc592059e1-ovn-node-metrics-cert\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44fe6670-ad43-49cb-9174-65dc592059e1-ovnkube-script-lib\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-tuned\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-cnibin\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378193    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/489001a7-8558-49d1-8649-da9d993bfedf-cni-binary-copy\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-systemd-units\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.378240    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-host\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-kubelet\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-node-log\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.378350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44fe6670-ad43-49cb-9174-65dc592059e1-env-overrides\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-kubelet-config\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378348    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-kubernetes\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-run-multus-certs\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-etc-kubernetes\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-run-openvswitch\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-var-lib-kubelet\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-multus-cni-dir\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-multus-socket-dir-parent\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-var-lib-kubelet\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-run-netns\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44fe6670-ad43-49cb-9174-65dc592059e1-ovnkube-config\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-dbus\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb077d28-c480-4c8d-87ea-524fbd67a571-konnectivity-ca\") pod \"konnectivity-agent-5klwv\" (UID: \"eb077d28-c480-4c8d-87ea-524fbd67a571\") " pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-sysctl-d\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de4cb875-83a4-41ac-85d7-0aff074ccaf8-tmp\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.379104 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9hbd\" (UniqueName: \"kubernetes.io/projected/44fe6670-ad43-49cb-9174-65dc592059e1-kube-api-access-s9hbd\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-lib-modules\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-hostroot\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378833    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-cni-netd\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-var-lib-cni-multus\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/489001a7-8558-49d1-8649-da9d993bfedf-multus-daemon-config\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c66f4397-d953-471c-a4cd-cffe164dab6c-host-slash\") pod \"iptables-alerter-258w7\" (UID: \"c66f4397-d953-471c-a4cd-cffe164dab6c\") " pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378938    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-systemd\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-multus-conf-dir\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.378993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-run-ovn\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.379026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-log-socket\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.379752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.379046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-run\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.380168 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.380094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.382281 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.382266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.383708 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.383682    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 20:36:17.383708 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.383695    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 20:36:17.383987 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.383974    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28xcw\""
Sep 10 20:36:17.384068 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.384009    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 20:36:17.384125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.384081    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 20:36:17.384125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.384110    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4fw7w\""
Sep 10 20:36:17.384415 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.384400    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:17.384485 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.384457    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:17.384892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.384879    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 20:36:17.385158 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.385141    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 20:36:17.385828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.385586    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qj45q\""
Sep 10 20:36:17.385828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.385605    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 20:36:17.385828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.385655    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 20:36:17.385828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.385690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nn8rf\""
Sep 10 20:36:17.385828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.385697    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 20:36:17.385828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.385657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 20:36:17.385828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.385589    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 20:36:17.386215 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.385911    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 20:36:17.386215 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.386115    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q78tm\""
Sep 10 20:36:17.401931 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.401914    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:36:17.425333 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.425317    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ldwf"
Sep 10 20:36:17.433754 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.433739    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ldwf"
Sep 10 20:36:17.470773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.470754    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 20:36:17.479483 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-multus-conf-dir\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.479570 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59c8ba8a-e505-428d-b485-1a68ec843e5b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.479570 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-run-ovn\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.479570 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-log-socket\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.479570 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-run\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.479570 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479569    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-multus-conf-dir\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-sysctl-conf\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479587    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-run-ovn\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-run-k8s-cni-cncf-io\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-log-socket\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcxgz\" (UniqueName: \"kubernetes.io/projected/71874884-3083-4674-8d44-ff4c994e6121-kube-api-access-pcxgz\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479707    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-run-k8s-cni-cncf-io\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-run\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-sysctl-conf\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.479784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-etc-openvswitch\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-modprobe-d\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-system-cni-dir\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-etc-openvswitch\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c66f4397-d953-471c-a4cd-cffe164dab6c-iptables-alerter-script\") pod \"iptables-alerter-258w7\" (UID: \"c66f4397-d953-471c-a4cd-cffe164dab6c\") " pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479909    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-modprobe-d\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-system-cni-dir\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59c8ba8a-e505-428d-b485-1a68ec843e5b-cnibin\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-kubelet-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.479984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/081cc327-993f-45e7-9ef1-27d71931fdc3-tmp-dir\") pod \"node-resolver-rwh9z\" (UID: \"081cc327-993f-45e7-9ef1-27d71931fdc3\") " pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-run-netns\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-var-lib-cni-bin\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480043    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-run-netns\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zll4l\" (UniqueName: \"kubernetes.io/projected/25035a46-ed7d-4b5b-96f2-044d90402f30-kube-api-access-zll4l\") pod \"node-ca-zrqqq\" (UID: \"25035a46-ed7d-4b5b-96f2-044d90402f30\") " pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480084    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-run-ovn-kubernetes\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480090    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-var-lib-cni-bin\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb077d28-c480-4c8d-87ea-524fbd67a571-agent-certs\") pod \"konnectivity-agent-5klwv\" (UID: \"eb077d28-c480-4c8d-87ea-524fbd67a571\") " pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:17.480209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-sys\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480133    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-run-ovn-kubernetes\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2rz\" (UniqueName: \"kubernetes.io/projected/489001a7-8558-49d1-8649-da9d993bfedf-kube-api-access-gd2rz\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59c8ba8a-e505-428d-b485-1a68ec843e5b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-sys\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhmzm\" (UniqueName: \"kubernetes.io/projected/de4cb875-83a4-41ac-85d7-0aff074ccaf8-kube-api-access-qhmzm\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-cni-bin\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-sysconfig\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhhdb\" (UniqueName: \"kubernetes.io/projected/c66f4397-d953-471c-a4cd-cffe164dab6c-kube-api-access-bhhdb\") pod \"iptables-alerter-258w7\" (UID: \"c66f4397-d953-471c-a4cd-cffe164dab6c\") " pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59c8ba8a-e505-428d-b485-1a68ec843e5b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-cni-bin\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c66f4397-d953-471c-a4cd-cffe164dab6c-iptables-alerter-script\") pod \"iptables-alerter-258w7\" (UID: \"c66f4397-d953-471c-a4cd-cffe164dab6c\") " pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-registration-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480455    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-slash\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.480924 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-slash\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-run-systemd\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-var-lib-openvswitch\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44fe6670-ad43-49cb-9174-65dc592059e1-ovn-node-metrics-cert\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480399    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-sysconfig\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44fe6670-ad43-49cb-9174-65dc592059e1-ovnkube-script-lib\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-tuned\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480614    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-var-lib-openvswitch\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-cnibin\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480617    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-run-systemd\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-cnibin\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/489001a7-8558-49d1-8649-da9d993bfedf-cni-binary-copy\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-systemd-units\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.480716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-systemd-units\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-host\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59c8ba8a-e505-428d-b485-1a68ec843e5b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.481559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7l24\" (UniqueName: \"kubernetes.io/projected/59c8ba8a-e505-428d-b485-1a68ec843e5b-kube-api-access-s7l24\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/489001a7-8558-49d1-8649-da9d993bfedf-cni-binary-copy\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-socket-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpmlp\" (UniqueName: \"kubernetes.io/projected/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-kube-api-access-kpmlp\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44fe6670-ad43-49cb-9174-65dc592059e1-ovnkube-script-lib\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-kubelet\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-host\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-node-log\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-kubelet\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44fe6670-ad43-49cb-9174-65dc592059e1-env-overrides\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-node-log\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-kubelet-config\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-kubernetes\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-run-multus-certs\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-etc-kubernetes\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/081cc327-993f-45e7-9ef1-27d71931fdc3-hosts-file\") pod \"node-resolver-rwh9z\" (UID: \"081cc327-993f-45e7-9ef1-27d71931fdc3\") " pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-run-openvswitch\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.482233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-var-lib-kubelet\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-multus-cni-dir\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-multus-socket-dir-parent\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-var-lib-kubelet\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481552    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-device-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-sys-fs\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb8dk\" (UniqueName: \"kubernetes.io/projected/081cc327-993f-45e7-9ef1-27d71931fdc3-kube-api-access-xb8dk\") pod \"node-resolver-rwh9z\" (UID: \"081cc327-993f-45e7-9ef1-27d71931fdc3\") " pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-run-netns\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44fe6670-ad43-49cb-9174-65dc592059e1-ovnkube-config\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44fe6670-ad43-49cb-9174-65dc592059e1-env-overrides\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-dbus\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-kubelet-config\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.481805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb077d28-c480-4c8d-87ea-524fbd67a571-konnectivity-ca\") pod \"konnectivity-agent-5klwv\" (UID: \"eb077d28-c480-4c8d-87ea-524fbd67a571\") " pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-var-lib-kubelet\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482085    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-run-multus-certs\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-kubernetes\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482151    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-etc-kubernetes\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.483033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-run-openvswitch\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44fe6670-ad43-49cb-9174-65dc592059e1-ovnkube-config\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482264    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-multus-cni-dir\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482305    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-multus-socket-dir-parent\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-var-lib-kubelet\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-run-netns\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-dbus\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-sysctl-d\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de4cb875-83a4-41ac-85d7-0aff074ccaf8-tmp\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25035a46-ed7d-4b5b-96f2-044d90402f30-host\") pod \"node-ca-zrqqq\" (UID: \"25035a46-ed7d-4b5b-96f2-044d90402f30\") " pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25035a46-ed7d-4b5b-96f2-044d90402f30-serviceca\") pod \"node-ca-zrqqq\" (UID: \"25035a46-ed7d-4b5b-96f2-044d90402f30\") " pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482657    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9hbd\" (UniqueName: \"kubernetes.io/projected/44fe6670-ad43-49cb-9174-65dc592059e1-kube-api-access-s9hbd\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-lib-modules\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-hostroot\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c8ba8a-e505-428d-b485-1a68ec843e5b-system-cni-dir\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb077d28-c480-4c8d-87ea-524fbd67a571-konnectivity-ca\") pod \"konnectivity-agent-5klwv\" (UID: \"eb077d28-c480-4c8d-87ea-524fbd67a571\") " pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:17.483773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-etc-selinux\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-cni-netd\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-var-lib-cni-multus\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482898    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-lib-modules\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482959    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-host-var-lib-cni-multus\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.482997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-sysctl-d\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.483023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/489001a7-8558-49d1-8649-da9d993bfedf-multus-daemon-config\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.483053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c66f4397-d953-471c-a4cd-cffe164dab6c-host-slash\") pod \"iptables-alerter-258w7\" (UID: \"c66f4397-d953-471c-a4cd-cffe164dab6c\") " pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.483077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-systemd\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.483152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-systemd\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.483230    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.483297    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret podName:2fd289a0-76aa-4446-8a89-f221bd4d7bd8 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:17.983266266 +0000 UTC m=+3.020167778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret") pod "global-pull-secret-syncer-b8mq6" (UID: "2fd289a0-76aa-4446-8a89-f221bd4d7bd8") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.483295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/489001a7-8558-49d1-8649-da9d993bfedf-hostroot\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.483335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c66f4397-d953-471c-a4cd-cffe164dab6c-host-slash\") pod \"iptables-alerter-258w7\" (UID: \"c66f4397-d953-471c-a4cd-cffe164dab6c\") " pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.483410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44fe6670-ad43-49cb-9174-65dc592059e1-host-cni-netd\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.483716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/489001a7-8558-49d1-8649-da9d993bfedf-multus-daemon-config\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.484321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de4cb875-83a4-41ac-85d7-0aff074ccaf8-etc-tuned\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.484466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.484458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44fe6670-ad43-49cb-9174-65dc592059e1-ovn-node-metrics-cert\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.485154 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.484565    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb077d28-c480-4c8d-87ea-524fbd67a571-agent-certs\") pod \"konnectivity-agent-5klwv\" (UID: \"eb077d28-c480-4c8d-87ea-524fbd67a571\") " pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:17.485733 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.485718    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de4cb875-83a4-41ac-85d7-0aff074ccaf8-tmp\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.486253 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.486211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal" event={"ID":"de650f0c6b3437c5758879ed16ef7713","Type":"ContainerStarted","Data":"720de5b1ba7afc87a88496342c808c735137497b4e35daf8124349a94281a618"}
Sep 10 20:36:17.487367 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.487340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal" event={"ID":"71145f74aff83e7911b20b9c8bf3b610","Type":"ContainerStarted","Data":"bb059af5d0c3285fe9180f778d6658d2dc165276401c2763da76e87a8de4119c"}
Sep 10 20:36:17.488115 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.488095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhhdb\" (UniqueName: \"kubernetes.io/projected/c66f4397-d953-471c-a4cd-cffe164dab6c-kube-api-access-bhhdb\") pod \"iptables-alerter-258w7\" (UID: \"c66f4397-d953-471c-a4cd-cffe164dab6c\") " pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.488988 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.488971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhmzm\" (UniqueName: \"kubernetes.io/projected/de4cb875-83a4-41ac-85d7-0aff074ccaf8-kube-api-access-qhmzm\") pod \"tuned-fm7gl\" (UID: \"de4cb875-83a4-41ac-85d7-0aff074ccaf8\") " pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.489348 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.489326    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2rz\" (UniqueName: \"kubernetes.io/projected/489001a7-8558-49d1-8649-da9d993bfedf-kube-api-access-gd2rz\") pod \"multus-rqfdv\" (UID: \"489001a7-8558-49d1-8649-da9d993bfedf\") " pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.490126 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.490103    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9hbd\" (UniqueName: \"kubernetes.io/projected/44fe6670-ad43-49cb-9174-65dc592059e1-kube-api-access-s9hbd\") pod \"ovnkube-node-52jzs\" (UID: \"44fe6670-ad43-49cb-9174-65dc592059e1\") " pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.583669 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:17.583669 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59c8ba8a-e505-428d-b485-1a68ec843e5b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7l24\" (UniqueName: \"kubernetes.io/projected/59c8ba8a-e505-428d-b485-1a68ec843e5b-kube-api-access-s7l24\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-socket-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpmlp\" (UniqueName: \"kubernetes.io/projected/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-kube-api-access-kpmlp\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/081cc327-993f-45e7-9ef1-27d71931fdc3-hosts-file\") pod \"node-resolver-rwh9z\" (UID: \"081cc327-993f-45e7-9ef1-27d71931fdc3\") " pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-device-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-sys-fs\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb8dk\" (UniqueName: \"kubernetes.io/projected/081cc327-993f-45e7-9ef1-27d71931fdc3-kube-api-access-xb8dk\") pod \"node-resolver-rwh9z\" (UID: \"081cc327-993f-45e7-9ef1-27d71931fdc3\") " pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25035a46-ed7d-4b5b-96f2-044d90402f30-host\") pod \"node-ca-zrqqq\" (UID: \"25035a46-ed7d-4b5b-96f2-044d90402f30\") " pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25035a46-ed7d-4b5b-96f2-044d90402f30-serviceca\") pod \"node-ca-zrqqq\" (UID: \"25035a46-ed7d-4b5b-96f2-044d90402f30\") " pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.583881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583883    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c8ba8a-e505-428d-b485-1a68ec843e5b-system-cni-dir\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-etc-selinux\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583900    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/081cc327-993f-45e7-9ef1-27d71931fdc3-hosts-file\") pod \"node-resolver-rwh9z\" (UID: \"081cc327-993f-45e7-9ef1-27d71931fdc3\") " pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59c8ba8a-e505-428d-b485-1a68ec843e5b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcxgz\" (UniqueName: \"kubernetes.io/projected/71874884-3083-4674-8d44-ff4c994e6121-kube-api-access-pcxgz\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59c8ba8a-e505-428d-b485-1a68ec843e5b-cnibin\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.583997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-kubelet-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/081cc327-993f-45e7-9ef1-27d71931fdc3-tmp-dir\") pod \"node-resolver-rwh9z\" (UID: \"081cc327-993f-45e7-9ef1-27d71931fdc3\") " pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-socket-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zll4l\" (UniqueName: \"kubernetes.io/projected/25035a46-ed7d-4b5b-96f2-044d90402f30-kube-api-access-zll4l\") pod \"node-ca-zrqqq\" (UID: \"25035a46-ed7d-4b5b-96f2-044d90402f30\") " pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59c8ba8a-e505-428d-b485-1a68ec843e5b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59c8ba8a-e505-428d-b485-1a68ec843e5b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-registration-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-registration-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584224    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-device-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584225    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59c8ba8a-e505-428d-b485-1a68ec843e5b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.584304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584265    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-sys-fs\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584895 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.584315    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:17.584895 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.584369    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs podName:fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:18.084353528 +0000 UTC m=+3.121255033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs") pod "network-metrics-daemon-qs4rm" (UID: "fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:17.584895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584561    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-kubelet-dir\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584618    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59c8ba8a-e505-428d-b485-1a68ec843e5b-system-cni-dir\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.584895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25035a46-ed7d-4b5b-96f2-044d90402f30-host\") pod \"node-ca-zrqqq\" (UID: \"25035a46-ed7d-4b5b-96f2-044d90402f30\") " pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.584895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71874884-3083-4674-8d44-ff4c994e6121-etc-selinux\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.584895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584840    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59c8ba8a-e505-428d-b485-1a68ec843e5b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.584895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.584868    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59c8ba8a-e505-428d-b485-1a68ec843e5b-cnibin\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.585118 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.585004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/081cc327-993f-45e7-9ef1-27d71931fdc3-tmp-dir\") pod \"node-resolver-rwh9z\" (UID: \"081cc327-993f-45e7-9ef1-27d71931fdc3\") " pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.585118 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.585032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59c8ba8a-e505-428d-b485-1a68ec843e5b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.585118 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.585032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25035a46-ed7d-4b5b-96f2-044d90402f30-serviceca\") pod \"node-ca-zrqqq\" (UID: \"25035a46-ed7d-4b5b-96f2-044d90402f30\") " pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.585251 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.585192    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59c8ba8a-e505-428d-b485-1a68ec843e5b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.590232 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.590211    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:36:17.590232 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.590236    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:36:17.590382 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.590246    2579 projected.go:196] Error preparing data for projected volume kube-api-access-42w7k for pod openshift-network-diagnostics/network-check-target-bdgjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:17.590382 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.590311    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k podName:dc0f32c9-1e74-4a85-93df-32c8fd1bd874 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:18.090297008 +0000 UTC m=+3.127198523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-42w7k" (UniqueName: "kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k") pod "network-check-target-bdgjw" (UID: "dc0f32c9-1e74-4a85-93df-32c8fd1bd874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:17.593108 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.593085    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpmlp\" (UniqueName: \"kubernetes.io/projected/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-kube-api-access-kpmlp\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:17.593643 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.593605    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcxgz\" (UniqueName: \"kubernetes.io/projected/71874884-3083-4674-8d44-ff4c994e6121-kube-api-access-pcxgz\") pod \"aws-ebs-csi-driver-node-429f8\" (UID: \"71874884-3083-4674-8d44-ff4c994e6121\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.594243 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.594212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb8dk\" (UniqueName: \"kubernetes.io/projected/081cc327-993f-45e7-9ef1-27d71931fdc3-kube-api-access-xb8dk\") pod \"node-resolver-rwh9z\" (UID: \"081cc327-993f-45e7-9ef1-27d71931fdc3\") " pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.594314 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.594276    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zll4l\" (UniqueName: \"kubernetes.io/projected/25035a46-ed7d-4b5b-96f2-044d90402f30-kube-api-access-zll4l\") pod \"node-ca-zrqqq\" (UID: \"25035a46-ed7d-4b5b-96f2-044d90402f30\") " pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.596036 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.596016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7l24\" (UniqueName: \"kubernetes.io/projected/59c8ba8a-e505-428d-b485-1a68ec843e5b-kube-api-access-s7l24\") pod \"multus-additional-cni-plugins-hs4zw\" (UID: \"59c8ba8a-e505-428d-b485-1a68ec843e5b\") " pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.671800 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.671774    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fm7gl"
Sep 10 20:36:17.678884 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.678859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-258w7"
Sep 10 20:36:17.685670 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.685651    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqfdv"
Sep 10 20:36:17.691239 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.691224    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:17.698838 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.698819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:17.704301 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.704285    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zrqqq"
Sep 10 20:36:17.709581 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.709564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8"
Sep 10 20:36:17.715969 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.715953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rwh9z"
Sep 10 20:36:17.720831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.720815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hs4zw"
Sep 10 20:36:17.987059 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:17.986985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:17.987192 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.987106    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:17.987192 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:17.987167    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret podName:2fd289a0-76aa-4446-8a89-f221bd4d7bd8 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:18.987151234 +0000 UTC m=+4.024052727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret") pod "global-pull-secret-syncer-b8mq6" (UID: "2fd289a0-76aa-4446-8a89-f221bd4d7bd8") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:18.088027 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.087997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:18.088189 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:18.088135    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:18.088244 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:18.088201    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs podName:fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:19.088183279 +0000 UTC m=+4.125084781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs") pod "network-metrics-daemon-qs4rm" (UID: "fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:18.188929 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.188900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:18.189054 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:18.189024    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:36:18.189054 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:18.189037    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:36:18.189054 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:18.189045    2579 projected.go:196] Error preparing data for projected volume kube-api-access-42w7k for pod openshift-network-diagnostics/network-check-target-bdgjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:18.189154 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:18.189090    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k podName:dc0f32c9-1e74-4a85-93df-32c8fd1bd874 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:19.189078894 +0000 UTC m=+4.225980384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-42w7k" (UniqueName: "kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k") pod "network-check-target-bdgjw" (UID: "dc0f32c9-1e74-4a85-93df-32c8fd1bd874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:18.262472 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:18.262448    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4cb875_83a4_41ac_85d7_0aff074ccaf8.slice/crio-1c9d72c8dca2140612ccc4625fad29d1a7c14cf15f46a5b04713db1a599feb9f WatchSource:0}: Error finding container 1c9d72c8dca2140612ccc4625fad29d1a7c14cf15f46a5b04713db1a599feb9f: Status 404 returned error can't find the container with id 1c9d72c8dca2140612ccc4625fad29d1a7c14cf15f46a5b04713db1a599feb9f
Sep 10 20:36:18.263827 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:18.263798    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44fe6670_ad43_49cb_9174_65dc592059e1.slice/crio-b59b66ec78c0155ead92015a562e4d7f70f2cb12f845c6d256f7429751c66ed3 WatchSource:0}: Error finding container b59b66ec78c0155ead92015a562e4d7f70f2cb12f845c6d256f7429751c66ed3: Status 404 returned error can't find the container with id b59b66ec78c0155ead92015a562e4d7f70f2cb12f845c6d256f7429751c66ed3
Sep 10 20:36:18.267032 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:18.267004    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb077d28_c480_4c8d_87ea_524fbd67a571.slice/crio-69ad4d4ec7f535ffeac0e1335e0b9c33e9ca9b76bc57c45c62502dd3d63a8964 WatchSource:0}: Error finding container 69ad4d4ec7f535ffeac0e1335e0b9c33e9ca9b76bc57c45c62502dd3d63a8964: Status 404 returned error can't find the container with id 69ad4d4ec7f535ffeac0e1335e0b9c33e9ca9b76bc57c45c62502dd3d63a8964
Sep 10 20:36:18.267740 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:18.267726    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71874884_3083_4674_8d44_ff4c994e6121.slice/crio-87b87b738bdd99ae5f0eda470ef1535940ddec353afc79fe7bd6ab63d7b59873 WatchSource:0}: Error finding container 87b87b738bdd99ae5f0eda470ef1535940ddec353afc79fe7bd6ab63d7b59873: Status 404 returned error can't find the container with id 87b87b738bdd99ae5f0eda470ef1535940ddec353afc79fe7bd6ab63d7b59873
Sep 10 20:36:18.268337 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:18.268304    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081cc327_993f_45e7_9ef1_27d71931fdc3.slice/crio-b577c7727adfcdb194ff1c36a08bc54249ad9cc875900eae9b08fe7ba9bd6182 WatchSource:0}: Error finding container b577c7727adfcdb194ff1c36a08bc54249ad9cc875900eae9b08fe7ba9bd6182: Status 404 returned error can't find the container with id b577c7727adfcdb194ff1c36a08bc54249ad9cc875900eae9b08fe7ba9bd6182
Sep 10 20:36:18.270393 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:18.269140    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c8ba8a_e505_428d_b485_1a68ec843e5b.slice/crio-0b12dd6bb0fd6daa175473523eab33c07aed419338ad3dd4863e44f305c61e2b WatchSource:0}: Error finding container 0b12dd6bb0fd6daa175473523eab33c07aed419338ad3dd4863e44f305c61e2b: Status 404 returned error can't find the container with id 0b12dd6bb0fd6daa175473523eab33c07aed419338ad3dd4863e44f305c61e2b
Sep 10 20:36:18.270393 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:18.269841    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25035a46_ed7d_4b5b_96f2_044d90402f30.slice/crio-bbe19df34b05c9871f45fd68f0a9f529cb2728cecdb8db264e51a48255a65b9e WatchSource:0}: Error finding container bbe19df34b05c9871f45fd68f0a9f529cb2728cecdb8db264e51a48255a65b9e: Status 404 returned error can't find the container with id bbe19df34b05c9871f45fd68f0a9f529cb2728cecdb8db264e51a48255a65b9e
Sep 10 20:36:18.271652 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:18.271557    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489001a7_8558_49d1_8649_da9d993bfedf.slice/crio-3632c1384f4104202be979a3369eaadb24f4c22e1adf1a1004092e47b5c57360 WatchSource:0}: Error finding container 3632c1384f4104202be979a3369eaadb24f4c22e1adf1a1004092e47b5c57360: Status 404 returned error can't find the container with id 3632c1384f4104202be979a3369eaadb24f4c22e1adf1a1004092e47b5c57360
Sep 10 20:36:18.272664 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:18.272340    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66f4397_d953_471c_a4cd_cffe164dab6c.slice/crio-50797c6391b0eade789218004a04fb3f636362a893952d315433869b5554858e WatchSource:0}: Error finding container 50797c6391b0eade789218004a04fb3f636362a893952d315433869b5554858e: Status 404 returned error can't find the container with id 50797c6391b0eade789218004a04fb3f636362a893952d315433869b5554858e
Sep 10 20:36:18.436931 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.436900    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:31:17 +0000 UTC" deadline="2028-04-14 01:01:30.118892758 +0000 UTC"
Sep 10 20:36:18.436931 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.436927    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13948h25m11.681969514s"
Sep 10 20:36:18.489910 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.489881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fm7gl" event={"ID":"de4cb875-83a4-41ac-85d7-0aff074ccaf8","Type":"ContainerStarted","Data":"1c9d72c8dca2140612ccc4625fad29d1a7c14cf15f46a5b04713db1a599feb9f"}
Sep 10 20:36:18.491653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.491606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal" event={"ID":"71145f74aff83e7911b20b9c8bf3b610","Type":"ContainerStarted","Data":"efd039b48c73d247608e53c8750ef00c9d16617d2346c8e912885bd6b97e342e"}
Sep 10 20:36:18.492570 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.492548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-258w7" event={"ID":"c66f4397-d953-471c-a4cd-cffe164dab6c","Type":"ContainerStarted","Data":"50797c6391b0eade789218004a04fb3f636362a893952d315433869b5554858e"}
Sep 10 20:36:18.493596 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.493547    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zrqqq" event={"ID":"25035a46-ed7d-4b5b-96f2-044d90402f30","Type":"ContainerStarted","Data":"bbe19df34b05c9871f45fd68f0a9f529cb2728cecdb8db264e51a48255a65b9e"}
Sep 10 20:36:18.494769 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.494590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hs4zw" event={"ID":"59c8ba8a-e505-428d-b485-1a68ec843e5b","Type":"ContainerStarted","Data":"0b12dd6bb0fd6daa175473523eab33c07aed419338ad3dd4863e44f305c61e2b"}
Sep 10 20:36:18.495666 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.495648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8" event={"ID":"71874884-3083-4674-8d44-ff4c994e6121","Type":"ContainerStarted","Data":"87b87b738bdd99ae5f0eda470ef1535940ddec353afc79fe7bd6ab63d7b59873"}
Sep 10 20:36:18.496640 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.496608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" event={"ID":"44fe6670-ad43-49cb-9174-65dc592059e1","Type":"ContainerStarted","Data":"b59b66ec78c0155ead92015a562e4d7f70f2cb12f845c6d256f7429751c66ed3"}
Sep 10 20:36:18.500043 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.500023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal" event={"ID":"de650f0c6b3437c5758879ed16ef7713","Type":"ContainerStarted","Data":"3b2b0376ef2355a53238aa27347c3d9f00df6ab3ca73a61e62128e11c9dd6b25"}
Sep 10 20:36:18.501063 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.501046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rwh9z" event={"ID":"081cc327-993f-45e7-9ef1-27d71931fdc3","Type":"ContainerStarted","Data":"b577c7727adfcdb194ff1c36a08bc54249ad9cc875900eae9b08fe7ba9bd6182"}
Sep 10 20:36:18.501952 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.501936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqfdv" event={"ID":"489001a7-8558-49d1-8649-da9d993bfedf","Type":"ContainerStarted","Data":"3632c1384f4104202be979a3369eaadb24f4c22e1adf1a1004092e47b5c57360"}
Sep 10 20:36:18.502810 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.502789    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5klwv" event={"ID":"eb077d28-c480-4c8d-87ea-524fbd67a571","Type":"ContainerStarted","Data":"69ad4d4ec7f535ffeac0e1335e0b9c33e9ca9b76bc57c45c62502dd3d63a8964"}
Sep 10 20:36:18.523564 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.523508    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-160.ec2.internal" podStartSLOduration=2.5234982070000003 podStartE2EDuration="2.523498207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:18.523288307 +0000 UTC m=+3.560189816" watchObservedRunningTime="2026-09-10 20:36:18.523498207 +0000 UTC m=+3.560399717"
Sep 10 20:36:18.993459 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:18.993421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:18.993687 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:18.993670    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:18.993759 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:18.993734    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret podName:2fd289a0-76aa-4446-8a89-f221bd4d7bd8 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:20.993716716 +0000 UTC m=+6.030618219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret") pod "global-pull-secret-syncer-b8mq6" (UID: "2fd289a0-76aa-4446-8a89-f221bd4d7bd8") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:19.094465 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:19.094433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:19.094664 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:19.094574    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:19.094664 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:19.094627    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs podName:fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:21.094609529 +0000 UTC m=+6.131511034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs") pod "network-metrics-daemon-qs4rm" (UID: "fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:19.195116 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:19.195022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:19.195295 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:19.195231    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:36:19.195295 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:19.195249    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:36:19.195295 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:19.195261    2579 projected.go:196] Error preparing data for projected volume kube-api-access-42w7k for pod openshift-network-diagnostics/network-check-target-bdgjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:19.195447 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:19.195318    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k podName:dc0f32c9-1e74-4a85-93df-32c8fd1bd874 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:21.195301537 +0000 UTC m=+6.232203047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-42w7k" (UniqueName: "kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k") pod "network-check-target-bdgjw" (UID: "dc0f32c9-1e74-4a85-93df-32c8fd1bd874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:19.437693 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:19.437616    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:31:17 +0000 UTC" deadline="2028-03-12 09:50:02.304233584 +0000 UTC"
Sep 10 20:36:19.437693 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:19.437691    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13165h13m42.866546898s"
Sep 10 20:36:19.481209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:19.481169    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:19.481371 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:19.481300    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:19.481710 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:19.481681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:19.481793 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:19.481768    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:19.482065 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:19.481908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:19.482065 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:19.482025    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:19.529430 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:19.529176    2579 generic.go:356] "Generic (PLEG): container finished" podID="71145f74aff83e7911b20b9c8bf3b610" containerID="efd039b48c73d247608e53c8750ef00c9d16617d2346c8e912885bd6b97e342e" exitCode=0
Sep 10 20:36:19.530711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:19.530129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal" event={"ID":"71145f74aff83e7911b20b9c8bf3b610","Type":"ContainerDied","Data":"efd039b48c73d247608e53c8750ef00c9d16617d2346c8e912885bd6b97e342e"}
Sep 10 20:36:20.563776 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:20.563081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal" event={"ID":"71145f74aff83e7911b20b9c8bf3b610","Type":"ContainerStarted","Data":"69d1a20cd539c1d2b0cf25bed4a0496085ae98853b159e08c1c4f1a667b6c546"}
Sep 10 20:36:20.583646 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:20.583061    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-160.ec2.internal" podStartSLOduration=4.5830453890000005 podStartE2EDuration="4.583045389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:20.582836146 +0000 UTC m=+5.619737659" watchObservedRunningTime="2026-09-10 20:36:20.583045389 +0000 UTC m=+5.619946901"
Sep 10 20:36:21.009321 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:21.009285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:21.009523 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.009470    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:21.009588 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.009533    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret podName:2fd289a0-76aa-4446-8a89-f221bd4d7bd8 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:25.009516223 +0000 UTC m=+10.046417755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret") pod "global-pull-secret-syncer-b8mq6" (UID: "2fd289a0-76aa-4446-8a89-f221bd4d7bd8") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:21.110767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:21.110734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:21.110953 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.110856    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:21.110953 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.110911    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs podName:fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:25.110897071 +0000 UTC m=+10.147798579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs") pod "network-metrics-daemon-qs4rm" (UID: "fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:21.211180 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:21.211140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:21.211340 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.211293    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:36:21.211340 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.211311    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:36:21.211340 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.211323    2579 projected.go:196] Error preparing data for projected volume kube-api-access-42w7k for pod openshift-network-diagnostics/network-check-target-bdgjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:21.211506 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.211386    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k podName:dc0f32c9-1e74-4a85-93df-32c8fd1bd874 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:25.211369264 +0000 UTC m=+10.248270768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-42w7k" (UniqueName: "kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k") pod "network-check-target-bdgjw" (UID: "dc0f32c9-1e74-4a85-93df-32c8fd1bd874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:21.480954 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:21.480922    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:21.481085 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.481059    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:21.481476 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:21.481455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:21.481576 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.481555    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:21.482050 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:21.482029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:21.482160 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:21.482140    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:23.481576 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:23.481540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:23.482061 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:23.481835    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:23.482211 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:23.482192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:23.482312 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:23.482289    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:23.482373 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:23.482346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:23.482475 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:23.482418    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:25.041762 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:25.041719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:25.042207 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.041843    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:25.042207 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.041906    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret podName:2fd289a0-76aa-4446-8a89-f221bd4d7bd8 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:33.041888149 +0000 UTC m=+18.078789650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret") pod "global-pull-secret-syncer-b8mq6" (UID: "2fd289a0-76aa-4446-8a89-f221bd4d7bd8") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:25.142383 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:25.142345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:25.142550 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.142513    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:25.142611 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.142580    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs podName:fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:33.142560238 +0000 UTC m=+18.179461730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs") pod "network-metrics-daemon-qs4rm" (UID: "fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:25.243487 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:25.243453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:25.243693 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.243601    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:36:25.243693 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.243623    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:36:25.243693 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.243648    2579 projected.go:196] Error preparing data for projected volume kube-api-access-42w7k for pod openshift-network-diagnostics/network-check-target-bdgjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:25.243863 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.243715    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k podName:dc0f32c9-1e74-4a85-93df-32c8fd1bd874 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:33.243693261 +0000 UTC m=+18.280594768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-42w7k" (UniqueName: "kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k") pod "network-check-target-bdgjw" (UID: "dc0f32c9-1e74-4a85-93df-32c8fd1bd874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:25.482029 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:25.481966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:25.482225 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.482169    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:25.482510 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:25.482314    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:25.482510 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.482421    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:25.482510 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:25.482453    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:25.483302 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:25.483234    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:27.481756 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:27.481717    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:27.482236 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:27.481717    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:27.482236 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:27.481873    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:27.482236 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:27.481733    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:27.482236 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:27.481930    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:27.482236 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:27.481996    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:29.481137 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:29.481102    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:29.481137 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:29.481120    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:29.481654 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:29.481103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:29.481654 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:29.481232    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:29.481654 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:29.481304    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:29.481654 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:29.481395    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:31.481563 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:31.481527    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:31.481563 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:31.481528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:31.482069 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:31.481539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:31.482069 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:31.481644    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:31.482069 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:31.481753    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:31.482069 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:31.481839    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:33.101731 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:33.101689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:33.102214 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.101857    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:33.102214 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.101915    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret podName:2fd289a0-76aa-4446-8a89-f221bd4d7bd8 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:49.101900396 +0000 UTC m=+34.138801887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret") pod "global-pull-secret-syncer-b8mq6" (UID: "2fd289a0-76aa-4446-8a89-f221bd4d7bd8") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:33.202341 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:33.202309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:33.202500 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.202405    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:33.202500 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.202461    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs podName:fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:49.202443857 +0000 UTC m=+34.239345372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs") pod "network-metrics-daemon-qs4rm" (UID: "fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:33.302810 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:33.302775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:33.302978 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.302958    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:36:33.303055 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.302985    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:36:33.303055 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.303025    2579 projected.go:196] Error preparing data for projected volume kube-api-access-42w7k for pod openshift-network-diagnostics/network-check-target-bdgjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:33.303158 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.303085    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k podName:dc0f32c9-1e74-4a85-93df-32c8fd1bd874 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:49.30306754 +0000 UTC m=+34.339969033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-42w7k" (UniqueName: "kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k") pod "network-check-target-bdgjw" (UID: "dc0f32c9-1e74-4a85-93df-32c8fd1bd874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:33.481084 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:33.481052    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:33.481257 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:33.481088    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:33.481257 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.481176    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:33.481257 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:33.481225    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:33.481450 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.481332    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:33.481503 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:33.481449    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:35.482190 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:35.482050    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:35.482190 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:35.482139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:35.482190 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:35.482159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:35.482190 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:35.482180    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:35.482859 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:35.482237    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:35.482859 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:35.482327    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:36.597886 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.597692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8" event={"ID":"71874884-3083-4674-8d44-ff4c994e6121","Type":"ContainerStarted","Data":"21ff8b42410230fe57694a98ad36c2f15d302fcebeaa63c903fcc93dfcde4391"}
Sep 10 20:36:36.603021 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.602832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" event={"ID":"44fe6670-ad43-49cb-9174-65dc592059e1","Type":"ContainerStarted","Data":"a072ef14481010bea3b4736dc0d497d9fc9db302e8083de65eac3cd4d1106c32"}
Sep 10 20:36:36.603113 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.603083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" event={"ID":"44fe6670-ad43-49cb-9174-65dc592059e1","Type":"ContainerStarted","Data":"d5d146c64643afbfc5eeffc306be2cab0cb9e4d3cf5c36fcdfb2cd267b817112"}
Sep 10 20:36:36.603169 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.603133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" event={"ID":"44fe6670-ad43-49cb-9174-65dc592059e1","Type":"ContainerStarted","Data":"170dff5a90e8c68d51832a165b0a8c9f4c7f4fae4487de8ba32763cd66790534"}
Sep 10 20:36:36.603231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.603180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" event={"ID":"44fe6670-ad43-49cb-9174-65dc592059e1","Type":"ContainerStarted","Data":"d9b33b1cd191d44f7fb8b1392d3a71d13093e78da4a92f3c8e3f0e5a1d48118a"}
Sep 10 20:36:36.604490 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.604466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rwh9z" event={"ID":"081cc327-993f-45e7-9ef1-27d71931fdc3","Type":"ContainerStarted","Data":"acedd88f6a47fea5799fdb27135de5dbf9458dc2c775f060b9adedcc46ba740e"}
Sep 10 20:36:36.605874 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.605844    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqfdv" event={"ID":"489001a7-8558-49d1-8649-da9d993bfedf","Type":"ContainerStarted","Data":"af0d9170e1a48fcf81cb3b12f14c31ebb03327f0198b53a5f2a5a8160639ad5e"}
Sep 10 20:36:36.607420 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.607399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5klwv" event={"ID":"eb077d28-c480-4c8d-87ea-524fbd67a571","Type":"ContainerStarted","Data":"0fa0201a240bcf6a584dc871da593cace5d6ba72bbb88eccc5f414d3fafe2daf"}
Sep 10 20:36:36.608979 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.608961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fm7gl" event={"ID":"de4cb875-83a4-41ac-85d7-0aff074ccaf8","Type":"ContainerStarted","Data":"260c617af8432be6187865053e9c1dcdf1c1cd7dfa9968bafbb167a22332f035"}
Sep 10 20:36:36.610578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.610502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zrqqq" event={"ID":"25035a46-ed7d-4b5b-96f2-044d90402f30","Type":"ContainerStarted","Data":"d706b635c45d118a014a666cf339851688bef00ef6f22880e7b9b87a6cd4dfbd"}
Sep 10 20:36:36.612110 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.612090    2579 generic.go:356] "Generic (PLEG): container finished" podID="59c8ba8a-e505-428d-b485-1a68ec843e5b" containerID="a5927ab486527716848fb0b56ee5bf6df07223b67e2b7141f951541029581296" exitCode=0
Sep 10 20:36:36.612182 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.612117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hs4zw" event={"ID":"59c8ba8a-e505-428d-b485-1a68ec843e5b","Type":"ContainerDied","Data":"a5927ab486527716848fb0b56ee5bf6df07223b67e2b7141f951541029581296"}
Sep 10 20:36:36.621618 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.621582    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rwh9z" podStartSLOduration=3.750040205 podStartE2EDuration="21.621571182s" totalImagesPullingTime="17.871530977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:36.621538273 +0000 UTC m=+21.658439786" watchObservedRunningTime="2026-09-10 20:36:36.621571182 +0000 UTC m=+21.658472694"
Sep 10 20:36:36.638846 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.638812    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5klwv" podStartSLOduration=7.702006669 podStartE2EDuration="21.638799438s" totalImagesPullingTime="13.936792769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:36.638594511 +0000 UTC m=+21.675496024" watchObservedRunningTime="2026-09-10 20:36:36.638799438 +0000 UTC m=+21.675700990"
Sep 10 20:36:36.659507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.659471    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zrqqq" podStartSLOduration=3.7887237320000002 podStartE2EDuration="21.659460403s" totalImagesPullingTime="17.870736671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:36.659043696 +0000 UTC m=+21.695945210" watchObservedRunningTime="2026-09-10 20:36:36.659460403 +0000 UTC m=+21.696361915"
Sep 10 20:36:36.699119 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.699084    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fm7gl" podStartSLOduration=3.819662451 podStartE2EDuration="21.6990728s" totalImagesPullingTime="17.879410349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:36.698406168 +0000 UTC m=+21.735307681" watchObservedRunningTime="2026-09-10 20:36:36.6990728 +0000 UTC m=+21.735974314"
Sep 10 20:36:36.716110 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.716079    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rqfdv" podStartSLOduration=3.748251568 podStartE2EDuration="21.716068004s" totalImagesPullingTime="17.967816436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:36.715818829 +0000 UTC m=+21.752720341" watchObservedRunningTime="2026-09-10 20:36:36.716068004 +0000 UTC m=+21.752969516"
Sep 10 20:36:36.748200 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.748175    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:36.820847 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.820758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:36.928939 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:36.928906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:37.014961 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.014924    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:37.080195 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.080128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:37.481507 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.481481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:37.481676 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.481481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:37.481676 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:37.481591    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:37.481760 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:37.481702    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:37.481760 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.481480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:37.481834 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:37.481793    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:37.530828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.530747    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 20:36:37.578585 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.578554    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:37.581313 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.581207    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T20:36:37.530762749Z","UUID":"f8d54c5b-5305-4bc9-b79d-c8a8c4a079e3","Handler":null,"Name":"","Endpoint":""}
Sep 10 20:36:37.583210 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.583193    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 20:36:37.583310 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.583219    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 20:36:37.616999 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.616961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" event={"ID":"44fe6670-ad43-49cb-9174-65dc592059e1","Type":"ContainerStarted","Data":"abcbff45d347021d560d8f786e336a3489dc2c9a1276d9576092e78aa8dc3a7c"}
Sep 10 20:36:37.617412 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.617078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" event={"ID":"44fe6670-ad43-49cb-9174-65dc592059e1","Type":"ContainerStarted","Data":"b4bf7ceab8b6b6350e9a988a8e408570ef9b2342363021058bbe22503ef022e5"}
Sep 10 20:36:37.619056 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.619029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8" event={"ID":"71874884-3083-4674-8d44-ff4c994e6121","Type":"ContainerStarted","Data":"7ba47bab904424df29cefd65c52a5ed0ece48412b88d1b4de4b1dad9b88794e7"}
Sep 10 20:36:37.679567 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:37.679534    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:38.622988 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:38.622905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-258w7" event={"ID":"c66f4397-d953-471c-a4cd-cffe164dab6c","Type":"ContainerStarted","Data":"0977b6551c0823fccc1961939d57e6ef8e36cf021a81d172b844888ec0a625ea"}
Sep 10 20:36:38.625240 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:38.625209    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8" event={"ID":"71874884-3083-4674-8d44-ff4c994e6121","Type":"ContainerStarted","Data":"ea3d4484eecca5764a355ddcfb5f5f369c16449350ecc958de692c11ed76294a"}
Sep 10 20:36:38.641641 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:38.641586    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-258w7" podStartSLOduration=5.773442514 podStartE2EDuration="23.641568379s" totalImagesPullingTime="17.868125865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:38.64119351 +0000 UTC m=+23.678095024" watchObservedRunningTime="2026-09-10 20:36:38.641568379 +0000 UTC m=+23.678469892"
Sep 10 20:36:38.661663 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:38.661604    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-429f8" podStartSLOduration=3.971820013 podStartE2EDuration="23.661588202s" totalImagesPullingTime="19.689768189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:38.660853208 +0000 UTC m=+23.697754720" watchObservedRunningTime="2026-09-10 20:36:38.661588202 +0000 UTC m=+23.698489713"
Sep 10 20:36:38.761519 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:38.761488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:38.801450 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:38.801426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:38.801914 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:38.801895    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:38.829038 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:38.829005    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:39.481729 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:39.481697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:39.481992 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:39.481697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:39.481992 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:39.481799    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:39.481992 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:39.481808    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:39.481992 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:39.481884    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:39.481992 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:39.481942    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:39.632150 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:39.632115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" event={"ID":"44fe6670-ad43-49cb-9174-65dc592059e1","Type":"ContainerStarted","Data":"ece5ff4bb979bbd24733b64e30a6df6576be1f334bb4a4e091293396deeabe9b"}
Sep 10 20:36:39.876940 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:39.876836    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:39.943515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:39.943464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:41.023604 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.023568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:41.096671 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.096618    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:41.482125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.481913    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:41.482298 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.481967    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:41.482298 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:41.482207    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:41.482298 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:41.482261    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:41.482298 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.481998    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:41.482521 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:41.482340    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:41.639327 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.639296    2579 generic.go:356] "Generic (PLEG): container finished" podID="59c8ba8a-e505-428d-b485-1a68ec843e5b" containerID="112b44f6348576d81ad9c7b3af3c7cc5d55f08bc38173b8a133c6a94fa596284" exitCode=0
Sep 10 20:36:41.639468 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.639388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hs4zw" event={"ID":"59c8ba8a-e505-428d-b485-1a68ec843e5b","Type":"ContainerDied","Data":"112b44f6348576d81ad9c7b3af3c7cc5d55f08bc38173b8a133c6a94fa596284"}
Sep 10 20:36:41.643282 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.643262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" event={"ID":"44fe6670-ad43-49cb-9174-65dc592059e1","Type":"ContainerStarted","Data":"b8ba4d442d7088208953fb3b4020bb5fc515d835bc9202722fe5244f91f64f6c"}
Sep 10 20:36:41.643522 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.643507    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:41.643575 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.643556    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:41.658020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.658004    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:41.698825 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:41.698789    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs" podStartSLOduration=8.800585799 podStartE2EDuration="26.698776057s" totalImagesPullingTime="17.898190258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:41.697038237 +0000 UTC m=+26.733939761" watchObservedRunningTime="2026-09-10 20:36:41.698776057 +0000 UTC m=+26.735677608"
Sep 10 20:36:42.017057 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:42.017028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:42.112198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:42.112165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:42.647736 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:42.647705    2579 generic.go:356] "Generic (PLEG): container finished" podID="59c8ba8a-e505-428d-b485-1a68ec843e5b" containerID="c41aa12242a5f39e543ab493004568dd876f25cdae39992c65be6cb966577a1f" exitCode=0
Sep 10 20:36:42.647910 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:42.647749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hs4zw" event={"ID":"59c8ba8a-e505-428d-b485-1a68ec843e5b","Type":"ContainerDied","Data":"c41aa12242a5f39e543ab493004568dd876f25cdae39992c65be6cb966577a1f"}
Sep 10 20:36:42.648176 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:42.648156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:42.662093 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:42.662074    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:36:42.750608 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:42.750578    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:42.860993 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:42.860822    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:43.320882 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:43.320856    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8mq6"]
Sep 10 20:36:43.321245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:43.320981    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:43.321245 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:43.321063    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:43.324727 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:43.324605    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdgjw"]
Sep 10 20:36:43.324840 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:43.324733    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:43.324840 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:43.324827    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:43.325317 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:43.325294    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qs4rm"]
Sep 10 20:36:43.325419 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:43.325405    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:43.325519 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:43.325502    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:43.652645 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:43.652599    2579 generic.go:356] "Generic (PLEG): container finished" podID="59c8ba8a-e505-428d-b485-1a68ec843e5b" containerID="0aa4eaa94850b2a7fdc3a0d44fe12324ffd0c3f507172a84bf9cb28822d338a3" exitCode=0
Sep 10 20:36:43.652774 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:43.652667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hs4zw" event={"ID":"59c8ba8a-e505-428d-b485-1a68ec843e5b","Type":"ContainerDied","Data":"0aa4eaa94850b2a7fdc3a0d44fe12324ffd0c3f507172a84bf9cb28822d338a3"}
Sep 10 20:36:45.482594 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:45.482555    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:45.483121 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:45.482669    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:45.483121 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:45.482703    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:45.483121 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:45.482744    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:45.483121 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:45.482768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:45.483121 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:45.482820    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:47.481722 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:47.481485    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:47.482124 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:47.481483    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:47.482124 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:47.481808    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mq6" podUID="2fd289a0-76aa-4446-8a89-f221bd4d7bd8"
Sep 10 20:36:47.482124 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:47.481483    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:47.482124 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:47.481903    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qs4rm" podUID="fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3"
Sep 10 20:36:47.482124 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:47.481991    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdgjw" podUID="dc0f32c9-1e74-4a85-93df-32c8fd1bd874"
Sep 10 20:36:47.580392 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:47.580356    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:47.580565 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:47.580502    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 20:36:47.581068 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:47.581044    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5klwv"
Sep 10 20:36:47.717294 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:47.717261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:49.121474 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.121444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:49.121907 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.121552    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:49.121907 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.121604    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret podName:2fd289a0-76aa-4446-8a89-f221bd4d7bd8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:21.121591579 +0000 UTC m=+66.158493083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret") pod "global-pull-secret-syncer-b8mq6" (UID: "2fd289a0-76aa-4446-8a89-f221bd4d7bd8") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:36:49.222732 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.222706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:49.222862 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.222846    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:49.222913 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.222903    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs podName:fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:21.222888507 +0000 UTC m=+66.259790012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs") pod "network-metrics-daemon-qs4rm" (UID: "fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:36:49.251651 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.251569    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-160.ec2.internal" event="NodeReady"
Sep 10 20:36:49.251764 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.251722    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 20:36:49.307547 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.307518    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5nbzf"]
Sep 10 20:36:49.322382 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.322361    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zhn5f"]
Sep 10 20:36:49.322497 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.322478    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.323029 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.323007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:49.323142 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.323129    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:36:49.323183 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.323145    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:36:49.323183 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.323154    2579 projected.go:196] Error preparing data for projected volume kube-api-access-42w7k for pod openshift-network-diagnostics/network-check-target-bdgjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:49.323248 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.323199    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k podName:dc0f32c9-1e74-4a85-93df-32c8fd1bd874 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:21.323184742 +0000 UTC m=+66.360086245 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-42w7k" (UniqueName: "kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k") pod "network-check-target-bdgjw" (UID: "dc0f32c9-1e74-4a85-93df-32c8fd1bd874") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:36:49.325830 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.325808    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 20:36:49.325830 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.325823    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-89pjq\""
Sep 10 20:36:49.325963 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.325840    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 20:36:49.336432 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.336410    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5nbzf"]
Sep 10 20:36:49.336521 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.336501    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zhn5f"
Sep 10 20:36:49.338951 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.338934    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zhn5f"]
Sep 10 20:36:49.340206 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.340188    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 20:36:49.340303 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.340290    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2vtqg\""
Sep 10 20:36:49.341028 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.341011    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 20:36:49.341107 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.341026    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 20:36:49.424106 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.424078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r72bl\" (UniqueName: \"kubernetes.io/projected/c00bd33f-8694-48a2-87b5-0c85c323752b-kube-api-access-r72bl\") pod \"ingress-canary-zhn5f\" (UID: \"c00bd33f-8694-48a2-87b5-0c85c323752b\") " pod="openshift-ingress-canary/ingress-canary-zhn5f"
Sep 10 20:36:49.424239 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.424112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.424239 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.424134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c00bd33f-8694-48a2-87b5-0c85c323752b-cert\") pod \"ingress-canary-zhn5f\" (UID: \"c00bd33f-8694-48a2-87b5-0c85c323752b\") " pod="openshift-ingress-canary/ingress-canary-zhn5f"
Sep 10 20:36:49.424239 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.424230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4mqh\" (UniqueName: \"kubernetes.io/projected/159ab7b6-4a77-418a-94d1-22a814d1bb64-kube-api-access-v4mqh\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.424364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.424272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159ab7b6-4a77-418a-94d1-22a814d1bb64-tmp-dir\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.424364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.424289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/159ab7b6-4a77-418a-94d1-22a814d1bb64-config-volume\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.478594 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.478564    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:49.481412 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.481390    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:36:49.481542 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.481394    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:36:49.481602 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.481560    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:36:49.487324 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.487307    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:36:49.487445 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.487328    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ks6z6\""
Sep 10 20:36:49.487501 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.487452    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d24xx\""
Sep 10 20:36:49.487558 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.487525    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:36:49.487614 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.487531    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 20:36:49.487614 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.487573    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 20:36:49.524717 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.524653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c00bd33f-8694-48a2-87b5-0c85c323752b-cert\") pod \"ingress-canary-zhn5f\" (UID: \"c00bd33f-8694-48a2-87b5-0c85c323752b\") " pod="openshift-ingress-canary/ingress-canary-zhn5f"
Sep 10 20:36:49.524821 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.524731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4mqh\" (UniqueName: \"kubernetes.io/projected/159ab7b6-4a77-418a-94d1-22a814d1bb64-kube-api-access-v4mqh\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.524821 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.524776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159ab7b6-4a77-418a-94d1-22a814d1bb64-tmp-dir\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.524940 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.524887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/159ab7b6-4a77-418a-94d1-22a814d1bb64-config-volume\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.524940 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.524914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r72bl\" (UniqueName: \"kubernetes.io/projected/c00bd33f-8694-48a2-87b5-0c85c323752b-kube-api-access-r72bl\") pod \"ingress-canary-zhn5f\" (UID: \"c00bd33f-8694-48a2-87b5-0c85c323752b\") " pod="openshift-ingress-canary/ingress-canary-zhn5f"
Sep 10 20:36:49.524940 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.524934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.525092 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.525030    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:36:49.525092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.525056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159ab7b6-4a77-418a-94d1-22a814d1bb64-tmp-dir\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.525166 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:49.525103    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls podName:159ab7b6-4a77-418a-94d1-22a814d1bb64 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:50.025083707 +0000 UTC m=+35.061985212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls") pod "dns-default-5nbzf" (UID: "159ab7b6-4a77-418a-94d1-22a814d1bb64") : secret "dns-default-metrics-tls" not found
Sep 10 20:36:49.525418 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.525402    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/159ab7b6-4a77-418a-94d1-22a814d1bb64-config-volume\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.528612 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.528597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c00bd33f-8694-48a2-87b5-0c85c323752b-cert\") pod \"ingress-canary-zhn5f\" (UID: \"c00bd33f-8694-48a2-87b5-0c85c323752b\") " pod="openshift-ingress-canary/ingress-canary-zhn5f"
Sep 10 20:36:49.535458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.535438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4mqh\" (UniqueName: \"kubernetes.io/projected/159ab7b6-4a77-418a-94d1-22a814d1bb64-kube-api-access-v4mqh\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:49.535532 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.535450    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r72bl\" (UniqueName: \"kubernetes.io/projected/c00bd33f-8694-48a2-87b5-0c85c323752b-kube-api-access-r72bl\") pod \"ingress-canary-zhn5f\" (UID: \"c00bd33f-8694-48a2-87b5-0c85c323752b\") " pod="openshift-ingress-canary/ingress-canary-zhn5f"
Sep 10 20:36:49.573446 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.573413    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:49.645940 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.645914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zhn5f"
Sep 10 20:36:49.668584 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.668556    2579 generic.go:356] "Generic (PLEG): container finished" podID="59c8ba8a-e505-428d-b485-1a68ec843e5b" containerID="b97ded57f50c5c4fa1dbd1303aa07b7e351881cd3877c9e6960425bcd37fd716" exitCode=0
Sep 10 20:36:49.668714 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.668610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hs4zw" event={"ID":"59c8ba8a-e505-428d-b485-1a68ec843e5b","Type":"ContainerDied","Data":"b97ded57f50c5c4fa1dbd1303aa07b7e351881cd3877c9e6960425bcd37fd716"}
Sep 10 20:36:49.979604 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:49.979426    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zhn5f"]
Sep 10 20:36:49.982953 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:36:49.982928    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00bd33f_8694_48a2_87b5_0c85c323752b.slice/crio-404823fa17f26a12f803c73c83d8d0b4352cfcf3294b9bfa231c94650d4a0370 WatchSource:0}: Error finding container 404823fa17f26a12f803c73c83d8d0b4352cfcf3294b9bfa231c94650d4a0370: Status 404 returned error can't find the container with id 404823fa17f26a12f803c73c83d8d0b4352cfcf3294b9bfa231c94650d4a0370
Sep 10 20:36:50.029308 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:50.029212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:50.029460 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:50.029317    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:36:50.029460 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:50.029376    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls podName:159ab7b6-4a77-418a-94d1-22a814d1bb64 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:51.029355329 +0000 UTC m=+36.066256821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls") pod "dns-default-5nbzf" (UID: "159ab7b6-4a77-418a-94d1-22a814d1bb64") : secret "dns-default-metrics-tls" not found
Sep 10 20:36:50.676947 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:50.676904    2579 generic.go:356] "Generic (PLEG): container finished" podID="59c8ba8a-e505-428d-b485-1a68ec843e5b" containerID="61c10339fc175e0ce6611498a499f1df66811a3ec892176ce792087720b637b2" exitCode=0
Sep 10 20:36:50.677743 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:50.677024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hs4zw" event={"ID":"59c8ba8a-e505-428d-b485-1a68ec843e5b","Type":"ContainerDied","Data":"61c10339fc175e0ce6611498a499f1df66811a3ec892176ce792087720b637b2"}
Sep 10 20:36:50.679316 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:50.679291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zhn5f" event={"ID":"c00bd33f-8694-48a2-87b5-0c85c323752b","Type":"ContainerStarted","Data":"404823fa17f26a12f803c73c83d8d0b4352cfcf3294b9bfa231c94650d4a0370"}
Sep 10 20:36:51.036398 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:51.036301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:51.036587 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:51.036453    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:36:51.036587 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:51.036531    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls podName:159ab7b6-4a77-418a-94d1-22a814d1bb64 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:53.036511147 +0000 UTC m=+38.073412651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls") pod "dns-default-5nbzf" (UID: "159ab7b6-4a77-418a-94d1-22a814d1bb64") : secret "dns-default-metrics-tls" not found
Sep 10 20:36:51.685851 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:51.685812    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hs4zw" event={"ID":"59c8ba8a-e505-428d-b485-1a68ec843e5b","Type":"ContainerStarted","Data":"d6409c163ef63bf3457b59cd95c801217470fba53ecef743f1665a00879822ed"}
Sep 10 20:36:51.714115 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:51.714061    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hs4zw" podStartSLOduration=7.498877729 podStartE2EDuration="36.714043322s" totalImagesPullingTime="29.215165593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:51.71271222 +0000 UTC m=+36.749613732" watchObservedRunningTime="2026-09-10 20:36:51.714043322 +0000 UTC m=+36.750944835"
Sep 10 20:36:51.875237 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:51.875200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:51.984980 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:51.984897    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:53.051059 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:53.050832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:53.051059 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:53.050996    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:36:53.051440 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:53.051064    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls podName:159ab7b6-4a77-418a-94d1-22a814d1bb64 nodeName:}" failed. No retries permitted until 2026-09-10 20:36:57.051049185 +0000 UTC m=+42.087950682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls") pod "dns-default-5nbzf" (UID: "159ab7b6-4a77-418a-94d1-22a814d1bb64") : secret "dns-default-metrics-tls" not found
Sep 10 20:36:53.692424 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:53.692389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zhn5f" event={"ID":"c00bd33f-8694-48a2-87b5-0c85c323752b","Type":"ContainerStarted","Data":"dc5cf7372665a6a27ca7b14699cd77ab24b873e0ce2b6f95ec68690a525f7481"}
Sep 10 20:36:53.713943 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:53.713896    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zhn5f" podStartSLOduration=1.997028447 podStartE2EDuration="4.713879714s" totalImagesPullingTime="2.716851267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:36:53.71337437 +0000 UTC m=+38.750275879" watchObservedRunningTime="2026-09-10 20:36:53.713879714 +0000 UTC m=+38.750781227"
Sep 10 20:36:54.403986 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:54.403954    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:54.508923 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:54.508890    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:36:57.077192 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:36:57.077148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:36:57.077579 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:57.077303    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:36:57.077579 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:36:57.077374    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls podName:159ab7b6-4a77-418a-94d1-22a814d1bb64 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:05.077349498 +0000 UTC m=+50.114251009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls") pod "dns-default-5nbzf" (UID: "159ab7b6-4a77-418a-94d1-22a814d1bb64") : secret "dns-default-metrics-tls" not found
Sep 10 20:37:02.006750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:02.006713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:02.112834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:02.112799    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:02.193826 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:02.193793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:04.024317 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.024286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:04.124744 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.124713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:04.757159 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.757127    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"]
Sep 10 20:37:04.787899 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.787871    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"]
Sep 10 20:37:04.788040 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.787957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:04.793185 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.793156    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 20:37:04.793185 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.793185    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 20:37:04.793388 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.793164    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 20:37:04.794255 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.794228    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-llwmb\""
Sep 10 20:37:04.794370 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.794325    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 20:37:04.861728 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.861692    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"]
Sep 10 20:37:04.882035 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.882005    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-644c5d48fd-8jn7w"]
Sep 10 20:37:04.882195 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.882132    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:04.885876 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.885854    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 20:37:04.885975 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.885875    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:37:04.885975 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.885877    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 20:37:04.886040 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.885995    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8s57q\""
Sep 10 20:37:04.886183 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.886163    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 20:37:04.902128 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.902104    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"]
Sep 10 20:37:04.902230 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.902184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:04.905999 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.905963    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-644c5d48fd-8jn7w"]
Sep 10 20:37:04.905999 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.905979    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hstsn\""
Sep 10 20:37:04.906180 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.906112    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 20:37:04.908802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.908285    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 20:37:04.908802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.908397    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 20:37:04.908802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.908498    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 20:37:04.908802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.908619    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 20:37:04.908802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.908711    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 20:37:04.930046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.930021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:04.930141 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.930068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:04.930141 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:04.930125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shgxj\" (UniqueName: \"kubernetes.io/projected/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-kube-api-access-shgxj\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:05.030670 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.030559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:05.030670 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.030596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.030670 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.030615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9511892-7ea1-4dc9-a501-3f878a6c1d0f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-fk9n8\" (UID: \"a9511892-7ea1-4dc9-a501-3f878a6c1d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.030670 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.030653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz96d\" (UniqueName: \"kubernetes.io/projected/a9511892-7ea1-4dc9-a501-3f878a6c1d0f-kube-api-access-qz96d\") pod \"kube-storage-version-migrator-operator-6c8f84f897-fk9n8\" (UID: \"a9511892-7ea1-4dc9-a501-3f878a6c1d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.031206 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.031007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shgxj\" (UniqueName: \"kubernetes.io/projected/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-kube-api-access-shgxj\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:05.031780 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.031752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:05.032165 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.032143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-default-certificate\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.032239 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.032221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxt76\" (UniqueName: \"kubernetes.io/projected/d6aa23a4-abe7-44dc-9690-f0e612b133c8-kube-api-access-lxt76\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.032291 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.032265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-stats-auth\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.032338 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.032296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9511892-7ea1-4dc9-a501-3f878a6c1d0f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-fk9n8\" (UID: \"a9511892-7ea1-4dc9-a501-3f878a6c1d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.032338 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.032328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.032435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.032395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:05.032609 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.032594    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:05.032700 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.032688    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls podName:53fcf57c-3ebd-4596-b0d5-c5c2d069c246 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:05.532670065 +0000 UTC m=+50.569571557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-jntp6" (UID: "53fcf57c-3ebd-4596-b0d5-c5c2d069c246") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:05.042262 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.042240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shgxj\" (UniqueName: \"kubernetes.io/projected/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-kube-api-access-shgxj\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:05.113523 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.113491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:05.132881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.132857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:37:05.132943 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.132885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-default-certificate\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.132943 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.132905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxt76\" (UniqueName: \"kubernetes.io/projected/d6aa23a4-abe7-44dc-9690-f0e612b133c8-kube-api-access-lxt76\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.132943 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.132924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-stats-auth\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.133061 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.132998    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:37:05.133109 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.133063    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls podName:159ab7b6-4a77-418a-94d1-22a814d1bb64 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:21.133049545 +0000 UTC m=+66.169951054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls") pod "dns-default-5nbzf" (UID: "159ab7b6-4a77-418a-94d1-22a814d1bb64") : secret "dns-default-metrics-tls" not found
Sep 10 20:37:05.133169 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.133135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9511892-7ea1-4dc9-a501-3f878a6c1d0f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-fk9n8\" (UID: \"a9511892-7ea1-4dc9-a501-3f878a6c1d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.133221 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.133188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.133315 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.133291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.133450 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.133327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9511892-7ea1-4dc9-a501-3f878a6c1d0f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-fk9n8\" (UID: \"a9511892-7ea1-4dc9-a501-3f878a6c1d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.133450 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.133350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz96d\" (UniqueName: \"kubernetes.io/projected/a9511892-7ea1-4dc9-a501-3f878a6c1d0f-kube-api-access-qz96d\") pod \"kube-storage-version-migrator-operator-6c8f84f897-fk9n8\" (UID: \"a9511892-7ea1-4dc9-a501-3f878a6c1d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.133450 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.133393    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:37:05.133450 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.133421    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:05.633403244 +0000 UTC m=+50.670304756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : configmap references non-existent config key: service-ca.crt
Sep 10 20:37:05.133697 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.133470    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:05.633452096 +0000 UTC m=+50.670353588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : secret "router-metrics-certs-default" not found
Sep 10 20:37:05.133747 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.133696    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9511892-7ea1-4dc9-a501-3f878a6c1d0f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-fk9n8\" (UID: \"a9511892-7ea1-4dc9-a501-3f878a6c1d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.135412 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.135385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9511892-7ea1-4dc9-a501-3f878a6c1d0f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-fk9n8\" (UID: \"a9511892-7ea1-4dc9-a501-3f878a6c1d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.135490 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.135418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-default-certificate\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.135490 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.135391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-stats-auth\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.144883 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.144863    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz96d\" (UniqueName: \"kubernetes.io/projected/a9511892-7ea1-4dc9-a501-3f878a6c1d0f-kube-api-access-qz96d\") pod \"kube-storage-version-migrator-operator-6c8f84f897-fk9n8\" (UID: \"a9511892-7ea1-4dc9-a501-3f878a6c1d0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.145271 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.145254    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxt76\" (UniqueName: \"kubernetes.io/projected/d6aa23a4-abe7-44dc-9690-f0e612b133c8-kube-api-access-lxt76\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.190694 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.190672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"
Sep 10 20:37:05.216547 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.216518    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:05.494800 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.494764    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8"]
Sep 10 20:37:05.499534 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:05.498125    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9511892_7ea1_4dc9_a501_3f878a6c1d0f.slice/crio-7568dfa2e2e37e4b5093e35ea6a929ab747eef3e6458340ff3b32afb3d3d800f WatchSource:0}: Error finding container 7568dfa2e2e37e4b5093e35ea6a929ab747eef3e6458340ff3b32afb3d3d800f: Status 404 returned error can't find the container with id 7568dfa2e2e37e4b5093e35ea6a929ab747eef3e6458340ff3b32afb3d3d800f
Sep 10 20:37:05.537812 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.537788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:05.537929 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.537905    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:05.537967 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.537962    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls podName:53fcf57c-3ebd-4596-b0d5-c5c2d069c246 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:06.537948012 +0000 UTC m=+51.574849508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-jntp6" (UID: "53fcf57c-3ebd-4596-b0d5-c5c2d069c246") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:05.638124 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.638097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.638273 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.638178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:05.638273 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.638235    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:37:05.638346 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.638289    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:06.638270371 +0000 UTC m=+51.675171863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : secret "router-metrics-certs-default" not found
Sep 10 20:37:05.638346 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:05.638309    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:06.638302658 +0000 UTC m=+51.675204148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : configmap references non-existent config key: service-ca.crt
Sep 10 20:37:05.719811 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:05.719780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8" event={"ID":"a9511892-7ea1-4dc9-a501-3f878a6c1d0f","Type":"ContainerStarted","Data":"7568dfa2e2e37e4b5093e35ea6a929ab747eef3e6458340ff3b32afb3d3d800f"}
Sep 10 20:37:06.544480 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:06.544448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:06.544950 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:06.544644    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:06.544950 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:06.544730    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls podName:53fcf57c-3ebd-4596-b0d5-c5c2d069c246 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:08.544708137 +0000 UTC m=+53.581609642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-jntp6" (UID: "53fcf57c-3ebd-4596-b0d5-c5c2d069c246") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:06.645678 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:06.645644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:06.645846 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:06.645720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:06.645846 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:06.645814    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:37:06.645937 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:06.645884    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:08.645863947 +0000 UTC m=+53.682765443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : secret "router-metrics-certs-default" not found
Sep 10 20:37:06.645937 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:06.645902    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:08.645893418 +0000 UTC m=+53.682794913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : configmap references non-existent config key: service-ca.crt
Sep 10 20:37:07.606899 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.606859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"]
Sep 10 20:37:07.611010 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.610990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.613887 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.613860    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 20:37:07.613887 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.613868    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 20:37:07.613887 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.613864    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:37:07.614133 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.613924    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-frgwx\""
Sep 10 20:37:07.614133 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.613867    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 20:37:07.623492 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.623469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"]
Sep 10 20:37:07.753609 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.753575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c170710-3d50-48ae-addc-bc14969cbc88-config\") pod \"service-ca-operator-cf7c776b7-95wr7\" (UID: \"1c170710-3d50-48ae-addc-bc14969cbc88\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.753609 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.753616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c170710-3d50-48ae-addc-bc14969cbc88-serving-cert\") pod \"service-ca-operator-cf7c776b7-95wr7\" (UID: \"1c170710-3d50-48ae-addc-bc14969cbc88\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.753824 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.753655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv44d\" (UniqueName: \"kubernetes.io/projected/1c170710-3d50-48ae-addc-bc14969cbc88-kube-api-access-bv44d\") pod \"service-ca-operator-cf7c776b7-95wr7\" (UID: \"1c170710-3d50-48ae-addc-bc14969cbc88\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.854531 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.854490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c170710-3d50-48ae-addc-bc14969cbc88-config\") pod \"service-ca-operator-cf7c776b7-95wr7\" (UID: \"1c170710-3d50-48ae-addc-bc14969cbc88\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.854676 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.854543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c170710-3d50-48ae-addc-bc14969cbc88-serving-cert\") pod \"service-ca-operator-cf7c776b7-95wr7\" (UID: \"1c170710-3d50-48ae-addc-bc14969cbc88\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.854676 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.854584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv44d\" (UniqueName: \"kubernetes.io/projected/1c170710-3d50-48ae-addc-bc14969cbc88-kube-api-access-bv44d\") pod \"service-ca-operator-cf7c776b7-95wr7\" (UID: \"1c170710-3d50-48ae-addc-bc14969cbc88\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.855181 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.855116    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c170710-3d50-48ae-addc-bc14969cbc88-config\") pod \"service-ca-operator-cf7c776b7-95wr7\" (UID: \"1c170710-3d50-48ae-addc-bc14969cbc88\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.856884 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.856866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c170710-3d50-48ae-addc-bc14969cbc88-serving-cert\") pod \"service-ca-operator-cf7c776b7-95wr7\" (UID: \"1c170710-3d50-48ae-addc-bc14969cbc88\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.864568 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.864520    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv44d\" (UniqueName: \"kubernetes.io/projected/1c170710-3d50-48ae-addc-bc14969cbc88-kube-api-access-bv44d\") pod \"service-ca-operator-cf7c776b7-95wr7\" (UID: \"1c170710-3d50-48ae-addc-bc14969cbc88\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:07.920820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:07.920797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"
Sep 10 20:37:08.194528 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.194496    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7"]
Sep 10 20:37:08.561166 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.561073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:08.561307 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:08.561227    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:08.561307 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:08.561297    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls podName:53fcf57c-3ebd-4596-b0d5-c5c2d069c246 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:12.561279199 +0000 UTC m=+57.598180710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-jntp6" (UID: "53fcf57c-3ebd-4596-b0d5-c5c2d069c246") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:08.661745 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.661707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:08.662100 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.661780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:08.662100 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:08.661870    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:37:08.662100 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:08.661927    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:12.661905246 +0000 UTC m=+57.698806752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : configmap references non-existent config key: service-ca.crt
Sep 10 20:37:08.662100 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:08.661947    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:12.661940358 +0000 UTC m=+57.698841849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : secret "router-metrics-certs-default" not found
Sep 10 20:37:08.723085 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.723038    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:08.730057 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.730024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7" event={"ID":"1c170710-3d50-48ae-addc-bc14969cbc88","Type":"ContainerStarted","Data":"20684050e856a2b78916bdb596f7b91d47f03683c29d444f2199ab4eb2b551e1"}
Sep 10 20:37:08.731789 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.731756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8" event={"ID":"a9511892-7ea1-4dc9-a501-3f878a6c1d0f","Type":"ContainerStarted","Data":"ef0bc57b822ee6c378f4f96a9e4c91c577ebc7f6c57a0408626d2f2026dde43c"}
Sep 10 20:37:08.753146 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.753092    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8" podStartSLOduration=2.414059582 podStartE2EDuration="4.753073564s" totalImagesPullingTime="2.339013982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:08.752770663 +0000 UTC m=+53.789672177" watchObservedRunningTime="2026-09-10 20:37:08.753073564 +0000 UTC m=+53.789975097"
Sep 10 20:37:08.809620 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.809585    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:08.911243 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:08.911205    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:09.087499 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.087465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:09.167581 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.167491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:09.760674 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.760646    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t4j98"]
Sep 10 20:37:09.763821 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.763804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.766621 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.766599    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 20:37:09.767252 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.767229    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-djk6c\""
Sep 10 20:37:09.768074 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.768056    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 20:37:09.768165 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.768096    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 20:37:09.768165 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.768114    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 20:37:09.777295 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.777276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t4j98"]
Sep 10 20:37:09.784625 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.784602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:09.851517 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.851485    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:09.872522 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.872496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.872645 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.872563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68r6z\" (UniqueName: \"kubernetes.io/projected/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-api-access-68r6z\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.872824 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.872804    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4b69635-fc44-42aa-9405-a21c0c485f8e-crio-socket\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.872897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.872842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4b69635-fc44-42aa-9405-a21c0c485f8e-data-volume\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.872897 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.872887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.974286 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.974252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.974460 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.974373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.974460 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.974402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68r6z\" (UniqueName: \"kubernetes.io/projected/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-api-access-68r6z\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.974460 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:09.974414    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:09.974460 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.974439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4b69635-fc44-42aa-9405-a21c0c485f8e-crio-socket\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.974749 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:09.974480    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:10.474460603 +0000 UTC m=+55.511362110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:09.974749 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.974508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4b69635-fc44-42aa-9405-a21c0c485f8e-data-volume\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.974749 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.974516    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4b69635-fc44-42aa-9405-a21c0c485f8e-crio-socket\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.974749 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:09.974556    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:37:09.974749 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:09.974681    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:10.474643706 +0000 UTC m=+55.511545211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : configmap "kube-rbac-proxy" not found
Sep 10 20:37:09.974973 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.974831    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4b69635-fc44-42aa-9405-a21c0c485f8e-data-volume\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:09.984188 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:09.984164    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68r6z\" (UniqueName: \"kubernetes.io/projected/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-api-access-68r6z\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:10.480160 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:10.480119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:10.480354 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:10.480212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:10.480354 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:10.480264    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:37:10.480354 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:10.480341    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:11.480319593 +0000 UTC m=+56.517221101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : configmap "kube-rbac-proxy" not found
Sep 10 20:37:10.480354 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:10.480346    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:10.480536 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:10.480403    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:11.480392523 +0000 UTC m=+56.517294021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:11.120845 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:11.120763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:11.205660 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:11.205614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:11.489347 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:11.489316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:11.489521 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:11.489373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:11.489521 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:11.489447    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:37:11.489521 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:11.489497    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:11.489521 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:11.489516    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:13.489495245 +0000 UTC m=+58.526396750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : configmap "kube-rbac-proxy" not found
Sep 10 20:37:11.489691 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:11.489536    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:13.489525219 +0000 UTC m=+58.526426727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:11.741728 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:11.741644    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7" event={"ID":"1c170710-3d50-48ae-addc-bc14969cbc88","Type":"ContainerStarted","Data":"7b06f9fc6bf4161a682ad9cc4b93332800c4860042b1f8fc65062e9e3b080879"}
Sep 10 20:37:12.159789 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:12.159755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:12.265282 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:12.265251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:12.505881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:12.505809    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rwh9z_081cc327-993f-45e7-9ef1-27d71931fdc3/dns-node-resolver/0.log"
Sep 10 20:37:12.599615 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:12.599578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:12.599773 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:12.599725    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:12.599809 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:12.599788    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls podName:53fcf57c-3ebd-4596-b0d5-c5c2d069c246 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:20.599772547 +0000 UTC m=+65.636674039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-jntp6" (UID: "53fcf57c-3ebd-4596-b0d5-c5c2d069c246") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:12.700934 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:12.700897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:12.701094 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:12.700968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:12.701094 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:12.701046    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:37:12.701177 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:12.701106    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:20.701091 +0000 UTC m=+65.737992491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : secret "router-metrics-certs-default" not found
Sep 10 20:37:12.701177 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:12.701122    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:20.701116257 +0000 UTC m=+65.738017749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : configmap references non-existent config key: service-ca.crt
Sep 10 20:37:12.902988 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:12.902956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:13.025715 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:13.014526    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:13.507246 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:13.507216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:13.507727 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:13.507391    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:13.507727 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:13.507437    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:37:13.507727 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:13.507390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:13.507727 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:13.507462    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:17.507443152 +0000 UTC m=+62.544344667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:13.507727 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:13.507486    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:17.507475593 +0000 UTC m=+62.544377091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : configmap "kube-rbac-proxy" not found
Sep 10 20:37:13.707186 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:13.707160    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zrqqq_25035a46-ed7d-4b5b-96f2-044d90402f30/node-ca/0.log"
Sep 10 20:37:14.497494 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:14.497463    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:14.504159 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:14.504135    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zhn5f_c00bd33f-8694-48a2-87b5-0c85c323752b/serve-healthcheck-canary/0.log"
Sep 10 20:37:14.568693 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:14.568658    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:14.665524 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:14.665494    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-52jzs"
Sep 10 20:37:14.705848 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:14.705799    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7" podStartSLOduration=5.110180057 podStartE2EDuration="7.705784573s" totalImagesPullingTime="2.595604516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:11.762193503 +0000 UTC m=+56.799095017" watchObservedRunningTime="2026-09-10 20:37:14.705784573 +0000 UTC m=+59.742686093"
Sep 10 20:37:14.862058 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:14.861985    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:14.944701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:14.944672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:15.022190 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:15.022162    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:15.105050 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:15.105024    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-fk9n8_a9511892-7ea1-4dc9-a501-3f878a6c1d0f/kube-storage-version-migrator-operator/0.log"
Sep 10 20:37:15.511445 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:15.511417    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:17.537168 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:17.537125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:17.537562 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:17.537209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:17.537562 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:17.537248    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:37:17.537562 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:17.537304    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:25.53728949 +0000 UTC m=+70.574190981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : configmap "kube-rbac-proxy" not found
Sep 10 20:37:17.537562 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:17.537343    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:17.537562 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:17.537396    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:25.537382099 +0000 UTC m=+70.574283604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:18.331850 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:18.331809    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:18.433276 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:18.433245    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:18.547757 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:18.547729    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:18.651903 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:18.651875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:18.903120 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:18.903045    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:19.220932 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:19.220853    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:20.028921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:20.028887    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:20.410578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:20.410547    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:20.618407 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:20.618376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:20.660515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:20.660471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:20.660729 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:20.660623    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:20.660729 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:20.660700    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls podName:53fcf57c-3ebd-4596-b0d5-c5c2d069c246 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:36.660684707 +0000 UTC m=+81.697586197 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-jntp6" (UID: "53fcf57c-3ebd-4596-b0d5-c5c2d069c246") : secret "cluster-monitoring-operator-tls" not found
Sep 10 20:37:20.761132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:20.761097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:20.761294 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:20.761193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:20.761294 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:20.761243    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:37:20.761377 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:20.761307    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:36.761292399 +0000 UTC m=+81.798193893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : secret "router-metrics-certs-default" not found
Sep 10 20:37:20.761377 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:20.761366    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle podName:d6aa23a4-abe7-44dc-9690-f0e612b133c8 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:36.761345179 +0000 UTC m=+81.798246685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle") pod "router-default-644c5d48fd-8jn7w" (UID: "d6aa23a4-abe7-44dc-9690-f0e612b133c8") : configmap references non-existent config key: service-ca.crt
Sep 10 20:37:20.845217 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:20.845186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:21.014331 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.014250    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:21.165263 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.165231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:37:21.165615 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.165300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:37:21.165615 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:21.165396    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:37:21.165615 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:21.165457    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls podName:159ab7b6-4a77-418a-94d1-22a814d1bb64 nodeName:}" failed. No retries permitted until 2026-09-10 20:37:53.165442191 +0000 UTC m=+98.202343684 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls") pod "dns-default-5nbzf" (UID: "159ab7b6-4a77-418a-94d1-22a814d1bb64") : secret "dns-default-metrics-tls" not found
Sep 10 20:37:21.168371 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.168355    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:37:21.177915 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.177897    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2fd289a0-76aa-4446-8a89-f221bd4d7bd8-original-pull-secret\") pod \"global-pull-secret-syncer-b8mq6\" (UID: \"2fd289a0-76aa-4446-8a89-f221bd4d7bd8\") " pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:37:21.266266 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.266196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:37:21.269319 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.269305    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:37:21.277168 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:21.277151    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 20:37:21.277217 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:21.277201    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs podName:fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3 nodeName:}" failed. No retries permitted until 2026-09-10 20:38:25.277189472 +0000 UTC m=+130.314090963 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs") pod "network-metrics-daemon-qs4rm" (UID: "fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3") : secret "metrics-daemon-secret" not found
Sep 10 20:37:21.291143 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.291123    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mq6"
Sep 10 20:37:21.367315 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.367288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:37:21.370934 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.370916    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 20:37:21.381216 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.381189    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 20:37:21.390929 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.390906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42w7k\" (UniqueName: \"kubernetes.io/projected/dc0f32c9-1e74-4a85-93df-32c8fd1bd874-kube-api-access-42w7k\") pod \"network-check-target-bdgjw\" (UID: \"dc0f32c9-1e74-4a85-93df-32c8fd1bd874\") " pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:37:21.565274 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.565246    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8mq6"]
Sep 10 20:37:21.567414 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:21.567390    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd289a0_76aa_4446_8a89_f221bd4d7bd8.slice/crio-93c1219c490336a1c6c440f088a48c812bec54fff93870a7d2e9d16ebe253c90 WatchSource:0}: Error finding container 93c1219c490336a1c6c440f088a48c812bec54fff93870a7d2e9d16ebe253c90: Status 404 returned error can't find the container with id 93c1219c490336a1c6c440f088a48c812bec54fff93870a7d2e9d16ebe253c90
Sep 10 20:37:21.604458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.604436    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d24xx\""
Sep 10 20:37:21.612219 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.612202    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:37:21.766193 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.766159    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8mq6" event={"ID":"2fd289a0-76aa-4446-8a89-f221bd4d7bd8","Type":"ContainerStarted","Data":"93c1219c490336a1c6c440f088a48c812bec54fff93870a7d2e9d16ebe253c90"}
Sep 10 20:37:21.805938 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.805911    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:21.889789 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.889727    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdgjw"]
Sep 10 20:37:21.892218 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:21.892194    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0f32c9_1e74_4a85_93df_32c8fd1bd874.slice/crio-d0f1b289db01796c37076fce08fb997ace00e278150a530c5e128de3f802c044 WatchSource:0}: Error finding container d0f1b289db01796c37076fce08fb997ace00e278150a530c5e128de3f802c044: Status 404 returned error can't find the container with id d0f1b289db01796c37076fce08fb997ace00e278150a530c5e128de3f802c044
Sep 10 20:37:21.911622 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:21.911591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:22.030022 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:22.029993    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:22.229075 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:22.229043    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:22.381176 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:22.381143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:22.623882 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:22.623797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:22.770370 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:22.770340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdgjw" event={"ID":"dc0f32c9-1e74-4a85-93df-32c8fd1bd874","Type":"ContainerStarted","Data":"d0f1b289db01796c37076fce08fb997ace00e278150a530c5e128de3f802c044"}
Sep 10 20:37:22.902152 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:22.902119    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:23.018051 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:23.018017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:23.411433 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:23.411401    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:23.823866 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:23.823763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:24.233745 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:24.233706    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:24.460641 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:24.460595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:24.588366 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:24.588276    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:24.843784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:24.843701    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:25.409021 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:25.408986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:25.602180 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:25.602151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:25.602617 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:25.602221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:25.602617 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:25.602394    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:25.602617 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:25.602472    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls podName:f4b69635-fc44-42aa-9405-a21c0c485f8e nodeName:}" failed. No retries permitted until 2026-09-10 20:37:41.602450988 +0000 UTC m=+86.639352489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t4j98" (UID: "f4b69635-fc44-42aa-9405-a21c0c485f8e") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:37:25.602812 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:25.602798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4b69635-fc44-42aa-9405-a21c0c485f8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:25.817583 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:25.817502    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:26.016134 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:26.016094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:26.216422 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:26.216386    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:26.782428 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:26.782391    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdgjw" event={"ID":"dc0f32c9-1e74-4a85-93df-32c8fd1bd874","Type":"ContainerStarted","Data":"571bb52b9d043763860cf85916e7aebb7b811befe44e0d36c712b9f663536b4d"}
Sep 10 20:37:26.782875 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:26.782493    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:37:26.783909 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:26.783888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8mq6" event={"ID":"2fd289a0-76aa-4446-8a89-f221bd4d7bd8","Type":"ContainerStarted","Data":"5bd2c5c4b535a54f1eebe178f16a1cf30ccc825b1805a8601e36c4d095a7ca1f"}
Sep 10 20:37:26.804969 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:26.804928    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bdgjw" podStartSLOduration=67.608786109 podStartE2EDuration="1m11.80491487s" totalImagesPullingTime="4.196128761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:26.804287926 +0000 UTC m=+71.841189439" watchObservedRunningTime="2026-09-10 20:37:26.80491487 +0000 UTC m=+71.841816383"
Sep 10 20:37:26.825479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:26.825431    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b8mq6" podStartSLOduration=67.299613248 podStartE2EDuration="1m11.825418502s" totalImagesPullingTime="4.525805254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:26.824746839 +0000 UTC m=+71.861648352" watchObservedRunningTime="2026-09-10 20:37:26.825418502 +0000 UTC m=+71.862320023"
Sep 10 20:37:27.419599 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:27.419567    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:27.694491 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:27.694399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:27.892683 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:27.892653    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:28.014577 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:28.014481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:28.121600 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:28.121563    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:28.242244 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:28.242200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:28.799689 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:28.799658    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:29.034129 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:29.034095    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:29.558762 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:29.558731    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:29.658188 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:29.658151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:29.871215 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:29.871128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:30.238843 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:30.238807    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:30.336294 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:30.336262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:30.458382 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:30.458351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:30.571855 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:30.571764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:31.051625 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:31.051590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:31.405869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:31.405838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:31.612665 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:31.612614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:31.752027 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:31.751939    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:31.879058 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:31.879026    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:35.496057 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.496029    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"]
Sep 10 20:37:35.499191 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.499176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"
Sep 10 20:37:35.501673 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.501651    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"]
Sep 10 20:37:35.504571 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.504538    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:35.507367 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.507351    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 20:37:35.507428 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.507383    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-trm4d\""
Sep 10 20:37:35.521916 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:35.521887    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"work-manager-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-143-160.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-143-160.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" type="*v1.Secret"
Sep 10 20:37:35.532467 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.532444    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 20:37:35.532556 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.532499    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 20:37:35.532556 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.532516    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 20:37:35.532681 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.532575    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 20:37:35.545025 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.545006    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"]
Sep 10 20:37:35.545803 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.545786    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"]
Sep 10 20:37:35.582059 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.582030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2397d76c-5ec4-4dac-b7b9-7d377710d97f-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-g667l\" (UID: \"2397d76c-5ec4-4dac-b7b9-7d377710d97f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"
Sep 10 20:37:35.582163 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.582061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1faa215-118c-4436-9e54-057bb6d4366a-tmp\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:35.582163 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.582090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2397d76c-5ec4-4dac-b7b9-7d377710d97f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-g667l\" (UID: \"2397d76c-5ec4-4dac-b7b9-7d377710d97f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"
Sep 10 20:37:35.582274 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.582182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d1faa215-118c-4436-9e54-057bb6d4366a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:35.582328 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.582279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmbb4\" (UniqueName: \"kubernetes.io/projected/d1faa215-118c-4436-9e54-057bb6d4366a-kube-api-access-kmbb4\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:35.680673 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.680639    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dc7d765b9-t8ghf"]
Sep 10 20:37:35.682742 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.682712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmbb4\" (UniqueName: \"kubernetes.io/projected/d1faa215-118c-4436-9e54-057bb6d4366a-kube-api-access-kmbb4\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:35.682862 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.682826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2397d76c-5ec4-4dac-b7b9-7d377710d97f-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-g667l\" (UID: \"2397d76c-5ec4-4dac-b7b9-7d377710d97f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"
Sep 10 20:37:35.682862 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.682849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1faa215-118c-4436-9e54-057bb6d4366a-tmp\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:35.683008 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.682866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2397d76c-5ec4-4dac-b7b9-7d377710d97f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-g667l\" (UID: \"2397d76c-5ec4-4dac-b7b9-7d377710d97f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"
Sep 10 20:37:35.683008 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.682916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d1faa215-118c-4436-9e54-057bb6d4366a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:35.683588 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.683562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.683588 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.683581    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1faa215-118c-4436-9e54-057bb6d4366a-tmp\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:35.683743 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.683684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2397d76c-5ec4-4dac-b7b9-7d377710d97f-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-g667l\" (UID: \"2397d76c-5ec4-4dac-b7b9-7d377710d97f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"
Sep 10 20:37:35.685528 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.685508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2397d76c-5ec4-4dac-b7b9-7d377710d97f-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-g667l\" (UID: \"2397d76c-5ec4-4dac-b7b9-7d377710d97f\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"
Sep 10 20:37:35.686728 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.686706    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 20:37:35.686728 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.686724    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-drws7\""
Sep 10 20:37:35.686864 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.686773    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 20:37:35.686912 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.686880    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 20:37:35.694718 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.694696    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 20:37:35.695709 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.695687    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmbb4\" (UniqueName: \"kubernetes.io/projected/d1faa215-118c-4436-9e54-057bb6d4366a-kube-api-access-kmbb4\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:35.714706 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.714669    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:35.715545 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.715525    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc7d765b9-t8ghf"]
Sep 10 20:37:35.783650 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.783572    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c63fa15-f821-4fc2-a32b-0492f68e0853-installation-pull-secrets\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.783650 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.783607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c63fa15-f821-4fc2-a32b-0492f68e0853-registry-certificates\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.783834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.783651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c63fa15-f821-4fc2-a32b-0492f68e0853-registry-tls\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.783834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.783739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c63fa15-f821-4fc2-a32b-0492f68e0853-trusted-ca\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.783834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.783784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c63fa15-f821-4fc2-a32b-0492f68e0853-ca-trust-extracted\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.783834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.783802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c63fa15-f821-4fc2-a32b-0492f68e0853-bound-sa-token\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.783955 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.783859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6rr8\" (UniqueName: \"kubernetes.io/projected/0c63fa15-f821-4fc2-a32b-0492f68e0853-kube-api-access-w6rr8\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.783955 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.783929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c63fa15-f821-4fc2-a32b-0492f68e0853-image-registry-private-configuration\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.808059 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.808037    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"
Sep 10 20:37:35.814709 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.814681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:35.884311 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.884286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c63fa15-f821-4fc2-a32b-0492f68e0853-registry-certificates\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.884435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.884317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c63fa15-f821-4fc2-a32b-0492f68e0853-registry-tls\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.884435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.884430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c63fa15-f821-4fc2-a32b-0492f68e0853-trusted-ca\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.884548 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.884459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c63fa15-f821-4fc2-a32b-0492f68e0853-ca-trust-extracted\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.884548 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.884474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c63fa15-f821-4fc2-a32b-0492f68e0853-bound-sa-token\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.884548 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.884499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6rr8\" (UniqueName: \"kubernetes.io/projected/0c63fa15-f821-4fc2-a32b-0492f68e0853-kube-api-access-w6rr8\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.884720 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.884559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c63fa15-f821-4fc2-a32b-0492f68e0853-image-registry-private-configuration\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.884720 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.884588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c63fa15-f821-4fc2-a32b-0492f68e0853-installation-pull-secrets\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.885133 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.885105    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c63fa15-f821-4fc2-a32b-0492f68e0853-ca-trust-extracted\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.885230 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.885178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c63fa15-f821-4fc2-a32b-0492f68e0853-registry-certificates\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.885563 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.885544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c63fa15-f821-4fc2-a32b-0492f68e0853-trusted-ca\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.886839 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.886819    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c63fa15-f821-4fc2-a32b-0492f68e0853-installation-pull-secrets\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.886989 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.886970    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c63fa15-f821-4fc2-a32b-0492f68e0853-registry-tls\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.887156 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.887140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c63fa15-f821-4fc2-a32b-0492f68e0853-image-registry-private-configuration\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.893676 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.893658    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c63fa15-f821-4fc2-a32b-0492f68e0853-bound-sa-token\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:35.893750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:35.893700    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6rr8\" (UniqueName: \"kubernetes.io/projected/0c63fa15-f821-4fc2-a32b-0492f68e0853-kube-api-access-w6rr8\") pod \"image-registry-5dc7d765b9-t8ghf\" (UID: \"0c63fa15-f821-4fc2-a32b-0492f68e0853\") " pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:36.003725 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.003698    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:36.095506 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.095469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l"]
Sep 10 20:37:36.098464 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:36.098441    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2397d76c_5ec4_4dac_b7b9_7d377710d97f.slice/crio-7c3aeb592bd3f9c2380d5a4d7415c776a508861d46d6e9b2641f11d8f5c53250 WatchSource:0}: Error finding container 7c3aeb592bd3f9c2380d5a4d7415c776a508861d46d6e9b2641f11d8f5c53250: Status 404 returned error can't find the container with id 7c3aeb592bd3f9c2380d5a4d7415c776a508861d46d6e9b2641f11d8f5c53250
Sep 10 20:37:36.281255 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.281219    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc7d765b9-t8ghf"]
Sep 10 20:37:36.284068 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:36.284044    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c63fa15_f821_4fc2_a32b_0492f68e0853.slice/crio-ba4943a77bd440ff209ef5322c64794e57b62419bd482332a356acb9ea17f974 WatchSource:0}: Error finding container ba4943a77bd440ff209ef5322c64794e57b62419bd482332a356acb9ea17f974: Status 404 returned error can't find the container with id ba4943a77bd440ff209ef5322c64794e57b62419bd482332a356acb9ea17f974
Sep 10 20:37:36.684085 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:36.684042    2579 secret.go:189] Couldn't get secret open-cluster-management-agent-addon/work-manager-hub-kubeconfig: failed to sync secret cache: timed out waiting for the condition
Sep 10 20:37:36.684441 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:36.684148    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1faa215-118c-4436-9e54-057bb6d4366a-klusterlet-config podName:d1faa215-118c-4436-9e54-057bb6d4366a nodeName:}" failed. No retries permitted until 2026-09-10 20:37:37.184125153 +0000 UTC m=+82.221026643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "klusterlet-config" (UniqueName: "kubernetes.io/secret/d1faa215-118c-4436-9e54-057bb6d4366a-klusterlet-config") pod "klusterlet-addon-workmgr-6f665bf6d7-6l7wc" (UID: "d1faa215-118c-4436-9e54-057bb6d4366a") : failed to sync secret cache: timed out waiting for the condition
Sep 10 20:37:36.689914 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.689886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:36.692057 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.692038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/53fcf57c-3ebd-4596-b0d5-c5c2d069c246-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-jntp6\" (UID: \"53fcf57c-3ebd-4596-b0d5-c5c2d069c246\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:36.737076 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.737044    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:36.790937 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.790913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:36.791035 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.790953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:36.791983 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.791967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6aa23a4-abe7-44dc-9690-f0e612b133c8-service-ca-bundle\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:36.793125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.793107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6aa23a4-abe7-44dc-9690-f0e612b133c8-metrics-certs\") pod \"router-default-644c5d48fd-8jn7w\" (UID: \"d6aa23a4-abe7-44dc-9690-f0e612b133c8\") " pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:36.810906 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.810874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf" event={"ID":"0c63fa15-f821-4fc2-a32b-0492f68e0853","Type":"ContainerStarted","Data":"af9ca870b769ba47515ebf1254ca6387cf4bf3cbba1dd2e894a0e17cb4c93494"}
Sep 10 20:37:36.811023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.810925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf" event={"ID":"0c63fa15-f821-4fc2-a32b-0492f68e0853","Type":"ContainerStarted","Data":"ba4943a77bd440ff209ef5322c64794e57b62419bd482332a356acb9ea17f974"}
Sep 10 20:37:36.811023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.810951    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:36.812120 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.812100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l" event={"ID":"2397d76c-5ec4-4dac-b7b9-7d377710d97f","Type":"ContainerStarted","Data":"7c3aeb592bd3f9c2380d5a4d7415c776a508861d46d6e9b2641f11d8f5c53250"}
Sep 10 20:37:36.838052 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.838009    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf" podStartSLOduration=1.8379936940000001 podStartE2EDuration="1.837993694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:37:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:36.837739377 +0000 UTC m=+81.874640890" watchObservedRunningTime="2026-09-10 20:37:36.837993694 +0000 UTC m=+81.874895204"
Sep 10 20:37:36.852612 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.852590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:36.901020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.901000    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-llwmb\""
Sep 10 20:37:36.907554 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:36.907537    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"
Sep 10 20:37:37.013955 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.013928    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hstsn\""
Sep 10 20:37:37.021711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.021685    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:37.100402 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.100181    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 20:37:37.198155 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.198113    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6"]
Sep 10 20:37:37.202123 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.202098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d1faa215-118c-4436-9e54-057bb6d4366a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:37.204319 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.204300    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d1faa215-118c-4436-9e54-057bb6d4366a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f665bf6d7-6l7wc\" (UID: \"d1faa215-118c-4436-9e54-057bb6d4366a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:37.306223 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.306150    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-644c5d48fd-8jn7w"]
Sep 10 20:37:37.313770 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.313748    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:37.475134 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:37.475094    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6aa23a4_abe7_44dc_9690_f0e612b133c8.slice/crio-b030d660f5da93215c822e01fb6d5c5cde0fdf01b30973c9aba582071a616e4a WatchSource:0}: Error finding container b030d660f5da93215c822e01fb6d5c5cde0fdf01b30973c9aba582071a616e4a: Status 404 returned error can't find the container with id b030d660f5da93215c822e01fb6d5c5cde0fdf01b30973c9aba582071a616e4a
Sep 10 20:37:37.475658 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:37.475612    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fcf57c_3ebd_4596_b0d5_c5c2d069c246.slice/crio-d937b0f185bdafc4267cb264e44faee00968c9ed85bc67fe2cf494a8f5d596e3 WatchSource:0}: Error finding container d937b0f185bdafc4267cb264e44faee00968c9ed85bc67fe2cf494a8f5d596e3: Status 404 returned error can't find the container with id d937b0f185bdafc4267cb264e44faee00968c9ed85bc67fe2cf494a8f5d596e3
Sep 10 20:37:37.748579 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.748547    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"]
Sep 10 20:37:37.751484 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:37.751457    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1faa215_118c_4436_9e54_057bb6d4366a.slice/crio-2374d72a6c05dd705958885a79975f789168d9432f27309daa5a77630957788f WatchSource:0}: Error finding container 2374d72a6c05dd705958885a79975f789168d9432f27309daa5a77630957788f: Status 404 returned error can't find the container with id 2374d72a6c05dd705958885a79975f789168d9432f27309daa5a77630957788f
Sep 10 20:37:37.817005 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.816919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-644c5d48fd-8jn7w" event={"ID":"d6aa23a4-abe7-44dc-9690-f0e612b133c8","Type":"ContainerStarted","Data":"fc02521fc77f5c26c881635f5b15f5c92a59ed2239aac69baecdd9b41be21c4b"}
Sep 10 20:37:37.817005 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.816980    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-644c5d48fd-8jn7w" event={"ID":"d6aa23a4-abe7-44dc-9690-f0e612b133c8","Type":"ContainerStarted","Data":"b030d660f5da93215c822e01fb6d5c5cde0fdf01b30973c9aba582071a616e4a"}
Sep 10 20:37:37.818362 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.818337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l" event={"ID":"2397d76c-5ec4-4dac-b7b9-7d377710d97f","Type":"ContainerStarted","Data":"1cb38a3bc926a12f061c17bb7f8147f730be9692273532507870728a1e9995fe"}
Sep 10 20:37:37.819493 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.819468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc" event={"ID":"d1faa215-118c-4436-9e54-057bb6d4366a","Type":"ContainerStarted","Data":"2374d72a6c05dd705958885a79975f789168d9432f27309daa5a77630957788f"}
Sep 10 20:37:37.820558 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.820541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6" event={"ID":"53fcf57c-3ebd-4596-b0d5-c5c2d069c246","Type":"ContainerStarted","Data":"d937b0f185bdafc4267cb264e44faee00968c9ed85bc67fe2cf494a8f5d596e3"}
Sep 10 20:37:37.858748 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:37.858708    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-644c5d48fd-8jn7w" podStartSLOduration=33.858695835 podStartE2EDuration="33.858695835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:37.857571619 +0000 UTC m=+82.894473131" watchObservedRunningTime="2026-09-10 20:37:37.858695835 +0000 UTC m=+82.895597347"
Sep 10 20:37:38.022722 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:38.022581    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:38.025569 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:38.025545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:38.051023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:38.050965    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-g667l" podStartSLOduration=1.6277100930000001 podStartE2EDuration="3.050948308s" totalImagesPullingTime="1.423238215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:37.88660616 +0000 UTC m=+82.923507672" watchObservedRunningTime="2026-09-10 20:37:38.050948308 +0000 UTC m=+83.087849822"
Sep 10 20:37:38.102397 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:38.102326    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:38.278660 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:38.278614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:38.447023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:38.446966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:38.571028 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:38.570956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:38.825075 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:38.824974    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:38.827233 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:38.827006    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-644c5d48fd-8jn7w"
Sep 10 20:37:40.452262 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:40.452215    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:40.637992 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:40.637853    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:40.764896 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:40.764858    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:40.833856 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:40.833816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6" event={"ID":"53fcf57c-3ebd-4596-b0d5-c5c2d069c246","Type":"ContainerStarted","Data":"84248282796f8806140d15d45ca9eb2b29f0f1c990e5b172f36406fd5e044550"}
Sep 10 20:37:40.899743 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:40.899688    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:41.294895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:41.294802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:41.640966 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:41.640877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:41.642847 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:41.642829    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4b69635-fc44-42aa-9405-a21c0c485f8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t4j98\" (UID: \"f4b69635-fc44-42aa-9405-a21c0c485f8e\") " pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:41.838413 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:41.838372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc" event={"ID":"d1faa215-118c-4436-9e54-057bb6d4366a","Type":"ContainerStarted","Data":"a98ac8c9b70e707b27170ff8388cb45cd8ad1984b3f55489fcd312dff848548b"}
Sep 10 20:37:41.861369 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:41.861278    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-jntp6" podStartSLOduration=35.114021858 podStartE2EDuration="37.861263296s" totalImagesPullingTime="2.747241438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:40.85708245 +0000 UTC m=+85.893983966" watchObservedRunningTime="2026-09-10 20:37:41.861263296 +0000 UTC m=+86.898164847"
Sep 10 20:37:41.875650 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:41.875604    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-djk6c\""
Sep 10 20:37:41.883453 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:41.883440    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t4j98"
Sep 10 20:37:42.156207 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:42.156162    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc" podStartSLOduration=3.314314567 podStartE2EDuration="7.156144724s" totalImagesPullingTime="3.841830157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:41.862444793 +0000 UTC m=+86.899346305" watchObservedRunningTime="2026-09-10 20:37:42.156144724 +0000 UTC m=+87.193046237"
Sep 10 20:37:42.157479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:42.157460    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t4j98"]
Sep 10 20:37:42.159877 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:42.159851    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b69635_fc44_42aa_9405_a21c0c485f8e.slice/crio-0235bcfc0405d9a4f19f259e31cecb4271aaf1965466e1e3e1989c55e6f728e4 WatchSource:0}: Error finding container 0235bcfc0405d9a4f19f259e31cecb4271aaf1965466e1e3e1989c55e6f728e4: Status 404 returned error can't find the container with id 0235bcfc0405d9a4f19f259e31cecb4271aaf1965466e1e3e1989c55e6f728e4
Sep 10 20:37:42.712351 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:42.712311    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:42.811130 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:42.808389    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:42.843301 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:42.843271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t4j98" event={"ID":"f4b69635-fc44-42aa-9405-a21c0c485f8e","Type":"ContainerStarted","Data":"c84886b442c30a6f845d4966cc5acc320472292faded644f5af71e9f5fad9c26"}
Sep 10 20:37:42.843461 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:42.843365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t4j98" event={"ID":"f4b69635-fc44-42aa-9405-a21c0c485f8e","Type":"ContainerStarted","Data":"0235bcfc0405d9a4f19f259e31cecb4271aaf1965466e1e3e1989c55e6f728e4"}
Sep 10 20:37:42.843461 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:42.843403    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:42.845165 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:42.845142    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f665bf6d7-6l7wc"
Sep 10 20:37:43.847785 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:43.847740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t4j98" event={"ID":"f4b69635-fc44-42aa-9405-a21c0c485f8e","Type":"ContainerStarted","Data":"dd73680bcb5eab5fcab19907e60b582fe6d6d37a91b4f1c8802c41d24262e075"}
Sep 10 20:37:44.619070 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.619032    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77f6fd5c44-wxlnh"]
Sep 10 20:37:44.621505 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.621477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.624520 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.624495    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lrjhl\""
Sep 10 20:37:44.624624 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.624548    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 20:37:44.625820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.625800    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 20:37:44.625820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.625813    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 20:37:44.625970 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.625836    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 20:37:44.625970 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.625878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 20:37:44.626085 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.626070    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 20:37:44.626160 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.626109    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 20:37:44.631273 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.631254    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 20:37:44.637294 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.637276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77f6fd5c44-wxlnh"]
Sep 10 20:37:44.645863 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.645840    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:44.664718 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.664693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-config\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.664849 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.664727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-trusted-ca-bundle\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.664849 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.664772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-oauth-serving-cert\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.664849 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.664827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-service-ca\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.664998 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.664905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-oauth-config\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.664998 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.664945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-serving-cert\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.665102 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.664994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-strdv\" (UniqueName: \"kubernetes.io/projected/042ca34a-49aa-4347-97e2-cf86e8c6d576-kube-api-access-strdv\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.766206 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.766181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-oauth-serving-cert\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.766306 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.766228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-service-ca\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.766306 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.766259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-oauth-config\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.766306 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.766284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-serving-cert\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.766306 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.766300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-strdv\" (UniqueName: \"kubernetes.io/projected/042ca34a-49aa-4347-97e2-cf86e8c6d576-kube-api-access-strdv\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.766477 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.766328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-config\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.766477 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.766350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-trusted-ca-bundle\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.766934 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.766912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-oauth-serving-cert\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.767039 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.767020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-service-ca\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.767081 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.767020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-config\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.767280 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.767256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-trusted-ca-bundle\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.768529 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.768503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-serving-cert\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.768609 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.768577    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-oauth-config\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.775158 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.775136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-strdv\" (UniqueName: \"kubernetes.io/projected/042ca34a-49aa-4347-97e2-cf86e8c6d576-kube-api-access-strdv\") pod \"console-77f6fd5c44-wxlnh\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") " pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:44.778447 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.778425    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:44.852561 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.852529    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t4j98" event={"ID":"f4b69635-fc44-42aa-9405-a21c0c485f8e","Type":"ContainerStarted","Data":"6c284c18f83af1593c7471bd6dfb44751fbe0bba33deacc5f444ce33d02f7df0"}
Sep 10 20:37:44.891595 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.891505    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t4j98" podStartSLOduration=33.428923529 podStartE2EDuration="35.891491216s" totalImagesPullingTime="2.462567687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:37:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:44.890402947 +0000 UTC m=+89.927304459" watchObservedRunningTime="2026-09-10 20:37:44.891491216 +0000 UTC m=+89.928392728"
Sep 10 20:37:44.932013 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:44.931986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:45.212429 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:45.212406    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77f6fd5c44-wxlnh"]
Sep 10 20:37:45.218433 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:45.218404    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042ca34a_49aa_4347_97e2_cf86e8c6d576.slice/crio-d5197ab8de1ec4c0ff5ba76b89bdd115e9ee7748c04d37eadc2754d1925f516e WatchSource:0}: Error finding container d5197ab8de1ec4c0ff5ba76b89bdd115e9ee7748c04d37eadc2754d1925f516e: Status 404 returned error can't find the container with id d5197ab8de1ec4c0ff5ba76b89bdd115e9ee7748c04d37eadc2754d1925f516e
Sep 10 20:37:45.832099 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:45.832064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:45.857672 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:45.857620    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f6fd5c44-wxlnh" event={"ID":"042ca34a-49aa-4347-97e2-cf86e8c6d576","Type":"ContainerStarted","Data":"d5197ab8de1ec4c0ff5ba76b89bdd115e9ee7748c04d37eadc2754d1925f516e"}
Sep 10 20:37:45.951491 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:45.951455    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:46.062723 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:46.062610    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:47.470303 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:47.470266    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:47.607344 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:47.607260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:48.872747 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:48.872713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f6fd5c44-wxlnh" event={"ID":"042ca34a-49aa-4347-97e2-cf86e8c6d576","Type":"ContainerStarted","Data":"bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795"}
Sep 10 20:37:48.898591 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:48.898546    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77f6fd5c44-wxlnh" podStartSLOduration=2.124486659 podStartE2EDuration="4.898532901s" totalImagesPullingTime="2.774046242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:48.89710532 +0000 UTC m=+93.934006833" watchObservedRunningTime="2026-09-10 20:37:48.898532901 +0000 UTC m=+93.935434413"
Sep 10 20:37:50.643172 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:50.643130    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:50.743518 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:50.743480    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:53.231396 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:53.231365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:37:53.233536 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:53.233515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/159ab7b6-4a77-418a-94d1-22a814d1bb64-metrics-tls\") pod \"dns-default-5nbzf\" (UID: \"159ab7b6-4a77-418a-94d1-22a814d1bb64\") " pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:37:53.534142 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:53.534055    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-89pjq\""
Sep 10 20:37:53.541781 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:53.541744    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:37:53.815704 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:53.815677    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5nbzf"]
Sep 10 20:37:53.818127 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:53.818106    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159ab7b6_4a77_418a_94d1_22a814d1bb64.slice/crio-e3e328299448700c6e99b3d96e688c6bac8701dbc64c133f072ab59f2791d293 WatchSource:0}: Error finding container e3e328299448700c6e99b3d96e688c6bac8701dbc64c133f072ab59f2791d293: Status 404 returned error can't find the container with id e3e328299448700c6e99b3d96e688c6bac8701dbc64c133f072ab59f2791d293
Sep 10 20:37:53.895206 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:53.895171    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nbzf" event={"ID":"159ab7b6-4a77-418a-94d1-22a814d1bb64","Type":"ContainerStarted","Data":"e3e328299448700c6e99b3d96e688c6bac8701dbc64c133f072ab59f2791d293"}
Sep 10 20:37:54.932467 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:54.932430    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:54.932959 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:54.932791    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:54.938201 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:54.938176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:55.903954 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:55.903917    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nbzf" event={"ID":"159ab7b6-4a77-418a-94d1-22a814d1bb64","Type":"ContainerStarted","Data":"7cfd5a6b4ac779118666ab960ca3195cf03473b783bdfa357f0024fff1eaf75d"}
Sep 10 20:37:55.904111 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:55.903970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nbzf" event={"ID":"159ab7b6-4a77-418a-94d1-22a814d1bb64","Type":"ContainerStarted","Data":"98662dcb15bc1021f867736f58ea93aa2e4bc7acb845adba5d54b0fd1a159d04"}
Sep 10 20:37:55.904295 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:55.904278    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:37:55.907663 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:55.907643    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:37:55.937374 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:55.937327    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5nbzf" podStartSLOduration=65.347312859 podStartE2EDuration="1m6.937313287s" totalImagesPullingTime="1.590000428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:37:55.935329463 +0000 UTC m=+100.972230977" watchObservedRunningTime="2026-09-10 20:37:55.937313287 +0000 UTC m=+100.974214799"
Sep 10 20:37:56.008370 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:56.008339    2579 patch_prober.go:28] interesting pod/image-registry-5dc7d765b9-t8ghf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 20:37:56.008512 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:56.008393    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf" podUID="0c63fa15-f821-4fc2-a32b-0492f68e0853" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 20:37:56.859029 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:56.858995    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:57.788993 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:57.788963    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bdgjw"
Sep 10 20:37:57.826266 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:57.826239    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dc7d765b9-t8ghf"
Sep 10 20:37:58.093755 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:58.093657    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:58.195348 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:58.195318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:58.295446 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:58.295420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:58.456110 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:58.456077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:58.542037 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:58.542000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:58.653914 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:58.653871    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:58.807587 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:58.807509    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:58.911429 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:58.911396    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:59.063317 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.063221    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:59.283908 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.283874    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:59.363542 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.363472    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"]
Sep 10 20:37:59.401124 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.401096    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"]
Sep 10 20:37:59.401283 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.401229    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.405725 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.405703    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 20:37:59.405844 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.405708    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c88f8\""
Sep 10 20:37:59.407159 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.407140    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 20:37:59.407313 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.407295    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 20:37:59.407383 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.407366    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 20:37:59.417918 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.417897    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dbjpt"]
Sep 10 20:37:59.437151 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.437131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.440192 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.440166    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pfdlc\""
Sep 10 20:37:59.440291 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.440167    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 20:37:59.440291 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.440209    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 20:37:59.440291 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.440209    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 20:37:59.484208 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.484175    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:59.486317 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.486297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0505a9f1-6e41-49af-8a19-2adb29dbc315-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.486436 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.486337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0505a9f1-6e41-49af-8a19-2adb29dbc315-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.486436 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.486417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.486533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.486450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.486533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.486472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.486621 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.486572    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77prc\" (UniqueName: \"kubernetes.io/projected/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-api-access-77prc\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.587570 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.587536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.587570 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.587574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bbd613fc-fc2b-41d1-b66a-45845f29cfac-root\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.587817 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.587597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.587817 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.587615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.587817 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:59.587704    2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 10 20:37:59.587817 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.587704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-accelerators-collector-config\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.587817 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:37:59.587761    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-tls podName:0505a9f1-6e41-49af-8a19-2adb29dbc315 nodeName:}" failed. No retries permitted until 2026-09-10 20:38:00.087746559 +0000 UTC m=+105.124648049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-rtkcg" (UID: "0505a9f1-6e41-49af-8a19-2adb29dbc315") : secret "kube-state-metrics-tls" not found
Sep 10 20:37:59.588072 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.587858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbd613fc-fc2b-41d1-b66a-45845f29cfac-sys\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.588072 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.587909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25fjg\" (UniqueName: \"kubernetes.io/projected/bbd613fc-fc2b-41d1-b66a-45845f29cfac-kube-api-access-25fjg\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.588072 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.587949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77prc\" (UniqueName: \"kubernetes.io/projected/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-api-access-77prc\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.588225 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd613fc-fc2b-41d1-b66a-45845f29cfac-metrics-client-ca\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.588225 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588117    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-wtmp\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.588225 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.588387 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-tls\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.588387 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-textfile\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.588387 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0505a9f1-6e41-49af-8a19-2adb29dbc315-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.588387 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0505a9f1-6e41-49af-8a19-2adb29dbc315-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.588546 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.588613 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0505a9f1-6e41-49af-8a19-2adb29dbc315-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.588875 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.588857    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0505a9f1-6e41-49af-8a19-2adb29dbc315-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.590240 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.590216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.598043 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.598017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77prc\" (UniqueName: \"kubernetes.io/projected/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-api-access-77prc\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:37:59.660805 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.660777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:59.689003 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.688973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-tls\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689137 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-textfile\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689181 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bbd613fc-fc2b-41d1-b66a-45845f29cfac-root\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689253 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-accelerators-collector-config\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689247    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bbd613fc-fc2b-41d1-b66a-45845f29cfac-root\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbd613fc-fc2b-41d1-b66a-45845f29cfac-sys\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689404 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25fjg\" (UniqueName: \"kubernetes.io/projected/bbd613fc-fc2b-41d1-b66a-45845f29cfac-kube-api-access-25fjg\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689404 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689318    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbd613fc-fc2b-41d1-b66a-45845f29cfac-sys\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689404 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-textfile\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689404 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd613fc-fc2b-41d1-b66a-45845f29cfac-metrics-client-ca\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689596 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-wtmp\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689596 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689757 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689737    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-wtmp\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689817 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-accelerators-collector-config\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.689916 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.689896    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbd613fc-fc2b-41d1-b66a-45845f29cfac-metrics-client-ca\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.691462 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.691441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-tls\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.691718 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.691698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbd613fc-fc2b-41d1-b66a-45845f29cfac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.698704 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.698682    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25fjg\" (UniqueName: \"kubernetes.io/projected/bbd613fc-fc2b-41d1-b66a-45845f29cfac-kube-api-access-25fjg\") pod \"node-exporter-dbjpt\" (UID: \"bbd613fc-fc2b-41d1-b66a-45845f29cfac\") " pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.745771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.745742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dbjpt"
Sep 10 20:37:59.778511 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.778477    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:59.785741 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:37:59.785719    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd613fc_fc2b_41d1_b66a_45845f29cfac.slice/crio-a81a190471b75069d1e719f34371c8a6e9abb7b65599efd794bbd192db65d459 WatchSource:0}: Error finding container a81a190471b75069d1e719f34371c8a6e9abb7b65599efd794bbd192db65d459: Status 404 returned error can't find the container with id a81a190471b75069d1e719f34371c8a6e9abb7b65599efd794bbd192db65d459
Sep 10 20:37:59.904496 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.904455    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:37:59.918119 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:37:59.918057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbjpt" event={"ID":"bbd613fc-fc2b-41d1-b66a-45845f29cfac","Type":"ContainerStarted","Data":"a81a190471b75069d1e719f34371c8a6e9abb7b65599efd794bbd192db65d459"}
Sep 10 20:38:00.093096 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.093061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:38:00.095350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.095326    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0505a9f1-6e41-49af-8a19-2adb29dbc315-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rtkcg\" (UID: \"0505a9f1-6e41-49af-8a19-2adb29dbc315\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:38:00.098682 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.098657    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:00.309976 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.309911    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"
Sep 10 20:38:00.347397 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.347369    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:00.482915 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.482885    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:00.610037 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.609887    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg"]
Sep 10 20:38:00.612222 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:38:00.612192    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0505a9f1_6e41_49af_8a19_2adb29dbc315.slice/crio-34afca04cbe4544c3b263a755afb313876fd3be27df5fb6192d48947bf793df6 WatchSource:0}: Error finding container 34afca04cbe4544c3b263a755afb313876fd3be27df5fb6192d48947bf793df6: Status 404 returned error can't find the container with id 34afca04cbe4544c3b263a755afb313876fd3be27df5fb6192d48947bf793df6
Sep 10 20:38:00.645866 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.645837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:00.755862 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.755833    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:00.923007 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:00.922973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg" event={"ID":"0505a9f1-6e41-49af-8a19-2adb29dbc315","Type":"ContainerStarted","Data":"34afca04cbe4544c3b263a755afb313876fd3be27df5fb6192d48947bf793df6"}
Sep 10 20:38:01.334563 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:01.334486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:01.445659 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:01.445607    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:01.929386 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:01.929354    2579 generic.go:356] "Generic (PLEG): container finished" podID="bbd613fc-fc2b-41d1-b66a-45845f29cfac" containerID="e53b1c26949080661cba8f0d792d44d5f872c6129614ae9a751caf33b232ffd4" exitCode=0
Sep 10 20:38:01.929952 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:01.929442    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbjpt" event={"ID":"bbd613fc-fc2b-41d1-b66a-45845f29cfac","Type":"ContainerDied","Data":"e53b1c26949080661cba8f0d792d44d5f872c6129614ae9a751caf33b232ffd4"}
Sep 10 20:38:02.436673 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.436562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:02.577883 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.577845    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:02.702876 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.702790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:02.935652 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.935591    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbjpt" event={"ID":"bbd613fc-fc2b-41d1-b66a-45845f29cfac","Type":"ContainerStarted","Data":"9b8986c4ad68663acf05a303a2b6d6dc7d13e6b6bf21a9ff61afb4e06a7e4856"}
Sep 10 20:38:02.936085 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.935673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbjpt" event={"ID":"bbd613fc-fc2b-41d1-b66a-45845f29cfac","Type":"ContainerStarted","Data":"911feb1c6e20b956ccb5d81845181b379753d4fd5af0a846cff76ceaef4d46eb"}
Sep 10 20:38:02.937685 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.937658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg" event={"ID":"0505a9f1-6e41-49af-8a19-2adb29dbc315","Type":"ContainerStarted","Data":"657ceb675317f562df657bc2e1766515e0f22317c73e65080cc65ae71f046dd7"}
Sep 10 20:38:02.937802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.937710    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg" event={"ID":"0505a9f1-6e41-49af-8a19-2adb29dbc315","Type":"ContainerStarted","Data":"95035131ea81f58ae73c71832ff8cf64a673bfe1bbea57ce705dd7529061aa64"}
Sep 10 20:38:02.937802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.937731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg" event={"ID":"0505a9f1-6e41-49af-8a19-2adb29dbc315","Type":"ContainerStarted","Data":"0b7cdfcf89569b8d9451b7c0c2464dcfbf6d8bc8678a880fff4f49e4853404e1"}
Sep 10 20:38:02.962824 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.962731    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dbjpt" podStartSLOduration=2.135700923 podStartE2EDuration="3.962717123s" totalImagesPullingTime="1.751415997s" totalInitContainerRuntime="75.600203ms" isStatefulPod=true podCreationTimestamp="2026-09-10 20:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:38:02.960724165 +0000 UTC m=+107.997625681" watchObservedRunningTime="2026-09-10 20:38:02.962717123 +0000 UTC m=+107.999618635"
Sep 10 20:38:02.981373 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:02.981328    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rtkcg" podStartSLOduration=2.4712063779999998 podStartE2EDuration="3.981317207s" totalImagesPullingTime="1.510110829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:38:02.98072079 +0000 UTC m=+108.017622302" watchObservedRunningTime="2026-09-10 20:38:02.981317207 +0000 UTC m=+108.018218719"
Sep 10 20:38:04.031258 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.031230    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"]
Sep 10 20:38:04.034503 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.034481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:04.039134 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.039103    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 10 20:38:04.039134 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.039133    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4bnlc\""
Sep 10 20:38:04.042437 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.042410    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c49bc586f-fvcng"]
Sep 10 20:38:04.045517 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.045497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.057745 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.057713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:04.058292 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.058271    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"]
Sep 10 20:38:04.067097 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.067070    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c49bc586f-fvcng"]
Sep 10 20:38:04.128544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.128510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/846d113e-4adc-4e8e-82fe-bb89660507e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8h2qm\" (UID: \"846d113e-4adc-4e8e-82fe-bb89660507e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:04.128544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.128544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-oauth-config\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.128820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.128563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdvqz\" (UniqueName: \"kubernetes.io/projected/adcc558a-db99-4f32-bfe4-8b1458effe5d-kube-api-access-hdvqz\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.128820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.128697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-service-ca\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.128820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.128734    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf54q\" (UniqueName: \"kubernetes.io/projected/846d113e-4adc-4e8e-82fe-bb89660507e6-kube-api-access-cf54q\") pod \"monitoring-plugin-5d85778b9d-8h2qm\" (UID: \"846d113e-4adc-4e8e-82fe-bb89660507e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:04.128820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.128762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-trusted-ca-bundle\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.128820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.128803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-config\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.129032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.128868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-serving-cert\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.129032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.128900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-oauth-serving-cert\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.180048 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.180011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:04.230026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.229994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-serving-cert\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.230141 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.230031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-oauth-serving-cert\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.230141 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.230084    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/846d113e-4adc-4e8e-82fe-bb89660507e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8h2qm\" (UID: \"846d113e-4adc-4e8e-82fe-bb89660507e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:04.230141 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.230111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-oauth-config\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.230141 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.230135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdvqz\" (UniqueName: \"kubernetes.io/projected/adcc558a-db99-4f32-bfe4-8b1458effe5d-kube-api-access-hdvqz\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.230369 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.230285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-service-ca\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.230369 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.230328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf54q\" (UniqueName: \"kubernetes.io/projected/846d113e-4adc-4e8e-82fe-bb89660507e6-kube-api-access-cf54q\") pod \"monitoring-plugin-5d85778b9d-8h2qm\" (UID: \"846d113e-4adc-4e8e-82fe-bb89660507e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:04.230369 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.230357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-trusted-ca-bundle\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.230533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.230501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-config\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.231004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.230968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-oauth-serving-cert\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.231139 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.231094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-service-ca\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.231234 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.231214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-config\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.231445 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.231422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-trusted-ca-bundle\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.232645 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.232610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-oauth-config\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.232739 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.232698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/846d113e-4adc-4e8e-82fe-bb89660507e6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8h2qm\" (UID: \"846d113e-4adc-4e8e-82fe-bb89660507e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:04.232775 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.232742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-serving-cert\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.240020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.239998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdvqz\" (UniqueName: \"kubernetes.io/projected/adcc558a-db99-4f32-bfe4-8b1458effe5d-kube-api-access-hdvqz\") pod \"console-6c49bc586f-fvcng\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") " pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.240237 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.240218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf54q\" (UniqueName: \"kubernetes.io/projected/846d113e-4adc-4e8e-82fe-bb89660507e6-kube-api-access-cf54q\") pod \"monitoring-plugin-5d85778b9d-8h2qm\" (UID: \"846d113e-4adc-4e8e-82fe-bb89660507e6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:04.304154 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.304063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:04.344135 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.344111    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:04.354180 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.354160    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:04.627245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.627220    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"]
Sep 10 20:38:04.629490 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:38:04.629461    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846d113e_4adc_4e8e_82fe_bb89660507e6.slice/crio-ee4304f6f2b73cd8004d032035236857c7526d6186a571421736896e78f16c32 WatchSource:0}: Error finding container ee4304f6f2b73cd8004d032035236857c7526d6186a571421736896e78f16c32: Status 404 returned error can't find the container with id ee4304f6f2b73cd8004d032035236857c7526d6186a571421736896e78f16c32
Sep 10 20:38:04.632143 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.632122    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c49bc586f-fvcng"]
Sep 10 20:38:04.633853 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:38:04.633834    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadcc558a_db99_4f32_bfe4_8b1458effe5d.slice/crio-77629ee1741a2f855a1ac00e84aeb253b058fe4727d3efcad56c4ecd417807a8 WatchSource:0}: Error finding container 77629ee1741a2f855a1ac00e84aeb253b058fe4727d3efcad56c4ecd417807a8: Status 404 returned error can't find the container with id 77629ee1741a2f855a1ac00e84aeb253b058fe4727d3efcad56c4ecd417807a8
Sep 10 20:38:04.946287 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.946248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c49bc586f-fvcng" event={"ID":"adcc558a-db99-4f32-bfe4-8b1458effe5d","Type":"ContainerStarted","Data":"b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108"}
Sep 10 20:38:04.946482 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.946309    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c49bc586f-fvcng" event={"ID":"adcc558a-db99-4f32-bfe4-8b1458effe5d","Type":"ContainerStarted","Data":"77629ee1741a2f855a1ac00e84aeb253b058fe4727d3efcad56c4ecd417807a8"}
Sep 10 20:38:04.947505 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.947473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm" event={"ID":"846d113e-4adc-4e8e-82fe-bb89660507e6","Type":"ContainerStarted","Data":"ee4304f6f2b73cd8004d032035236857c7526d6186a571421736896e78f16c32"}
Sep 10 20:38:04.968887 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:04.968837    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c49bc586f-fvcng" podStartSLOduration=0.968824016 podStartE2EDuration="968.824016ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:38:04.96773448 +0000 UTC m=+110.004635988" watchObservedRunningTime="2026-09-10 20:38:04.968824016 +0000 UTC m=+110.005725583"
Sep 10 20:38:05.126443 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.126405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:05.741267 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.741232    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:38:05.743741 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.743713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:05.745056 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.745038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.752592 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.752574    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 20:38:05.753688 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.753672    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 20:38:05.753688 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.753680    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 20:38:05.754002 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.753988    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 20:38:05.755130 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.755106    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 20:38:05.755130 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.755129    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 20:38:05.755293 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.755139    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 20:38:05.755293 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.755141    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 20:38:05.755293 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.755200    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-asmg178rtfi9k\""
Sep 10 20:38:05.755293 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.755148    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4czqr\""
Sep 10 20:38:05.757334 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.757316    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 20:38:05.757334 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.757327    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 20:38:05.757502 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.757331    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 20:38:05.757502 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.757405    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 20:38:05.757622 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.757545    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 20:38:05.757622 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.757608    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 20:38:05.758732 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.758714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 20:38:05.776071 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.776042    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:38:05.843495 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843495 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843721 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843721 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843721 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843721 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843721 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843721 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.843921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.844145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8vtm\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-kube-api-access-h8vtm\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.844145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.844145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.844145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.843994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.844145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.844009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945063 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945241 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8vtm\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-kube-api-access-h8vtm\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945241 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945241 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945241 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945241 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945241 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945998 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945563    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945998 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945998 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.945998 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.945672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.946545 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.946336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.946545 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.946434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.947007 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.946979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.948917 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.948895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.949148 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.949127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.950666 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.950044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.950666 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.950248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.950666 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.950454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.950666 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.950644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.950917 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.950749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.951892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.951167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.951892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.951285    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.951892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.951517    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.951892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.951649    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.951892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.951842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.952177 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.952024    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.952967 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.952945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.953068 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.953049    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.953125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.953111    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:05.957938 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:05.957917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8vtm\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-kube-api-access-h8vtm\") pod \"prometheus-k8s-0\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:06.054062 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.053984    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:06.158796 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.158758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:06.318400 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.318360    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:06.518573 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.518538    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:38:06.526841 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:38:06.526806    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1517beb_f7e0_46bd_87ae_e0b9d214aee8.slice/crio-7819759cfe7847e2c292dc5f717a844cd3e4df6912d0dc6441aee0b7c8979143 WatchSource:0}: Error finding container 7819759cfe7847e2c292dc5f717a844cd3e4df6912d0dc6441aee0b7c8979143: Status 404 returned error can't find the container with id 7819759cfe7847e2c292dc5f717a844cd3e4df6912d0dc6441aee0b7c8979143
Sep 10 20:38:06.912804 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.912769    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5nbzf"
Sep 10 20:38:06.961569 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.961536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm" event={"ID":"846d113e-4adc-4e8e-82fe-bb89660507e6","Type":"ContainerStarted","Data":"6fa41dbe0e886cadc70df3bec4b71be1486426d85967ec6cdea165c9e77a1ef3"}
Sep 10 20:38:06.961754 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.961662    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:06.962925 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.962902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerStarted","Data":"7819759cfe7847e2c292dc5f717a844cd3e4df6912d0dc6441aee0b7c8979143"}
Sep 10 20:38:06.966855 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.966831    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm"
Sep 10 20:38:06.980957 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:06.980909    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8h2qm" podStartSLOduration=1.349026106 podStartE2EDuration="2.980895068s" totalImagesPullingTime="1.631868962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:38:06.979660515 +0000 UTC m=+112.016562025" watchObservedRunningTime="2026-09-10 20:38:06.980895068 +0000 UTC m=+112.017796580"
Sep 10 20:38:07.307894 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:07.307809    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:07.522310 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:07.522278    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:08.516198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:08.516158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:08.708797 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:08.708763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:08.973147 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:08.973115    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerID="22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9" exitCode=0
Sep 10 20:38:08.973312 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:08.973208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerDied","Data":"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"}
Sep 10 20:38:12.372899 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:12.372807    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:12.499619 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:12.499576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:13.995263 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:13.995227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerStarted","Data":"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"}
Sep 10 20:38:13.995613 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:13.995321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerStarted","Data":"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"}
Sep 10 20:38:14.354653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:14.354563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:14.354653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:14.354647    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:14.360430 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:14.360341    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:15.004133 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:15.004105    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:38:15.074557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:15.074524    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77f6fd5c44-wxlnh"]
Sep 10 20:38:15.266810 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:15.266731    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:15.496130 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:15.496096    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:15.644719 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:15.644646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:16.515174 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:16.515085    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:16.840481 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:16.840398    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:17.010128 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:17.010094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerStarted","Data":"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"}
Sep 10 20:38:17.010279 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:17.010196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerStarted","Data":"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"}
Sep 10 20:38:17.010279 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:17.010225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerStarted","Data":"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"}
Sep 10 20:38:17.010279 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:17.010251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerStarted","Data":"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"}
Sep 10 20:38:17.070887 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:17.070834    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.871300218 podStartE2EDuration="12.07081814s" totalImagesPullingTime="8.18036572s" totalInitContainerRuntime="19.152202ms" isStatefulPod=false podCreationTimestamp="2026-09-10 20:38:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:38:17.068600112 +0000 UTC m=+122.105501626" watchObservedRunningTime="2026-09-10 20:38:17.07081814 +0000 UTC m=+122.107719652"
Sep 10 20:38:19.371389 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:19.371348    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:19.569879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:19.569844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:20.145523 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:20.145485    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:20.305100 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:20.305068    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-644c5d48fd-8jn7w_d6aa23a4-abe7-44dc-9690-f0e612b133c8/router/0.log"
Sep 10 20:38:20.367164 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:20.367139    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zhn5f_c00bd33f-8694-48a2-87b5-0c85c323752b/serve-healthcheck-canary/0.log"
Sep 10 20:38:20.429106 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:20.429074    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:20.655848 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:20.655813    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:21.054960 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:21.054927    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:38:21.754544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:21.754506    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:21.869527 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:21.869492    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:25.316921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:25.316886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:38:25.319183 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:25.319163    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3-metrics-certs\") pod \"network-metrics-daemon-qs4rm\" (UID: \"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3\") " pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:38:25.499391 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:25.499364    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ks6z6\""
Sep 10 20:38:25.507201 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:25.507179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qs4rm"
Sep 10 20:38:25.786823 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:25.786795    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qs4rm"]
Sep 10 20:38:25.788460 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:38:25.788432    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdbb6b5_d75c_43be_be0a_0ea5ffccc0b3.slice/crio-73f37ff86e8c6c8bd2844278ba12a92a951cf5217b9c9f50cba57f9a7ee5a4ee WatchSource:0}: Error finding container 73f37ff86e8c6c8bd2844278ba12a92a951cf5217b9c9f50cba57f9a7ee5a4ee: Status 404 returned error can't find the container with id 73f37ff86e8c6c8bd2844278ba12a92a951cf5217b9c9f50cba57f9a7ee5a4ee
Sep 10 20:38:26.044359 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:26.044275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qs4rm" event={"ID":"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3","Type":"ContainerStarted","Data":"73f37ff86e8c6c8bd2844278ba12a92a951cf5217b9c9f50cba57f9a7ee5a4ee"}
Sep 10 20:38:27.052935 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:27.052890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qs4rm" event={"ID":"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3","Type":"ContainerStarted","Data":"99d04f3616349803010c9b2ef2dd97b7993653d72d83e03458b7cc06397aa48f"}
Sep 10 20:38:27.053414 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:27.052988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qs4rm" event={"ID":"fcdbb6b5-d75c-43be-be0a-0ea5ffccc0b3","Type":"ContainerStarted","Data":"444c1db5bb00f7bb1365a6ce8e243436c8bcec20738038e8594c9419dcb99043"}
Sep 10 20:38:27.075647 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:27.075567    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qs4rm" podStartSLOduration=131.24509602 podStartE2EDuration="2m12.07554843s" totalImagesPullingTime="830.45241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:38:27.074926904 +0000 UTC m=+132.111828418" watchObservedRunningTime="2026-09-10 20:38:27.07554843 +0000 UTC m=+132.112449944"
Sep 10 20:38:27.262491 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:27.262455    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:27.460195 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:27.460161    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:34.082551 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:34.082512    2579 generic.go:356] "Generic (PLEG): container finished" podID="a9511892-7ea1-4dc9-a501-3f878a6c1d0f" containerID="ef0bc57b822ee6c378f4f96a9e4c91c577ebc7f6c57a0408626d2f2026dde43c" exitCode=0
Sep 10 20:38:34.082979 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:34.082586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8" event={"ID":"a9511892-7ea1-4dc9-a501-3f878a6c1d0f","Type":"ContainerDied","Data":"ef0bc57b822ee6c378f4f96a9e4c91c577ebc7f6c57a0408626d2f2026dde43c"}
Sep 10 20:38:34.082979 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:34.082922    2579 scope.go:117] "RemoveContainer" containerID="ef0bc57b822ee6c378f4f96a9e4c91c577ebc7f6c57a0408626d2f2026dde43c"
Sep 10 20:38:35.089064 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:35.089031    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-fk9n8" event={"ID":"a9511892-7ea1-4dc9-a501-3f878a6c1d0f","Type":"ContainerStarted","Data":"a14eb2049d4b0df7e2001f1a402ecd805dbd45a6f07df8ebe46060c17aea7d82"}
Sep 10 20:38:36.743855 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:36.743822    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:36.904994 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:36.904955    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:38:40.097250 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.097206    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77f6fd5c44-wxlnh" podUID="042ca34a-49aa-4347-97e2-cf86e8c6d576" containerName="console" containerID="cri-o://bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795" gracePeriod=15
Sep 10 20:38:40.344587 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.344564    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:38:40.446307 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446276    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-oauth-serving-cert\") pod \"042ca34a-49aa-4347-97e2-cf86e8c6d576\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") "
Sep 10 20:38:40.446479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446315    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-service-ca\") pod \"042ca34a-49aa-4347-97e2-cf86e8c6d576\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") "
Sep 10 20:38:40.446479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-oauth-config\") pod \"042ca34a-49aa-4347-97e2-cf86e8c6d576\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") "
Sep 10 20:38:40.446479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446421    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-trusted-ca-bundle\") pod \"042ca34a-49aa-4347-97e2-cf86e8c6d576\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") "
Sep 10 20:38:40.446479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446439    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-config\") pod \"042ca34a-49aa-4347-97e2-cf86e8c6d576\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") "
Sep 10 20:38:40.446479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-strdv\" (UniqueName: \"kubernetes.io/projected/042ca34a-49aa-4347-97e2-cf86e8c6d576-kube-api-access-strdv\") pod \"042ca34a-49aa-4347-97e2-cf86e8c6d576\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") "
Sep 10 20:38:40.446733 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-serving-cert\") pod \"042ca34a-49aa-4347-97e2-cf86e8c6d576\" (UID: \"042ca34a-49aa-4347-97e2-cf86e8c6d576\") "
Sep 10 20:38:40.446785 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446731    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-service-ca" (OuterVolumeSpecName: "service-ca") pod "042ca34a-49aa-4347-97e2-cf86e8c6d576" (UID: "042ca34a-49aa-4347-97e2-cf86e8c6d576"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:38:40.446997 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "042ca34a-49aa-4347-97e2-cf86e8c6d576" (UID: "042ca34a-49aa-4347-97e2-cf86e8c6d576"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:38:40.446997 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446982    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "042ca34a-49aa-4347-97e2-cf86e8c6d576" (UID: "042ca34a-49aa-4347-97e2-cf86e8c6d576"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:38:40.447110 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.446993    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-config" (OuterVolumeSpecName: "console-config") pod "042ca34a-49aa-4347-97e2-cf86e8c6d576" (UID: "042ca34a-49aa-4347-97e2-cf86e8c6d576"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:38:40.448737 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.448708    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/042ca34a-49aa-4347-97e2-cf86e8c6d576-kube-api-access-strdv" (OuterVolumeSpecName: "kube-api-access-strdv") pod "042ca34a-49aa-4347-97e2-cf86e8c6d576" (UID: "042ca34a-49aa-4347-97e2-cf86e8c6d576"). InnerVolumeSpecName "kube-api-access-strdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:38:40.448737 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.448724    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "042ca34a-49aa-4347-97e2-cf86e8c6d576" (UID: "042ca34a-49aa-4347-97e2-cf86e8c6d576"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:38:40.448860 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.448734    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "042ca34a-49aa-4347-97e2-cf86e8c6d576" (UID: "042ca34a-49aa-4347-97e2-cf86e8c6d576"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:38:40.547974 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.547933    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-trusted-ca-bundle\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:38:40.547974 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.547969    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:38:40.547974 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.547979    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-strdv\" (UniqueName: \"kubernetes.io/projected/042ca34a-49aa-4347-97e2-cf86e8c6d576-kube-api-access-strdv\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:38:40.548171 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.547990    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-serving-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:38:40.548171 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.547999    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-oauth-serving-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:38:40.548171 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.548006    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/042ca34a-49aa-4347-97e2-cf86e8c6d576-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:38:40.548171 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:40.548016    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/042ca34a-49aa-4347-97e2-cf86e8c6d576-console-oauth-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:38:41.114647 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.114603    2579 generic.go:356] "Generic (PLEG): container finished" podID="042ca34a-49aa-4347-97e2-cf86e8c6d576" containerID="bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795" exitCode=0
Sep 10 20:38:41.115033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.114661    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f6fd5c44-wxlnh"
Sep 10 20:38:41.115033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.114694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f6fd5c44-wxlnh" event={"ID":"042ca34a-49aa-4347-97e2-cf86e8c6d576","Type":"ContainerDied","Data":"bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795"}
Sep 10 20:38:41.115033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.114743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f6fd5c44-wxlnh" event={"ID":"042ca34a-49aa-4347-97e2-cf86e8c6d576","Type":"ContainerDied","Data":"d5197ab8de1ec4c0ff5ba76b89bdd115e9ee7748c04d37eadc2754d1925f516e"}
Sep 10 20:38:41.115033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.114761    2579 scope.go:117] "RemoveContainer" containerID="bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795"
Sep 10 20:38:41.123329 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.123310    2579 scope.go:117] "RemoveContainer" containerID="bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795"
Sep 10 20:38:41.123608 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:38:41.123589    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795\": container with ID starting with bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795 not found: ID does not exist" containerID="bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795"
Sep 10 20:38:41.123700 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.123616    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795"} err="failed to get container status \"bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795\": rpc error: code = NotFound desc = could not find container \"bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795\": container with ID starting with bb432c645ed6fd9a07b2ea33d76c714971e8bd2e9f02d360c755316c8b92d795 not found: ID does not exist"
Sep 10 20:38:41.136885 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.136859    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77f6fd5c44-wxlnh"]
Sep 10 20:38:41.140514 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.140496    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77f6fd5c44-wxlnh"]
Sep 10 20:38:41.486350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:41.486320    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="042ca34a-49aa-4347-97e2-cf86e8c6d576" path="/var/lib/kubelet/pods/042ca34a-49aa-4347-97e2-cf86e8c6d576/volumes"
Sep 10 20:38:46.136724 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:46.136691    2579 generic.go:356] "Generic (PLEG): container finished" podID="1c170710-3d50-48ae-addc-bc14969cbc88" containerID="7b06f9fc6bf4161a682ad9cc4b93332800c4860042b1f8fc65062e9e3b080879" exitCode=0
Sep 10 20:38:46.137045 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:46.136757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7" event={"ID":"1c170710-3d50-48ae-addc-bc14969cbc88","Type":"ContainerDied","Data":"7b06f9fc6bf4161a682ad9cc4b93332800c4860042b1f8fc65062e9e3b080879"}
Sep 10 20:38:46.137084 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:46.137073    2579 scope.go:117] "RemoveContainer" containerID="7b06f9fc6bf4161a682ad9cc4b93332800c4860042b1f8fc65062e9e3b080879"
Sep 10 20:38:47.141982 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:38:47.141944    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-95wr7" event={"ID":"1c170710-3d50-48ae-addc-bc14969cbc88","Type":"ContainerStarted","Data":"89acfb4f7b04a2136b3de4434198588ff41b31bd360ea18c5814294a0a6b0ebf"}
Sep 10 20:39:06.054486 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:06.054449    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:06.070272 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:06.070250    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:06.227304 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:06.227277    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:18.793669 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:18.793607    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:39:19.069406 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:19.069321    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:39:24.195572 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.195530    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:39:24.196149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.195927    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="thanos-sidecar" containerID="cri-o://4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380" gracePeriod=600
Sep 10 20:39:24.196149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.195956    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="config-reloader" containerID="cri-o://23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586" gracePeriod=600
Sep 10 20:39:24.196149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.195995    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy" containerID="cri-o://a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20" gracePeriod=600
Sep 10 20:39:24.196149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.195989    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f" gracePeriod=600
Sep 10 20:39:24.196149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.195974    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy-web" containerID="cri-o://51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d" gracePeriod=600
Sep 10 20:39:24.196149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.195924    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="prometheus" containerID="cri-o://ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf" gracePeriod=600
Sep 10 20:39:24.442023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.441999    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:24.504125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504057    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-grpc-tls\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504090    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-trusted-ca-bundle\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504109    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-kube-rbac-proxy\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504129    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config-out\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504157    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-0\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504186    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504209    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-1\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504238    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504286    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-thanos-prometheus-http-client-file\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504309    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8vtm\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-kube-api-access-h8vtm\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504336    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-tls\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504795 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504380    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-kubelet-serving-ca-bundle\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504795 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504418    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-web-config\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504795 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504443    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-2\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.504795 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.504475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-tls-assets\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.511703 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.511664    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:39:24.511916 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.511888    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.512342    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.512415    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-serving-certs-ca-bundle\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.512454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-db\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.512504    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-metrics-client-ca\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.512559    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-metrics-client-certs\") pod \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\" (UID: \"a1517beb-f7e0-46bd-87ae-e0b9d214aee8\") "
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.512856    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.513022    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.513043    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.513060    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.514310    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.514710    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:39:24.515701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.515110    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:39:24.516383 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.515926    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:39:24.516383 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.516272    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:39:24.516504 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.516446    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-kube-api-access-h8vtm" (OuterVolumeSpecName: "kube-api-access-h8vtm") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "kube-api-access-h8vtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:39:24.519175 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.516876    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:39:24.519175 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.516981    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:39:24.519175 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.517002    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:39:24.519175 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.518751    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:39:24.519175 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.518827    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config" (OuterVolumeSpecName: "config") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:39:24.519469 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.519267    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config-out" (OuterVolumeSpecName: "config-out") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:39:24.521712 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.521680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:39:24.524040 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.524008    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:39:24.524040 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.524029    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:39:24.524203 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.524065    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:39:24.531783 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.531757    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-web-config" (OuterVolumeSpecName: "web-config") pod "a1517beb-f7e0-46bd-87ae-e0b9d214aee8" (UID: "a1517beb-f7e0-46bd-87ae-e0b9d214aee8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:39:24.614409 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614376    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614409 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614404    2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614415    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8vtm\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-kube-api-access-h8vtm\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614424    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614433    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-web-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614441    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614450    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-tls-assets\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614458    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614466    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614474    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-db\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614482    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-configmap-metrics-client-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614490    2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-metrics-client-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614498    2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-grpc-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614506    2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-secret-kube-rbac-proxy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614513    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config-out\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614520    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:24.614557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:24.614528    2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1517beb-f7e0-46bd-87ae-e0b9d214aee8-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:39:25.285456 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285419    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerID="3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f" exitCode=0
Sep 10 20:39:25.285456 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285453    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerID="a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20" exitCode=0
Sep 10 20:39:25.285456 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285463    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerID="51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d" exitCode=0
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285474    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerID="4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380" exitCode=0
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285485    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerID="23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586" exitCode=0
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285493    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerID="ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf" exitCode=0
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285495    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerDied","Data":"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"}
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285523    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerDied","Data":"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"}
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285615    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerDied","Data":"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"}
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285656    2579 scope.go:117] "RemoveContainer" containerID="3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerDied","Data":"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"}
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerDied","Data":"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"}
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285789    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerDied","Data":"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"}
Sep 10 20:39:25.285869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.285827    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1517beb-f7e0-46bd-87ae-e0b9d214aee8","Type":"ContainerDied","Data":"7819759cfe7847e2c292dc5f717a844cd3e4df6912d0dc6441aee0b7c8979143"}
Sep 10 20:39:25.294424 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.294407    2579 scope.go:117] "RemoveContainer" containerID="a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"
Sep 10 20:39:25.301224 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.301209    2579 scope.go:117] "RemoveContainer" containerID="51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"
Sep 10 20:39:25.307564 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.307547    2579 scope.go:117] "RemoveContainer" containerID="4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"
Sep 10 20:39:25.312824 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.312804    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:39:25.314438 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.314422    2579 scope.go:117] "RemoveContainer" containerID="23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"
Sep 10 20:39:25.317834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.317812    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:39:25.321439 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.321422    2579 scope.go:117] "RemoveContainer" containerID="ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"
Sep 10 20:39:25.328339 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.328323    2579 scope.go:117] "RemoveContainer" containerID="22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"
Sep 10 20:39:25.334357 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.334342    2579 scope.go:117] "RemoveContainer" containerID="3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"
Sep 10 20:39:25.334619 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:39:25.334602    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": container with ID starting with 3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f not found: ID does not exist" containerID="3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"
Sep 10 20:39:25.334695 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.334651    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"} err="failed to get container status \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": rpc error: code = NotFound desc = could not find container \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": container with ID starting with 3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f not found: ID does not exist"
Sep 10 20:39:25.334695 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.334676    2579 scope.go:117] "RemoveContainer" containerID="a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"
Sep 10 20:39:25.334932 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:39:25.334914    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": container with ID starting with a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20 not found: ID does not exist" containerID="a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"
Sep 10 20:39:25.334985 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.334937    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"} err="failed to get container status \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": rpc error: code = NotFound desc = could not find container \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": container with ID starting with a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20 not found: ID does not exist"
Sep 10 20:39:25.334985 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.334954    2579 scope.go:117] "RemoveContainer" containerID="51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"
Sep 10 20:39:25.335174 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:39:25.335157    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": container with ID starting with 51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d not found: ID does not exist" containerID="51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"
Sep 10 20:39:25.335225 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.335181    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"} err="failed to get container status \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": rpc error: code = NotFound desc = could not find container \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": container with ID starting with 51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d not found: ID does not exist"
Sep 10 20:39:25.335225 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.335196    2579 scope.go:117] "RemoveContainer" containerID="4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"
Sep 10 20:39:25.335400 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:39:25.335385    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": container with ID starting with 4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380 not found: ID does not exist" containerID="4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"
Sep 10 20:39:25.335445 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.335404    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"} err="failed to get container status \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": rpc error: code = NotFound desc = could not find container \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": container with ID starting with 4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380 not found: ID does not exist"
Sep 10 20:39:25.335445 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.335418    2579 scope.go:117] "RemoveContainer" containerID="23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"
Sep 10 20:39:25.335728 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:39:25.335702    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": container with ID starting with 23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586 not found: ID does not exist" containerID="23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"
Sep 10 20:39:25.335833 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.335734    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"} err="failed to get container status \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": rpc error: code = NotFound desc = could not find container \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": container with ID starting with 23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586 not found: ID does not exist"
Sep 10 20:39:25.335833 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.335755    2579 scope.go:117] "RemoveContainer" containerID="ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"
Sep 10 20:39:25.336027 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:39:25.336011    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": container with ID starting with ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf not found: ID does not exist" containerID="ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"
Sep 10 20:39:25.336070 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336031    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"} err="failed to get container status \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": rpc error: code = NotFound desc = could not find container \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": container with ID starting with ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf not found: ID does not exist"
Sep 10 20:39:25.336070 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336045    2579 scope.go:117] "RemoveContainer" containerID="22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"
Sep 10 20:39:25.336275 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:39:25.336259    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": container with ID starting with 22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9 not found: ID does not exist" containerID="22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"
Sep 10 20:39:25.336325 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336277    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"} err="failed to get container status \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": rpc error: code = NotFound desc = could not find container \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": container with ID starting with 22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9 not found: ID does not exist"
Sep 10 20:39:25.336325 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336292    2579 scope.go:117] "RemoveContainer" containerID="3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"
Sep 10 20:39:25.336513 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336497    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"} err="failed to get container status \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": rpc error: code = NotFound desc = could not find container \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": container with ID starting with 3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f not found: ID does not exist"
Sep 10 20:39:25.336554 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336513    2579 scope.go:117] "RemoveContainer" containerID="a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"
Sep 10 20:39:25.336781 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336764    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"} err="failed to get container status \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": rpc error: code = NotFound desc = could not find container \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": container with ID starting with a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20 not found: ID does not exist"
Sep 10 20:39:25.336781 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336779    2579 scope.go:117] "RemoveContainer" containerID="51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"
Sep 10 20:39:25.336968 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336950    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"} err="failed to get container status \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": rpc error: code = NotFound desc = could not find container \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": container with ID starting with 51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d not found: ID does not exist"
Sep 10 20:39:25.337013 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.336969    2579 scope.go:117] "RemoveContainer" containerID="4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"
Sep 10 20:39:25.337204 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.337185    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"} err="failed to get container status \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": rpc error: code = NotFound desc = could not find container \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": container with ID starting with 4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380 not found: ID does not exist"
Sep 10 20:39:25.337273 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.337206    2579 scope.go:117] "RemoveContainer" containerID="23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"
Sep 10 20:39:25.337425 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.337410    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"} err="failed to get container status \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": rpc error: code = NotFound desc = could not find container \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": container with ID starting with 23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586 not found: ID does not exist"
Sep 10 20:39:25.337474 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.337426    2579 scope.go:117] "RemoveContainer" containerID="ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"
Sep 10 20:39:25.337713 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.337610    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"} err="failed to get container status \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": rpc error: code = NotFound desc = could not find container \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": container with ID starting with ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf not found: ID does not exist"
Sep 10 20:39:25.337759 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.337750    2579 scope.go:117] "RemoveContainer" containerID="22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"
Sep 10 20:39:25.337954 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.337938    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"} err="failed to get container status \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": rpc error: code = NotFound desc = could not find container \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": container with ID starting with 22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9 not found: ID does not exist"
Sep 10 20:39:25.337997 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.337954    2579 scope.go:117] "RemoveContainer" containerID="3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"
Sep 10 20:39:25.338135 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338119    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"} err="failed to get container status \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": rpc error: code = NotFound desc = could not find container \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": container with ID starting with 3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f not found: ID does not exist"
Sep 10 20:39:25.338182 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338134    2579 scope.go:117] "RemoveContainer" containerID="a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"
Sep 10 20:39:25.338294 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338278    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"} err="failed to get container status \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": rpc error: code = NotFound desc = could not find container \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": container with ID starting with a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20 not found: ID does not exist"
Sep 10 20:39:25.338294 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338292    2579 scope.go:117] "RemoveContainer" containerID="51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"
Sep 10 20:39:25.338474 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338460    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"} err="failed to get container status \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": rpc error: code = NotFound desc = could not find container \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": container with ID starting with 51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d not found: ID does not exist"
Sep 10 20:39:25.338516 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338473    2579 scope.go:117] "RemoveContainer" containerID="4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"
Sep 10 20:39:25.338656 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338619    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"} err="failed to get container status \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": rpc error: code = NotFound desc = could not find container \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": container with ID starting with 4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380 not found: ID does not exist"
Sep 10 20:39:25.338702 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338655    2579 scope.go:117] "RemoveContainer" containerID="23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"
Sep 10 20:39:25.338834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338821    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"} err="failed to get container status \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": rpc error: code = NotFound desc = could not find container \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": container with ID starting with 23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586 not found: ID does not exist"
Sep 10 20:39:25.338834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.338834    2579 scope.go:117] "RemoveContainer" containerID="ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"
Sep 10 20:39:25.339020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339001    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"} err="failed to get container status \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": rpc error: code = NotFound desc = could not find container \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": container with ID starting with ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf not found: ID does not exist"
Sep 10 20:39:25.339085 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339022    2579 scope.go:117] "RemoveContainer" containerID="22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"
Sep 10 20:39:25.339227 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339214    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"} err="failed to get container status \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": rpc error: code = NotFound desc = could not find container \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": container with ID starting with 22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9 not found: ID does not exist"
Sep 10 20:39:25.339227 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339227    2579 scope.go:117] "RemoveContainer" containerID="3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"
Sep 10 20:39:25.339434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339416    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"} err="failed to get container status \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": rpc error: code = NotFound desc = could not find container \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": container with ID starting with 3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f not found: ID does not exist"
Sep 10 20:39:25.339496 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339435    2579 scope.go:117] "RemoveContainer" containerID="a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"
Sep 10 20:39:25.339660 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339645    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"} err="failed to get container status \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": rpc error: code = NotFound desc = could not find container \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": container with ID starting with a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20 not found: ID does not exist"
Sep 10 20:39:25.339712 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339660    2579 scope.go:117] "RemoveContainer" containerID="51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"
Sep 10 20:39:25.339857 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339839    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"} err="failed to get container status \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": rpc error: code = NotFound desc = could not find container \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": container with ID starting with 51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d not found: ID does not exist"
Sep 10 20:39:25.339921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.339858    2579 scope.go:117] "RemoveContainer" containerID="4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"
Sep 10 20:39:25.340077 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340060    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"} err="failed to get container status \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": rpc error: code = NotFound desc = could not find container \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": container with ID starting with 4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380 not found: ID does not exist"
Sep 10 20:39:25.340122 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340078    2579 scope.go:117] "RemoveContainer" containerID="23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"
Sep 10 20:39:25.340258 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340244    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"} err="failed to get container status \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": rpc error: code = NotFound desc = could not find container \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": container with ID starting with 23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586 not found: ID does not exist"
Sep 10 20:39:25.340302 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340259    2579 scope.go:117] "RemoveContainer" containerID="ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"
Sep 10 20:39:25.340461 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340447    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"} err="failed to get container status \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": rpc error: code = NotFound desc = could not find container \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": container with ID starting with ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf not found: ID does not exist"
Sep 10 20:39:25.340506 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340461    2579 scope.go:117] "RemoveContainer" containerID="22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"
Sep 10 20:39:25.340643 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340615    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"} err="failed to get container status \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": rpc error: code = NotFound desc = could not find container \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": container with ID starting with 22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9 not found: ID does not exist"
Sep 10 20:39:25.340682 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340643    2579 scope.go:117] "RemoveContainer" containerID="3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"
Sep 10 20:39:25.340837 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340820    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"} err="failed to get container status \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": rpc error: code = NotFound desc = could not find container \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": container with ID starting with 3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f not found: ID does not exist"
Sep 10 20:39:25.340909 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.340838    2579 scope.go:117] "RemoveContainer" containerID="a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"
Sep 10 20:39:25.341049 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341034    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"} err="failed to get container status \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": rpc error: code = NotFound desc = could not find container \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": container with ID starting with a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20 not found: ID does not exist"
Sep 10 20:39:25.341093 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341049    2579 scope.go:117] "RemoveContainer" containerID="51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"
Sep 10 20:39:25.341240 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341223    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"} err="failed to get container status \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": rpc error: code = NotFound desc = could not find container \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": container with ID starting with 51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d not found: ID does not exist"
Sep 10 20:39:25.341317 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341241    2579 scope.go:117] "RemoveContainer" containerID="4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"
Sep 10 20:39:25.341456 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341440    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"} err="failed to get container status \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": rpc error: code = NotFound desc = could not find container \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": container with ID starting with 4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380 not found: ID does not exist"
Sep 10 20:39:25.341504 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341456    2579 scope.go:117] "RemoveContainer" containerID="23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"
Sep 10 20:39:25.341710 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341694    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"} err="failed to get container status \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": rpc error: code = NotFound desc = could not find container \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": container with ID starting with 23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586 not found: ID does not exist"
Sep 10 20:39:25.341710 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341709    2579 scope.go:117] "RemoveContainer" containerID="ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"
Sep 10 20:39:25.341915 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341894    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"} err="failed to get container status \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": rpc error: code = NotFound desc = could not find container \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": container with ID starting with ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf not found: ID does not exist"
Sep 10 20:39:25.341981 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.341917    2579 scope.go:117] "RemoveContainer" containerID="22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"
Sep 10 20:39:25.342144 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.342124    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"} err="failed to get container status \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": rpc error: code = NotFound desc = could not find container \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": container with ID starting with 22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9 not found: ID does not exist"
Sep 10 20:39:25.342193 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.342145    2579 scope.go:117] "RemoveContainer" containerID="3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"
Sep 10 20:39:25.342349 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.342334    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f"} err="failed to get container status \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": rpc error: code = NotFound desc = could not find container \"3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f\": container with ID starting with 3a882c2b5033e90fffb717416c772ccf69efcf8953cdcc7cc23713078d1eec7f not found: ID does not exist"
Sep 10 20:39:25.342391 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.342350    2579 scope.go:117] "RemoveContainer" containerID="a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"
Sep 10 20:39:25.342586 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.342567    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20"} err="failed to get container status \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": rpc error: code = NotFound desc = could not find container \"a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20\": container with ID starting with a4acbbef1f856244278504280576baa443fd66b47cfbdb9fb5796b2015876d20 not found: ID does not exist"
Sep 10 20:39:25.342646 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.342588    2579 scope.go:117] "RemoveContainer" containerID="51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"
Sep 10 20:39:25.342801 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.342778    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d"} err="failed to get container status \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": rpc error: code = NotFound desc = could not find container \"51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d\": container with ID starting with 51f1063647f7d60f4f823304e07d2e0cbc7186068975d1e26a11f914448f525d not found: ID does not exist"
Sep 10 20:39:25.342848 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.342803    2579 scope.go:117] "RemoveContainer" containerID="4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"
Sep 10 20:39:25.343005 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.342988    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380"} err="failed to get container status \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": rpc error: code = NotFound desc = could not find container \"4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380\": container with ID starting with 4d017d851400693eaeffee69c17d96bbff84329acae46eb0f92757e390c11380 not found: ID does not exist"
Sep 10 20:39:25.343070 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.343007    2579 scope.go:117] "RemoveContainer" containerID="23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"
Sep 10 20:39:25.343220 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.343204    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586"} err="failed to get container status \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": rpc error: code = NotFound desc = could not find container \"23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586\": container with ID starting with 23d0e4f78fb0e340f8abd2beafa64fe819d86b056989f1d5a7221742fb421586 not found: ID does not exist"
Sep 10 20:39:25.343271 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.343220    2579 scope.go:117] "RemoveContainer" containerID="ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"
Sep 10 20:39:25.343529 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.343505    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf"} err="failed to get container status \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": rpc error: code = NotFound desc = could not find container \"ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf\": container with ID starting with ee6da6fb0df82f03622b1ab34e1fd432fbc119d0d9e19c87d7c98f527906f7cf not found: ID does not exist"
Sep 10 20:39:25.343529 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.343528    2579 scope.go:117] "RemoveContainer" containerID="22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"
Sep 10 20:39:25.343889 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.343864    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9"} err="failed to get container status \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": rpc error: code = NotFound desc = could not find container \"22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9\": container with ID starting with 22ecd2c8aaa97d174c3c721672328b48a938fb88270a74bf8a45885e33e45bb9 not found: ID does not exist"
Sep 10 20:39:25.356050 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356029    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:39:25.356275 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356264    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy-web"
Sep 10 20:39:25.356325 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356277    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy-web"
Sep 10 20:39:25.356325 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356287    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy-thanos"
Sep 10 20:39:25.356325 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356293    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy-thanos"
Sep 10 20:39:25.356325 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356308    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="init-config-reloader"
Sep 10 20:39:25.356325 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356314    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="init-config-reloader"
Sep 10 20:39:25.356325 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356320    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="prometheus"
Sep 10 20:39:25.356325 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356325    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="prometheus"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356331    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="config-reloader"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356336    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="config-reloader"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356344    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356349    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356356    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="042ca34a-49aa-4347-97e2-cf86e8c6d576" containerName="console"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356361    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="042ca34a-49aa-4347-97e2-cf86e8c6d576" containerName="console"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356368    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="thanos-sidecar"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356373    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="thanos-sidecar"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356415    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356423    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="config-reloader"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356429    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy-thanos"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356435    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="prometheus"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356441    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="042ca34a-49aa-4347-97e2-cf86e8c6d576" containerName="console"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356446    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="thanos-sidecar"
Sep 10 20:39:25.356515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.356451    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" containerName="kube-rbac-proxy-web"
Sep 10 20:39:25.361307 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.361286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.364281 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.364263    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 20:39:25.371031 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.371013    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 20:39:25.371296 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.371277    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 20:39:25.371362 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.371333    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 20:39:25.371511 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.371495    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 20:39:25.371581 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.371537    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 20:39:25.371581 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.371552    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 20:39:25.371788 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.371771    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 20:39:25.371824 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.371787    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4czqr\""
Sep 10 20:39:25.372396 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.372373    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 20:39:25.372396 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.372388    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 20:39:25.372557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.372383    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 20:39:25.372557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.372428    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 20:39:25.372557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.372376    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 20:39:25.372557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.372392    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-asmg178rtfi9k\""
Sep 10 20:39:25.374372 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.374353    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 20:39:25.378146 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.378127    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 20:39:25.391426 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.391407    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:39:25.421370 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421377    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-config\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421410    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6htct\" (UniqueName: \"kubernetes.io/projected/798e8793-a52b-41ad-9795-0efff31f3462-kube-api-access-6htct\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421589 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421589 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421484    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421589 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/798e8793-a52b-41ad-9795-0efff31f3462-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421589 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421589 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421589 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421589 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421836 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-web-config\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421836 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421836 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/798e8793-a52b-41ad-9795-0efff31f3462-config-out\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421836 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421836 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421836 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421749    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421836 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.421836 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.421835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.486481 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.486416    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1517beb-f7e0-46bd-87ae-e0b9d214aee8" path="/var/lib/kubelet/pods/a1517beb-f7e0-46bd-87ae-e0b9d214aee8/volumes"
Sep 10 20:39:25.522929 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.522907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.522941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.522969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-config\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.522988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6htct\" (UniqueName: \"kubernetes.io/projected/798e8793-a52b-41ad-9795-0efff31f3462-kube-api-access-6htct\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523315 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523315 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523315 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523315 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/798e8793-a52b-41ad-9795-0efff31f3462-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523315 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.523315 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523721    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.523910    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-web-config\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/798e8793-a52b-41ad-9795-0efff31f3462-config-out\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524252    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.525533 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.524359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.526230 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.526094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-config\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.526230 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.526127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.526447 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.526364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.526896 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.526851    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.526996 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.526894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.527302 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.527207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.527302 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.527273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.527683 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.527648    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.527683 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.527668    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/798e8793-a52b-41ad-9795-0efff31f3462-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.528165 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.528142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/798e8793-a52b-41ad-9795-0efff31f3462-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.528728 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.528699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.528810 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.528726    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.529015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.528994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-web-config\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.529087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.529012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/798e8793-a52b-41ad-9795-0efff31f3462-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.529428 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.529406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/798e8793-a52b-41ad-9795-0efff31f3462-config-out\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.533274 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.533258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6htct\" (UniqueName: \"kubernetes.io/projected/798e8793-a52b-41ad-9795-0efff31f3462-kube-api-access-6htct\") pod \"prometheus-k8s-0\" (UID: \"798e8793-a52b-41ad-9795-0efff31f3462\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.670379 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.670350    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:25.973540 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:25.973514    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:39:25.975998 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:39:25.975962    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798e8793_a52b_41ad_9795_0efff31f3462.slice/crio-0a6892a8b9684d551379c4b50c9fd0d3752f8cc13d72e2d0e2f2cc60f2fc8ae0 WatchSource:0}: Error finding container 0a6892a8b9684d551379c4b50c9fd0d3752f8cc13d72e2d0e2f2cc60f2fc8ae0: Status 404 returned error can't find the container with id 0a6892a8b9684d551379c4b50c9fd0d3752f8cc13d72e2d0e2f2cc60f2fc8ae0
Sep 10 20:39:26.296854 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:26.296770    2579 generic.go:356] "Generic (PLEG): container finished" podID="798e8793-a52b-41ad-9795-0efff31f3462" containerID="0996d0002c5bfda3e583d99770470ac6fd4b9a29538bf661f37541fad52cdc71" exitCode=0
Sep 10 20:39:26.297189 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:26.296857    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798e8793-a52b-41ad-9795-0efff31f3462","Type":"ContainerDied","Data":"0996d0002c5bfda3e583d99770470ac6fd4b9a29538bf661f37541fad52cdc71"}
Sep 10 20:39:26.297189 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:26.296975    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798e8793-a52b-41ad-9795-0efff31f3462","Type":"ContainerStarted","Data":"0a6892a8b9684d551379c4b50c9fd0d3752f8cc13d72e2d0e2f2cc60f2fc8ae0"}
Sep 10 20:39:26.857822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:26.857736    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:39:26.980928 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:26.980893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:39:27.305691 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:27.305658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798e8793-a52b-41ad-9795-0efff31f3462","Type":"ContainerStarted","Data":"cd18e2fa6885048910dc597b5558b132fec6bdaa0c6e366bccaca0d02c651608"}
Sep 10 20:39:27.306049 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:27.305724    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798e8793-a52b-41ad-9795-0efff31f3462","Type":"ContainerStarted","Data":"84ad88bf9536ac16f190f5e61d7d20a9754e106893622642c254ff417fa530c9"}
Sep 10 20:39:27.306049 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:27.305751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798e8793-a52b-41ad-9795-0efff31f3462","Type":"ContainerStarted","Data":"5bac33879e32e1c02d6d88050fa9c4f284b3e37636965f2634ca3e816fd1f499"}
Sep 10 20:39:27.306049 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:27.305775    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798e8793-a52b-41ad-9795-0efff31f3462","Type":"ContainerStarted","Data":"c14a0d2f865f5205aa956b0c49727fd54b5025403d557af8f8a262390fe90fa6"}
Sep 10 20:39:27.306049 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:27.305800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798e8793-a52b-41ad-9795-0efff31f3462","Type":"ContainerStarted","Data":"10238cc0a2dcb390d304076b4d9039ed026342fa96711e8609aceb1a8d5f0880"}
Sep 10 20:39:27.306049 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:27.305824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798e8793-a52b-41ad-9795-0efff31f3462","Type":"ContainerStarted","Data":"8eb90f2981db9c270da498a4799eac43464e62508b94dafb5ecf3608512ffc5c"}
Sep 10 20:39:27.361958 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:27.361900    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.3434084139999998 podStartE2EDuration="2.361881324s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.47291ms" isStatefulPod=false podCreationTimestamp="2026-09-10 20:39:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:39:27.360040594 +0000 UTC m=+192.396942122" watchObservedRunningTime="2026-09-10 20:39:27.361881324 +0000 UTC m=+192.398782837"
Sep 10 20:39:30.671355 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:30.671310    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:39:37.710032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:37.709999    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c49bc586f-fvcng"]
Sep 10 20:39:37.844397 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:37.844341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:39:37.946215 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:37.946174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:39:38.038787 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:38.038701    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:39:39.384641 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:39.384602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:39:50.603166 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:50.603116    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:39:50.793242 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:39:50.793206    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:02.729745 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:02.729693    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c49bc586f-fvcng" podUID="adcc558a-db99-4f32-bfe4-8b1458effe5d" containerName="console" containerID="cri-o://b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108" gracePeriod=15
Sep 10 20:40:02.980273 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:02.980219    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:40:03.134075 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134034    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-service-ca\") pod \"adcc558a-db99-4f32-bfe4-8b1458effe5d\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") "
Sep 10 20:40:03.134075 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134076    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-trusted-ca-bundle\") pod \"adcc558a-db99-4f32-bfe4-8b1458effe5d\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") "
Sep 10 20:40:03.134269 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134099    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-config\") pod \"adcc558a-db99-4f32-bfe4-8b1458effe5d\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") "
Sep 10 20:40:03.134269 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134132    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdvqz\" (UniqueName: \"kubernetes.io/projected/adcc558a-db99-4f32-bfe4-8b1458effe5d-kube-api-access-hdvqz\") pod \"adcc558a-db99-4f32-bfe4-8b1458effe5d\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") "
Sep 10 20:40:03.134371 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134325    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-oauth-config\") pod \"adcc558a-db99-4f32-bfe4-8b1458effe5d\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") "
Sep 10 20:40:03.134427 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134403    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-serving-cert\") pod \"adcc558a-db99-4f32-bfe4-8b1458effe5d\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") "
Sep 10 20:40:03.134604 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134487    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-oauth-serving-cert\") pod \"adcc558a-db99-4f32-bfe4-8b1458effe5d\" (UID: \"adcc558a-db99-4f32-bfe4-8b1458effe5d\") "
Sep 10 20:40:03.134604 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134456    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-service-ca" (OuterVolumeSpecName: "service-ca") pod "adcc558a-db99-4f32-bfe4-8b1458effe5d" (UID: "adcc558a-db99-4f32-bfe4-8b1458effe5d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:40:03.134604 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134469    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-config" (OuterVolumeSpecName: "console-config") pod "adcc558a-db99-4f32-bfe4-8b1458effe5d" (UID: "adcc558a-db99-4f32-bfe4-8b1458effe5d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:40:03.134856 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134687    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "adcc558a-db99-4f32-bfe4-8b1458effe5d" (UID: "adcc558a-db99-4f32-bfe4-8b1458effe5d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:40:03.134912 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134861    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "adcc558a-db99-4f32-bfe4-8b1458effe5d" (UID: "adcc558a-db99-4f32-bfe4-8b1458effe5d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:40:03.134912 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134875    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:40:03.134912 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134892    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-trusted-ca-bundle\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:40:03.134912 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.134903    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:40:03.136353 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.136329    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adcc558a-db99-4f32-bfe4-8b1458effe5d-kube-api-access-hdvqz" (OuterVolumeSpecName: "kube-api-access-hdvqz") pod "adcc558a-db99-4f32-bfe4-8b1458effe5d" (UID: "adcc558a-db99-4f32-bfe4-8b1458effe5d"). InnerVolumeSpecName "kube-api-access-hdvqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:40:03.136433 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.136365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "adcc558a-db99-4f32-bfe4-8b1458effe5d" (UID: "adcc558a-db99-4f32-bfe4-8b1458effe5d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:40:03.136433 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.136408    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "adcc558a-db99-4f32-bfe4-8b1458effe5d" (UID: "adcc558a-db99-4f32-bfe4-8b1458effe5d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:40:03.235458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.235378    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdvqz\" (UniqueName: \"kubernetes.io/projected/adcc558a-db99-4f32-bfe4-8b1458effe5d-kube-api-access-hdvqz\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:40:03.235458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.235406    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-oauth-config\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:40:03.235458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.235416    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adcc558a-db99-4f32-bfe4-8b1458effe5d-console-serving-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:40:03.235458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.235425    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adcc558a-db99-4f32-bfe4-8b1458effe5d-oauth-serving-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:40:03.442262 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.442227    2579 generic.go:356] "Generic (PLEG): container finished" podID="adcc558a-db99-4f32-bfe4-8b1458effe5d" containerID="b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108" exitCode=0
Sep 10 20:40:03.442434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.442277    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c49bc586f-fvcng"
Sep 10 20:40:03.442434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.442302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c49bc586f-fvcng" event={"ID":"adcc558a-db99-4f32-bfe4-8b1458effe5d","Type":"ContainerDied","Data":"b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108"}
Sep 10 20:40:03.442434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.442384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c49bc586f-fvcng" event={"ID":"adcc558a-db99-4f32-bfe4-8b1458effe5d","Type":"ContainerDied","Data":"77629ee1741a2f855a1ac00e84aeb253b058fe4727d3efcad56c4ecd417807a8"}
Sep 10 20:40:03.442434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.442409    2579 scope.go:117] "RemoveContainer" containerID="b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108"
Sep 10 20:40:03.450583 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.450556    2579 scope.go:117] "RemoveContainer" containerID="b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108"
Sep 10 20:40:03.450860 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:40:03.450838    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108\": container with ID starting with b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108 not found: ID does not exist" containerID="b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108"
Sep 10 20:40:03.450916 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.450869    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108"} err="failed to get container status \"b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108\": rpc error: code = NotFound desc = could not find container \"b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108\": container with ID starting with b8339144b899f25dc3039cd4f77299514d2b32b8b14a5247e06f7a6a96c54108 not found: ID does not exist"
Sep 10 20:40:03.464957 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.464930    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c49bc586f-fvcng"]
Sep 10 20:40:03.470803 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.470781    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c49bc586f-fvcng"]
Sep 10 20:40:03.486333 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:03.486269    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adcc558a-db99-4f32-bfe4-8b1458effe5d" path="/var/lib/kubelet/pods/adcc558a-db99-4f32-bfe4-8b1458effe5d/volumes"
Sep 10 20:40:16.622035 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:16.621983    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:25.670704 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:25.670667    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:40:25.685563 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:25.685535    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:40:26.542929 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:26.542903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:40:31.470109 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:31.470064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:34.068267 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:34.068231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:34.155713 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:34.155679    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:34.717791 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:34.717754    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:34.900430 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:34.900394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:46.100314 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:46.100224    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:46.182359 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:46.182320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:51.727354 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:51.727314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:40:52.053217 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:40:52.053131    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:41:13.844771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:13.844738    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:41:13.908677 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:13.908616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:41:15.388160 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:15.388136    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 20:41:29.778177 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:29.778139    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:41:31.030062 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:31.030028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:41:40.333603 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:40.333564    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:41:40.430893 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:40.430854    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:41:40.533271 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:40.533237    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:41:43.478687 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:43.478645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:41:43.579267 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:41:43.579237    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:42:44.132121 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:42:44.132082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:42:54.640100 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:42:54.640068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:42:54.740284 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:42:54.740251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:42:54.801799 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:42:54.801761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:07.374736 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:07.374704    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:33.072830 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:33.072796    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:34.487906 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:34.487869    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:36.867057 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:36.867015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:36.934318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:36.934285    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:41.727901 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:41.727814    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:41.790524 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:41.790492    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:44.707414 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:44.707378    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:44.788463 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:44.788429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:45.044331 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:45.044261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:45.145980 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:45.145942    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:47.250944 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:47.250902    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:47.463610 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:47.463574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:52.336090 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:52.336054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:52.437106 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:52.437072    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:55.660724 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:55.660682    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:55.949822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:55.949732    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:56.018443 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:56.018414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:58.612491 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:58.612461    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:43:58.693792 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:43:58.693755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:04.543343 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:04.543309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:04.640347 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:04.640312    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:06.743752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:06.743713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:30.252708 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:30.252671    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:30.383445 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:30.383409    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:30.862088 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:30.862052    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:31.078020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.077971    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:31.175674 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.175644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:31.242025 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.241993    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"]
Sep 10 20:44:31.242330 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.242318    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adcc558a-db99-4f32-bfe4-8b1458effe5d" containerName="console"
Sep 10 20:44:31.242375 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.242332    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="adcc558a-db99-4f32-bfe4-8b1458effe5d" containerName="console"
Sep 10 20:44:31.242412 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.242394    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="adcc558a-db99-4f32-bfe4-8b1458effe5d" containerName="console"
Sep 10 20:44:31.245390 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.245375    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.248240 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.248220    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 20:44:31.250538 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.250521    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 20:44:31.250652 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.250621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v6fqb\""
Sep 10 20:44:31.250781 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.250761    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 20:44:31.251125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.251108    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 20:44:31.260093 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.260070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-webhook-cert\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.260374 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.260107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-manifests\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.260374 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.260143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-tmp\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.260374 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.260202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz2d2\" (UniqueName: \"kubernetes.io/projected/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-kube-api-access-gz2d2\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.260374 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.260247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.274593 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.274570    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"]
Sep 10 20:44:31.360603 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.360576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-manifests\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.360750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.360621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-tmp\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.360750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.360660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz2d2\" (UniqueName: \"kubernetes.io/projected/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-kube-api-access-gz2d2\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.360750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.360683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.360750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.360711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-webhook-cert\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.361052 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.361021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-manifests\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.363051 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.363022    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-tmp\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.363197 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.363176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-webhook-cert\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.363197 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.363191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.373259 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.373240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz2d2\" (UniqueName: \"kubernetes.io/projected/ad26bcba-0fe0-423e-a260-4f0e8bae8ae5-kube-api-access-gz2d2\") pod \"opendatahub-operator-controller-manager-59df7859b6-dtrv8\" (UID: \"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5\") " pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.387579 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.387550    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:31.483666 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.483576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:31.555843 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.555818    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:31.585421 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.585388    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:31.686001 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.685965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:31.796413 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.796323    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:31.832874 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.832815    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"]
Sep 10 20:44:31.835040 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:44:31.835012    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad26bcba_0fe0_423e_a260_4f0e8bae8ae5.slice/crio-9d14d6d2c79bfd5b51b5aa7b8361e6412e661b420f70235418a650c62393da82 WatchSource:0}: Error finding container 9d14d6d2c79bfd5b51b5aa7b8361e6412e661b420f70235418a650c62393da82: Status 404 returned error can't find the container with id 9d14d6d2c79bfd5b51b5aa7b8361e6412e661b420f70235418a650c62393da82
Sep 10 20:44:31.836830 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:31.836812    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 20:44:32.421386 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:32.421353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8" event={"ID":"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5","Type":"ContainerStarted","Data":"9d14d6d2c79bfd5b51b5aa7b8361e6412e661b420f70235418a650c62393da82"}
Sep 10 20:44:34.056794 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:34.056745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:34.159956 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:34.159920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:35.437680 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:35.437649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8" event={"ID":"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5","Type":"ContainerStarted","Data":"b77173880eeddee93ab65a819d70b9d1bd51daf1d1057472bfc6bf7ba82bb6e7"}
Sep 10 20:44:36.443558 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:36.443520    2579 generic.go:356] "Generic (PLEG): container finished" podID="ad26bcba-0fe0-423e-a260-4f0e8bae8ae5" containerID="b77173880eeddee93ab65a819d70b9d1bd51daf1d1057472bfc6bf7ba82bb6e7" exitCode=0
Sep 10 20:44:36.443984 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:36.443603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8" event={"ID":"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5","Type":"ContainerDied","Data":"b77173880eeddee93ab65a819d70b9d1bd51daf1d1057472bfc6bf7ba82bb6e7"}
Sep 10 20:44:37.449186 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:37.449154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8" event={"ID":"ad26bcba-0fe0-423e-a260-4f0e8bae8ae5","Type":"ContainerStarted","Data":"f1067dce70d04f176edb1b87ed567188b84324410d9a64ff49c42cac3117a1c4"}
Sep 10 20:44:37.449580 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:37.449262    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:37.478547 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:37.478500    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8" podStartSLOduration=1.8790455339999999 podStartE2EDuration="6.478484365s" totalImagesPullingTime="3.529058144s" totalInitContainerRuntime="1.070380687s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:44:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:44:37.476197746 +0000 UTC m=+502.513099259" watchObservedRunningTime="2026-09-10 20:44:37.478484365 +0000 UTC m=+502.515385877"
Sep 10 20:44:48.454984 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:48.454955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59df7859b6-dtrv8"
Sep 10 20:44:48.611913 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:48.611878    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:50.468372 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:50.468331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:50.580568 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:50.580516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:50.885388 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:50.885297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:51.179117 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:51.179089    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:52.375421 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:52.375386    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:52.476441 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:52.476409    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:53.507098 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:53.507063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:54.278358 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:54.278319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:54.373790 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:54.373755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:57.079128 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:57.079093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:57.181668 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:57.181640    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:57.774735 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:57.774699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:57.978855 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:57.978817    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:44:58.275722 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:44:58.275681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:01.683139 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:01.683102    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:01.797133 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:01.797101    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:01.896508 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:01.896472    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:01.995435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:01.995350    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:02.113297 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:02.113267    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:02.374918 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:02.374838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:02.564911 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:02.564878    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:09.095656 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.095425    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"]
Sep 10 20:45:09.109123 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.109096    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.112479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.112450    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 20:45:09.112643 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.112575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 20:45:09.113615 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.113592    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 20:45:09.113775 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.113602    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 20:45:09.113775 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.113601    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8krxv\""
Sep 10 20:45:09.114237 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.114217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"]
Sep 10 20:45:09.272725 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.272690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.272890 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.272743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.272890 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.272794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.272890 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.272830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.272890 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.272886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94ldn\" (UniqueName: \"kubernetes.io/projected/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-kube-api-access-94ldn\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.273017 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.272913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.273017 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.272930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.373822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.373734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.373822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.373770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.373822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.373799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.374080 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.373852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.374080 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.373875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.374080 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.373902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.374080 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.373951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ldn\" (UniqueName: \"kubernetes.io/projected/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-kube-api-access-94ldn\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.374776 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.374731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.376235 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.376204    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.376346 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.376246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.376419 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.376403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.376577 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.376558    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.396586 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.396559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.405895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.405848    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94ldn\" (UniqueName: \"kubernetes.io/projected/33585c70-a0b0-4f7a-88aa-1bcbbea313dd-kube-api-access-94ldn\") pod \"istiod-openshift-gateway-5677ccb49b-qsxgf\" (UID: \"33585c70-a0b0-4f7a-88aa-1bcbbea313dd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.419708 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.419686    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:09.612962 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.612926    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"]
Sep 10 20:45:09.616257 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.616238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.619512 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.619489    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 20:45:09.619512 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.619503    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 20:45:09.619846 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.619830    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 20:45:09.620506 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.620488    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h2f25\""
Sep 10 20:45:09.620610 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.620546    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:45:09.620610 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.620570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 20:45:09.626013 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.625968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"]
Sep 10 20:45:09.694899 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.694875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"]
Sep 10 20:45:09.696949 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:45:09.696924    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33585c70_a0b0_4f7a_88aa_1bcbbea313dd.slice/crio-090ce4f1492149b7cc3e5a822514d188c6ecf7648b5fccc2cb61e9caf3c83b03 WatchSource:0}: Error finding container 090ce4f1492149b7cc3e5a822514d188c6ecf7648b5fccc2cb61e9caf3c83b03: Status 404 returned error can't find the container with id 090ce4f1492149b7cc3e5a822514d188c6ecf7648b5fccc2cb61e9caf3c83b03
Sep 10 20:45:09.778012 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.777974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/26ba509d-49cd-4204-93ba-083e92f43674-metrics-cert\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.778012 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.778009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26ba509d-49cd-4204-93ba-083e92f43674-cert\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.778231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.778085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww492\" (UniqueName: \"kubernetes.io/projected/26ba509d-49cd-4204-93ba-083e92f43674-kube-api-access-ww492\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.778231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.778113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/26ba509d-49cd-4204-93ba-083e92f43674-manager-config\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.879489 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.879402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww492\" (UniqueName: \"kubernetes.io/projected/26ba509d-49cd-4204-93ba-083e92f43674-kube-api-access-ww492\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.879489 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.879444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/26ba509d-49cd-4204-93ba-083e92f43674-manager-config\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.879489 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.879470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/26ba509d-49cd-4204-93ba-083e92f43674-metrics-cert\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.879489 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.879485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26ba509d-49cd-4204-93ba-083e92f43674-cert\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.880126 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.880093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/26ba509d-49cd-4204-93ba-083e92f43674-manager-config\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.881907 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.881878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/26ba509d-49cd-4204-93ba-083e92f43674-metrics-cert\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.882092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.882075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26ba509d-49cd-4204-93ba-083e92f43674-cert\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.897599 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.897575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww492\" (UniqueName: \"kubernetes.io/projected/26ba509d-49cd-4204-93ba-083e92f43674-kube-api-access-ww492\") pod \"lws-controller-manager-8d95fb99-9frtv\" (UID: \"26ba509d-49cd-4204-93ba-083e92f43674\") " pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:09.926297 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:09.926275    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:10.211919 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:10.211850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"]
Sep 10 20:45:10.214202 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:45:10.214168    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ba509d_49cd_4204_93ba_083e92f43674.slice/crio-1327a0210c4ad952c1998bddd611b998154e10391f9eef942a9159cf2acda679 WatchSource:0}: Error finding container 1327a0210c4ad952c1998bddd611b998154e10391f9eef942a9159cf2acda679: Status 404 returned error can't find the container with id 1327a0210c4ad952c1998bddd611b998154e10391f9eef942a9159cf2acda679
Sep 10 20:45:10.577466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:10.577360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf" event={"ID":"33585c70-a0b0-4f7a-88aa-1bcbbea313dd","Type":"ContainerStarted","Data":"090ce4f1492149b7cc3e5a822514d188c6ecf7648b5fccc2cb61e9caf3c83b03"}
Sep 10 20:45:10.578798 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:10.578762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv" event={"ID":"26ba509d-49cd-4204-93ba-083e92f43674","Type":"ContainerStarted","Data":"1327a0210c4ad952c1998bddd611b998154e10391f9eef942a9159cf2acda679"}
Sep 10 20:45:12.655697 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:12.655643    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:12.826100 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:12.826066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:12.897243 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:12.897211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:13.000831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.000721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:13.086070 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.086030    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:45:13.086150 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.086123    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:45:13.103936 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.103904    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:13.210535 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.210497    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:45:13.597153 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.597116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf" event={"ID":"33585c70-a0b0-4f7a-88aa-1bcbbea313dd","Type":"ContainerStarted","Data":"7e9e304ace15476cea54fab60e75790fcaf0886c937e38498492abc789f80934"}
Sep 10 20:45:13.597339 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.597263    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:13.598645 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.598606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv" event={"ID":"26ba509d-49cd-4204-93ba-083e92f43674","Type":"ContainerStarted","Data":"c3f5c9ca347ac77448760970861d7b2ed16bfc133464a33302bde603fb59b088"}
Sep 10 20:45:13.598771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.598747    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:45:13.638510 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.638463    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf" podStartSLOduration=1.25157158 podStartE2EDuration="4.638448939s" totalImagesPullingTime="3.386877359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:45:13.63540727 +0000 UTC m=+538.672308794" watchObservedRunningTime="2026-09-10 20:45:13.638448939 +0000 UTC m=+538.675350451"
Sep 10 20:45:13.673177 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:13.673127    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv" podStartSLOduration=1.751353896 podStartE2EDuration="4.673112375s" totalImagesPullingTime="2.921758479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:45:13.671159547 +0000 UTC m=+538.708061060" watchObservedRunningTime="2026-09-10 20:45:13.673112375 +0000 UTC m=+538.710013887"
Sep 10 20:45:14.605542 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:14.605510    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf"
Sep 10 20:45:24.606170 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:45:24.606139    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8d95fb99-9frtv"
Sep 10 20:46:02.607764 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:02.607720    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:02.707140 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:02.707102    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:17.224193 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:17.224141    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:17.324525 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:17.324479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:28.660447 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:28.660414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:31.331442 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:31.331400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:32.807160 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:32.807127    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:33.092482 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:33.092394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:33.446606 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:33.446568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:34.261821 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:34.261784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:34.519494 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:34.519420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:35.951549 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:35.951515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:36.442961 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:36.442922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:36.746554 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:36.746464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:36.850692 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:36.850659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:36.961730 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:36.961689    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:37.251286 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:37.251244    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:37.350497 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:37.350460    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:40.308334 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:40.308246    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:42.313347 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:42.313312    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:42.425679 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:42.425642    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:46.777735 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:46.777706    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:46.920763 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:46.920722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:47.020453 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:47.020419    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:47.083981 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:47.083898    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:47.210502 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:47.210463    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:49.948222 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:49.948183    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:50.063215 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:50.063178    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:54.680640 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:54.680595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:54.780991 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:54.780955    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:46:54.881543 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:46:54.881510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:01.439189 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:01.439152    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:01.529387 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:01.529351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:06.771734 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:06.771702    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:06.831424 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:06.831389    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:07.171355 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:07.171322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:07.269652 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:07.269597    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:08.734286 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:08.734255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:10.597546 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:10.597515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:10.706920 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:10.706892    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:14.383019 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:14.382985    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:14.482187 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:14.482151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:14.583698 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:14.583663    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:26.172011 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:26.171972    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:26.333773 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:26.333738    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:29.421934 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:29.421895    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:29.523675 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:29.523623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:29.844585 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:29.844505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:40.300858 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.300823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:40.314900 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.314872    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jgfzq"]
Sep 10 20:47:40.318140 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.318118    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:40.321476 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.321454    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 20:47:40.321598 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.321479    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 20:47:40.321598 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.321501    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 20:47:40.321741 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.321618    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5j9jh\""
Sep 10 20:47:40.330492 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.330472    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jgfzq"]
Sep 10 20:47:40.405283 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.405251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jgfzq"]
Sep 10 20:47:40.407691 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.407662    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:40.437752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.437728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th6h9\" (UniqueName: \"kubernetes.io/projected/f72e383d-fafb-484e-bd6f-c698e5e99d2f-kube-api-access-th6h9\") pod \"limitador-limitador-8588749977-jgfzq\" (UID: \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\") " pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:40.437860 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.437763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f72e383d-fafb-484e-bd6f-c698e5e99d2f-config-file\") pod \"limitador-limitador-8588749977-jgfzq\" (UID: \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\") " pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:40.508768 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.508734    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:40.538896 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.538860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th6h9\" (UniqueName: \"kubernetes.io/projected/f72e383d-fafb-484e-bd6f-c698e5e99d2f-kube-api-access-th6h9\") pod \"limitador-limitador-8588749977-jgfzq\" (UID: \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\") " pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:40.539052 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.538905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f72e383d-fafb-484e-bd6f-c698e5e99d2f-config-file\") pod \"limitador-limitador-8588749977-jgfzq\" (UID: \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\") " pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:40.539578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.539557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f72e383d-fafb-484e-bd6f-c698e5e99d2f-config-file\") pod \"limitador-limitador-8588749977-jgfzq\" (UID: \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\") " pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:40.547822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.547793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th6h9\" (UniqueName: \"kubernetes.io/projected/f72e383d-fafb-484e-bd6f-c698e5e99d2f-kube-api-access-th6h9\") pod \"limitador-limitador-8588749977-jgfzq\" (UID: \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\") " pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:40.627877 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.627794    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:40.901402 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:40.901377    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jgfzq"]
Sep 10 20:47:40.903731 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:47:40.903702    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72e383d_fafb_484e_bd6f_c698e5e99d2f.slice/crio-7d744f45fe02d1ae4d4e23701c7f2e750722a88df451ec50d38b7d22b43028e7 WatchSource:0}: Error finding container 7d744f45fe02d1ae4d4e23701c7f2e750722a88df451ec50d38b7d22b43028e7: Status 404 returned error can't find the container with id 7d744f45fe02d1ae4d4e23701c7f2e750722a88df451ec50d38b7d22b43028e7
Sep 10 20:47:41.134250 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:41.134209    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:41.185294 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:41.185192    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:41.204586 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:41.204557    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq" event={"ID":"f72e383d-fafb-484e-bd6f-c698e5e99d2f","Type":"ContainerStarted","Data":"7d744f45fe02d1ae4d4e23701c7f2e750722a88df451ec50d38b7d22b43028e7"}
Sep 10 20:47:44.219087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:44.219048    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq" event={"ID":"f72e383d-fafb-484e-bd6f-c698e5e99d2f","Type":"ContainerStarted","Data":"d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57"}
Sep 10 20:47:44.219476 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:44.219180    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:44.242059 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:44.242012    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq" podStartSLOduration=1.999063294 podStartE2EDuration="4.2419956s" totalImagesPullingTime="2.242932306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:47:44.239758737 +0000 UTC m=+689.276660251" watchObservedRunningTime="2026-09-10 20:47:44.2419956 +0000 UTC m=+689.278897189"
Sep 10 20:47:54.980982 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:54.980944    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jgfzq"]
Sep 10 20:47:54.981489 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:54.981173    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq" podUID="f72e383d-fafb-484e-bd6f-c698e5e99d2f" containerName="limitador" containerID="cri-o://d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57" gracePeriod=30
Sep 10 20:47:54.982068 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:54.981942    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:55.529377 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:55.529353    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:55.670891 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:55.670856    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f72e383d-fafb-484e-bd6f-c698e5e99d2f-config-file\") pod \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\" (UID: \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\") "
Sep 10 20:47:55.671061 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:55.670945    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th6h9\" (UniqueName: \"kubernetes.io/projected/f72e383d-fafb-484e-bd6f-c698e5e99d2f-kube-api-access-th6h9\") pod \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\" (UID: \"f72e383d-fafb-484e-bd6f-c698e5e99d2f\") "
Sep 10 20:47:55.671270 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:55.671246    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f72e383d-fafb-484e-bd6f-c698e5e99d2f-config-file" (OuterVolumeSpecName: "config-file") pod "f72e383d-fafb-484e-bd6f-c698e5e99d2f" (UID: "f72e383d-fafb-484e-bd6f-c698e5e99d2f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:47:55.673171 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:55.673147    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f72e383d-fafb-484e-bd6f-c698e5e99d2f-kube-api-access-th6h9" (OuterVolumeSpecName: "kube-api-access-th6h9") pod "f72e383d-fafb-484e-bd6f-c698e5e99d2f" (UID: "f72e383d-fafb-484e-bd6f-c698e5e99d2f"). InnerVolumeSpecName "kube-api-access-th6h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:47:55.771948 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:55.771910    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f72e383d-fafb-484e-bd6f-c698e5e99d2f-config-file\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:47:55.771948 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:55.771943    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th6h9\" (UniqueName: \"kubernetes.io/projected/f72e383d-fafb-484e-bd6f-c698e5e99d2f-kube-api-access-th6h9\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:47:56.268361 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:56.268327    2579 generic.go:356] "Generic (PLEG): container finished" podID="f72e383d-fafb-484e-bd6f-c698e5e99d2f" containerID="d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57" exitCode=0
Sep 10 20:47:56.268800 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:56.268371    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq"
Sep 10 20:47:56.268800 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:56.268413    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq" event={"ID":"f72e383d-fafb-484e-bd6f-c698e5e99d2f","Type":"ContainerDied","Data":"d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57"}
Sep 10 20:47:56.268800 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:56.268470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-jgfzq" event={"ID":"f72e383d-fafb-484e-bd6f-c698e5e99d2f","Type":"ContainerDied","Data":"7d744f45fe02d1ae4d4e23701c7f2e750722a88df451ec50d38b7d22b43028e7"}
Sep 10 20:47:56.268800 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:56.268497    2579 scope.go:117] "RemoveContainer" containerID="d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57"
Sep 10 20:47:56.277040 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:56.277023    2579 scope.go:117] "RemoveContainer" containerID="d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57"
Sep 10 20:47:56.277304 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:47:56.277280    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57\": container with ID starting with d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57 not found: ID does not exist" containerID="d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57"
Sep 10 20:47:56.277368 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:56.277311    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57"} err="failed to get container status \"d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57\": rpc error: code = NotFound desc = could not find container \"d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57\": container with ID starting with d21e4f6f559ba36c3d7bacfff0a40bbb16252b13c7ceb643edf54efc381a7e57 not found: ID does not exist"
Sep 10 20:47:56.291960 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:56.291935    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jgfzq"]
Sep 10 20:47:56.293969 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:56.293947    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-jgfzq"]
Sep 10 20:47:57.486575 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:57.486545    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f72e383d-fafb-484e-bd6f-c698e5e99d2f" path="/var/lib/kubelet/pods/f72e383d-fafb-484e-bd6f-c698e5e99d2f/volumes"
Sep 10 20:47:58.161894 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.161851    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:58.264568 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.264528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:58.655037 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.655003    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"]
Sep 10 20:47:58.655402 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.655346    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72e383d-fafb-484e-bd6f-c698e5e99d2f" containerName="limitador"
Sep 10 20:47:58.655402 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.655357    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72e383d-fafb-484e-bd6f-c698e5e99d2f" containerName="limitador"
Sep 10 20:47:58.655402 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.655403    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72e383d-fafb-484e-bd6f-c698e5e99d2f" containerName="limitador"
Sep 10 20:47:58.659930 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.659914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:47:58.666235 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.666213    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 20:47:58.667232 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.667217    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-x8xxh\""
Sep 10 20:47:58.667385 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.667366    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 20:47:58.668433 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.668418    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 20:47:58.680471 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.680444    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"]
Sep 10 20:47:58.681392 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.681368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:47:58.801395 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.801353    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/349dccb8-bf4f-4dd6-8f1b-36eb0a22df37-data\") pod \"postgres-69fb4594cf-zgvqd\" (UID: \"349dccb8-bf4f-4dd6-8f1b-36eb0a22df37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:47:58.801546 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.801455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqfdw\" (UniqueName: \"kubernetes.io/projected/349dccb8-bf4f-4dd6-8f1b-36eb0a22df37-kube-api-access-qqfdw\") pod \"postgres-69fb4594cf-zgvqd\" (UID: \"349dccb8-bf4f-4dd6-8f1b-36eb0a22df37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:47:58.902490 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.902452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqfdw\" (UniqueName: \"kubernetes.io/projected/349dccb8-bf4f-4dd6-8f1b-36eb0a22df37-kube-api-access-qqfdw\") pod \"postgres-69fb4594cf-zgvqd\" (UID: \"349dccb8-bf4f-4dd6-8f1b-36eb0a22df37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:47:58.902714 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.902515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/349dccb8-bf4f-4dd6-8f1b-36eb0a22df37-data\") pod \"postgres-69fb4594cf-zgvqd\" (UID: \"349dccb8-bf4f-4dd6-8f1b-36eb0a22df37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:47:58.902888 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.902869    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/349dccb8-bf4f-4dd6-8f1b-36eb0a22df37-data\") pod \"postgres-69fb4594cf-zgvqd\" (UID: \"349dccb8-bf4f-4dd6-8f1b-36eb0a22df37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:47:58.911374 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.911323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqfdw\" (UniqueName: \"kubernetes.io/projected/349dccb8-bf4f-4dd6-8f1b-36eb0a22df37-kube-api-access-qqfdw\") pod \"postgres-69fb4594cf-zgvqd\" (UID: \"349dccb8-bf4f-4dd6-8f1b-36eb0a22df37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:47:58.969967 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:58.969937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:47:59.246428 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:59.246398    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"]
Sep 10 20:47:59.248974 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:47:59.248946    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349dccb8_bf4f_4dd6_8f1b_36eb0a22df37.slice/crio-b49d02f2fda8627bf776d7b73a81900bb120bac948ce2558469fc84f5ee25b43 WatchSource:0}: Error finding container b49d02f2fda8627bf776d7b73a81900bb120bac948ce2558469fc84f5ee25b43: Status 404 returned error can't find the container with id b49d02f2fda8627bf776d7b73a81900bb120bac948ce2558469fc84f5ee25b43
Sep 10 20:47:59.283327 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:47:59.283295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd" event={"ID":"349dccb8-bf4f-4dd6-8f1b-36eb0a22df37","Type":"ContainerStarted","Data":"b49d02f2fda8627bf776d7b73a81900bb120bac948ce2558469fc84f5ee25b43"}
Sep 10 20:48:04.311198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:04.311119    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd" event={"ID":"349dccb8-bf4f-4dd6-8f1b-36eb0a22df37","Type":"ContainerStarted","Data":"cf639cc62ac246e8e9f5a54f0db2db9e30829e347e2939690be30a323cbc1137"}
Sep 10 20:48:04.311548 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:04.311223    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:48:04.329534 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:04.329480    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd" podStartSLOduration=1.53869502 podStartE2EDuration="6.3294642s" totalImagesPullingTime="4.79076918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:48:04.328389293 +0000 UTC m=+709.365290807" watchObservedRunningTime="2026-09-10 20:48:04.3294642 +0000 UTC m=+709.366365712"
Sep 10 20:48:10.344170 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:10.344082    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zgvqd"
Sep 10 20:48:10.669649 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:10.669605    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:11.538240 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:11.538209    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:17.429807 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.429762    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:17.471156 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.471122    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7859676558-p2tm4"]
Sep 10 20:48:17.493953 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.493921    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7859676558-p2tm4"]
Sep 10 20:48:17.494100 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.494037    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.497660 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.497611    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 20:48:17.498972 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.498949    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 20:48:17.499102 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.499067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k557b\""
Sep 10 20:48:17.499268 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.499248    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 20:48:17.521339 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.521311    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:17.555487 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.555458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-webhook-cert\") pod \"maas-controller-7859676558-p2tm4\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") " pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.555601 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.555502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-metrics-certs\") pod \"maas-controller-7859676558-p2tm4\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") " pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.555601 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.555567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw8sb\" (UniqueName: \"kubernetes.io/projected/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-kube-api-access-fw8sb\") pod \"maas-controller-7859676558-p2tm4\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") " pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.584145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.584092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:17.645687 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.645659    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6db979f4bf-jpsjs"]
Sep 10 20:48:17.648992 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.648977    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.655932 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.655907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-webhook-cert\") pod \"maas-controller-7859676558-p2tm4\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") " pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.656045 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.655947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-metrics-certs\") pod \"maas-controller-7859676558-p2tm4\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") " pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.656045 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.655985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw8sb\" (UniqueName: \"kubernetes.io/projected/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-kube-api-access-fw8sb\") pod \"maas-controller-7859676558-p2tm4\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") " pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.658322 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.658302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-webhook-cert\") pod \"maas-controller-7859676558-p2tm4\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") " pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.658450 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.658432    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-metrics-certs\") pod \"maas-controller-7859676558-p2tm4\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") " pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.661715 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.661681    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-jpsjs"]
Sep 10 20:48:17.667708 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.667685    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw8sb\" (UniqueName: \"kubernetes.io/projected/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-kube-api-access-fw8sb\") pod \"maas-controller-7859676558-p2tm4\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") " pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.756521 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.756458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl99v\" (UniqueName: \"kubernetes.io/projected/4f886574-1899-4a7c-bbe6-622cfd167339-kube-api-access-cl99v\") pod \"maas-controller-6db979f4bf-jpsjs\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") " pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.756660 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.756545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-webhook-cert\") pod \"maas-controller-6db979f4bf-jpsjs\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") " pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.756660 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.756582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-metrics-certs\") pod \"maas-controller-6db979f4bf-jpsjs\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") " pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.805121 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.805094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:17.857811 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.857722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl99v\" (UniqueName: \"kubernetes.io/projected/4f886574-1899-4a7c-bbe6-622cfd167339-kube-api-access-cl99v\") pod \"maas-controller-6db979f4bf-jpsjs\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") " pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.857811 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.857782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-webhook-cert\") pod \"maas-controller-6db979f4bf-jpsjs\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") " pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.857811 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.857807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-metrics-certs\") pod \"maas-controller-6db979f4bf-jpsjs\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") " pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.861943 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.861914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-metrics-certs\") pod \"maas-controller-6db979f4bf-jpsjs\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") " pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.862346 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.862319    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-webhook-cert\") pod \"maas-controller-6db979f4bf-jpsjs\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") " pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.869404 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.869367    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl99v\" (UniqueName: \"kubernetes.io/projected/4f886574-1899-4a7c-bbe6-622cfd167339-kube-api-access-cl99v\") pod \"maas-controller-6db979f4bf-jpsjs\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") " pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:17.958732 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:17.958702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:18.081788 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:18.081728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7859676558-p2tm4"]
Sep 10 20:48:18.083809 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:48:18.083777    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3fb3f8_8d04_4f61_9e31_4851a7a0a20e.slice/crio-20d31e6cd17c15a1b1cc02ef1ae1f7e25003f1cb13273a2762b71cbaa99cb39f WatchSource:0}: Error finding container 20d31e6cd17c15a1b1cc02ef1ae1f7e25003f1cb13273a2762b71cbaa99cb39f: Status 404 returned error can't find the container with id 20d31e6cd17c15a1b1cc02ef1ae1f7e25003f1cb13273a2762b71cbaa99cb39f
Sep 10 20:48:18.229928 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:18.229907    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-jpsjs"]
Sep 10 20:48:18.231209 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:48:18.231178    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f886574_1899_4a7c_bbe6_622cfd167339.slice/crio-16d37d3232a29b82a4078aa57be7b6d7522cd4c67874ba1471fbb0f50a4786a2 WatchSource:0}: Error finding container 16d37d3232a29b82a4078aa57be7b6d7522cd4c67874ba1471fbb0f50a4786a2: Status 404 returned error can't find the container with id 16d37d3232a29b82a4078aa57be7b6d7522cd4c67874ba1471fbb0f50a4786a2
Sep 10 20:48:18.372705 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:18.372620    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-jpsjs" event={"ID":"4f886574-1899-4a7c-bbe6-622cfd167339","Type":"ContainerStarted","Data":"16d37d3232a29b82a4078aa57be7b6d7522cd4c67874ba1471fbb0f50a4786a2"}
Sep 10 20:48:18.373801 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:18.373761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7859676558-p2tm4" event={"ID":"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e","Type":"ContainerStarted","Data":"20d31e6cd17c15a1b1cc02ef1ae1f7e25003f1cb13273a2762b71cbaa99cb39f"}
Sep 10 20:48:20.857952 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:20.857919    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:20.949334 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:20.949246    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:21.391860 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:21.391770    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7859676558-p2tm4" event={"ID":"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e","Type":"ContainerStarted","Data":"aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9"}
Sep 10 20:48:21.392022 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:21.391858    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:21.393256 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:21.393236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-jpsjs" event={"ID":"4f886574-1899-4a7c-bbe6-622cfd167339","Type":"ContainerStarted","Data":"99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333"}
Sep 10 20:48:21.393367 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:21.393356    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:21.413919 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:21.413865    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7859676558-p2tm4" podStartSLOduration=1.8242568540000001 podStartE2EDuration="4.41384754s" totalImagesPullingTime="2.589590686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:48:21.41339519 +0000 UTC m=+726.450296702" watchObservedRunningTime="2026-09-10 20:48:21.41384754 +0000 UTC m=+726.450749054"
Sep 10 20:48:21.436003 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:21.435959    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6db979f4bf-jpsjs" podStartSLOduration=2.003457895 podStartE2EDuration="4.435946026s" totalImagesPullingTime="2.432488131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:48:21.434472593 +0000 UTC m=+726.471374109" watchObservedRunningTime="2026-09-10 20:48:21.435946026 +0000 UTC m=+726.472847566"
Sep 10 20:48:32.399857 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.399822    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 20:48:32.400223 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.399901    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:32.469460 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.469415    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7859676558-p2tm4"]
Sep 10 20:48:32.469736 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.469669    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7859676558-p2tm4" podUID="9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e" containerName="manager" containerID="cri-o://aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9" gracePeriod=30
Sep 10 20:48:32.713968 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.713941    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:32.789682 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.789648    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw8sb\" (UniqueName: \"kubernetes.io/projected/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-kube-api-access-fw8sb\") pod \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") "
Sep 10 20:48:32.789826 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.789690    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-webhook-cert\") pod \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") "
Sep 10 20:48:32.789826 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.789741    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-metrics-certs\") pod \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\" (UID: \"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e\") "
Sep 10 20:48:32.791857 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.791827    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-kube-api-access-fw8sb" (OuterVolumeSpecName: "kube-api-access-fw8sb") pod "9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e" (UID: "9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e"). InnerVolumeSpecName "kube-api-access-fw8sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:48:32.791989 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.791887    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e" (UID: "9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:48:32.791989 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.791904    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e" (UID: "9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:48:32.890962 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.890931    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw8sb\" (UniqueName: \"kubernetes.io/projected/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-kube-api-access-fw8sb\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:48:32.890962 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.890955    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-webhook-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:48:32.890962 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:32.890964    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:48:33.449062 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.449030    2579 generic.go:356] "Generic (PLEG): container finished" podID="9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e" containerID="aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9" exitCode=0
Sep 10 20:48:33.449496 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.449072    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7859676558-p2tm4" event={"ID":"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e","Type":"ContainerDied","Data":"aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9"}
Sep 10 20:48:33.449496 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.449111    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7859676558-p2tm4" event={"ID":"9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e","Type":"ContainerDied","Data":"20d31e6cd17c15a1b1cc02ef1ae1f7e25003f1cb13273a2762b71cbaa99cb39f"}
Sep 10 20:48:33.449496 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.449130    2579 scope.go:117] "RemoveContainer" containerID="aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9"
Sep 10 20:48:33.449496 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.449074    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7859676558-p2tm4"
Sep 10 20:48:33.458470 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.458453    2579 scope.go:117] "RemoveContainer" containerID="aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9"
Sep 10 20:48:33.458767 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:48:33.458747    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9\": container with ID starting with aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9 not found: ID does not exist" containerID="aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9"
Sep 10 20:48:33.458822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.458776    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9"} err="failed to get container status \"aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9\": rpc error: code = NotFound desc = could not find container \"aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9\": container with ID starting with aeac47642c94105241e96d48f73fd47c26e23f6b1c4ad9d9e1d516a850044aa9 not found: ID does not exist"
Sep 10 20:48:33.473364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.473338    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7859676558-p2tm4"]
Sep 10 20:48:33.477527 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.477505    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7859676558-p2tm4"]
Sep 10 20:48:33.485984 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:33.485961    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e" path="/var/lib/kubelet/pods/9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e/volumes"
Sep 10 20:48:53.510301 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:53.510257    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:53.611138 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:53.611090    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:55.015745 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.015703    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:55.115460 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.115419    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:55.151026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.150992    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"]
Sep 10 20:48:55.151306 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.151294    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e" containerName="manager"
Sep 10 20:48:55.151350 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.151307    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e" containerName="manager"
Sep 10 20:48:55.151384 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.151367    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3fb3f8-8d04-4f61-9e31-4851a7a0a20e" containerName="manager"
Sep 10 20:48:55.156989 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.156974    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.159925 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.159891    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 20:48:55.161030 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.161011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 20:48:55.161168 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.161067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qqzh2\""
Sep 10 20:48:55.166201 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.166178    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"]
Sep 10 20:48:55.181951 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.181926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-maas-api-tls\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.182081 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.181981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-metrics-certs\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.182081 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.182012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6psh\" (UniqueName: \"kubernetes.io/projected/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-kube-api-access-m6psh\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.182081 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.182051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-openshift-service-ca\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.210352 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.210321    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:55.282705 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.282603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-openshift-service-ca\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.282862 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.282707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-maas-api-tls\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.282862 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.282753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-metrics-certs\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.282862 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.282782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6psh\" (UniqueName: \"kubernetes.io/projected/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-kube-api-access-m6psh\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.283040 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:48:55.282859    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 10 20:48:55.283040 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:48:55.282939    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-maas-api-tls podName:371f6bb1-c93e-44bf-ad42-9bf18f6204b1 nodeName:}" failed. No retries permitted until 2026-09-10 20:48:55.782918395 +0000 UTC m=+760.819819890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-maas-api-tls") pod "maas-api-5999f65fcd-zwl76" (UID: "371f6bb1-c93e-44bf-ad42-9bf18f6204b1") : secret "maas-api-serving-cert" not found
Sep 10 20:48:55.283336 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.283314    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-openshift-service-ca\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.285046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.285029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-metrics-certs\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.293585 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.293561    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6psh\" (UniqueName: \"kubernetes.io/projected/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-kube-api-access-m6psh\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.528539 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.528502    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:55.644181 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.644088    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:55.730517 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.730476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:48:55.786401 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.786362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-maas-api-tls\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:55.788828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:55.788799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-maas-api-tls\") pod \"maas-api-5999f65fcd-zwl76\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") " pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:56.068439 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:56.068402    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:56.340471 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:56.340446    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"]
Sep 10 20:48:56.342619 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:48:56.342594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371f6bb1_c93e_44bf_ad42_9bf18f6204b1.slice/crio-d051c9cd4d70e3a9bdb6cfbe88340fd0a81085036d43bcd0a3252a145bcae8e6 WatchSource:0}: Error finding container d051c9cd4d70e3a9bdb6cfbe88340fd0a81085036d43bcd0a3252a145bcae8e6: Status 404 returned error can't find the container with id d051c9cd4d70e3a9bdb6cfbe88340fd0a81085036d43bcd0a3252a145bcae8e6
Sep 10 20:48:56.547417 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:56.547389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76" event={"ID":"371f6bb1-c93e-44bf-ad42-9bf18f6204b1","Type":"ContainerStarted","Data":"d051c9cd4d70e3a9bdb6cfbe88340fd0a81085036d43bcd0a3252a145bcae8e6"}
Sep 10 20:48:58.558860 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:58.558818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76" event={"ID":"371f6bb1-c93e-44bf-ad42-9bf18f6204b1","Type":"ContainerStarted","Data":"5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e"}
Sep 10 20:48:58.559486 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:58.558954    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:48:58.578966 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:48:58.578916    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76" podStartSLOduration=1.860021255 podStartE2EDuration="3.578903884s" totalImagesPullingTime="1.718882629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:48:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:48:58.577006176 +0000 UTC m=+763.613907691" watchObservedRunningTime="2026-09-10 20:48:58.578903884 +0000 UTC m=+763.615805397"
Sep 10 20:49:04.568541 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:04.568514    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 20:49:05.561349 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:05.561320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:49:05.661035 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:05.661007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:49:24.998305 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:24.998265    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:49:32.190828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.190789    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"]
Sep 10 20:49:32.195928 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.195903    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.200052 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.200028    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 20:49:32.200157 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.200082    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kzwmk\""
Sep 10 20:49:32.200157 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.200028    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 20:49:32.200420 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.200403    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 10 20:49:32.207201 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.207179    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"]
Sep 10 20:49:32.226657 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.226617    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:49:32.298009 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.297978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rjtj\" (UniqueName: \"kubernetes.io/projected/a22b5186-8c8a-485c-852e-456d377e4d86-kube-api-access-8rjtj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.298115 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.298032    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a22b5186-8c8a-485c-852e-456d377e4d86-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.298115 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.298091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.298191 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.298133    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.298191 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.298164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.298191 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.298187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.399411 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.399384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a22b5186-8c8a-485c-852e-456d377e4d86-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.399411 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.399422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.399653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.399452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.399653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.399485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.399653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.399510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.399653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.399552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rjtj\" (UniqueName: \"kubernetes.io/projected/a22b5186-8c8a-485c-852e-456d377e4d86-kube-api-access-8rjtj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.399955 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.399931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.400022 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.399965    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.400057 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.400019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.401778 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.401757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a22b5186-8c8a-485c-852e-456d377e4d86-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.401884 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.401869    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a22b5186-8c8a-485c-852e-456d377e4d86-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.409054 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.409030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rjtj\" (UniqueName: \"kubernetes.io/projected/a22b5186-8c8a-485c-852e-456d377e4d86-kube-api-access-8rjtj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9m6h\" (UID: \"a22b5186-8c8a-485c-852e-456d377e4d86\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.508234 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.508164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:32.779968 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.779946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"]
Sep 10 20:49:32.781882 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:49:32.781856    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22b5186_8c8a_485c_852e_456d377e4d86.slice/crio-fd38a798e0904587607114bc6dcb8c97e17f724b23006a40aa48a12b6370c755 WatchSource:0}: Error finding container fd38a798e0904587607114bc6dcb8c97e17f724b23006a40aa48a12b6370c755: Status 404 returned error can't find the container with id fd38a798e0904587607114bc6dcb8c97e17f724b23006a40aa48a12b6370c755
Sep 10 20:49:32.783142 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:32.783124    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 20:49:33.709944 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:33.709907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h" event={"ID":"a22b5186-8c8a-485c-852e-456d377e4d86","Type":"ContainerStarted","Data":"fd38a798e0904587607114bc6dcb8c97e17f724b23006a40aa48a12b6370c755"}
Sep 10 20:49:34.716699 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:34.716658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h" event={"ID":"a22b5186-8c8a-485c-852e-456d377e4d86","Type":"ContainerStarted","Data":"70fb506a28b036babfcb8d7a9364b8f07b7ad57e514355c3b2fd1ec31160d2e5"}
Sep 10 20:49:34.741169 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:34.741119    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h" podStartSLOduration=1.745450725 podStartE2EDuration="2.741105212s" totalImagesPullingTime="995.654487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:49:34.739464063 +0000 UTC m=+799.776365577" watchObservedRunningTime="2026-09-10 20:49:34.741105212 +0000 UTC m=+799.778006723"
Sep 10 20:49:42.508545 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:42.508444    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:42.508545 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:42.508511    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:42.520871 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:42.520840    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:42.761902 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:42.761822    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9m6h"
Sep 10 20:49:49.822530 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:49:49.822497    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:50:05.700754 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.700715    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"]
Sep 10 20:50:05.707208 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.707185    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.710098 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.710078    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 20:50:05.713821 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.713796    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"]
Sep 10 20:50:05.783877 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.783844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.784020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.783906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/660f449a-d30e-46e5-9dea-657ae07592ef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.784020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.783961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.784020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.783986    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7xdl\" (UniqueName: \"kubernetes.io/projected/660f449a-d30e-46e5-9dea-657ae07592ef-kube-api-access-j7xdl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.784020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.784011    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.784169 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.784075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.796789 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.796749    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:50:05.885282 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.885243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.885481 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.885303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.885481 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.885348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.885481 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.885397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/660f449a-d30e-46e5-9dea-657ae07592ef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.885481 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.885447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.885481 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.885473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7xdl\" (UniqueName: \"kubernetes.io/projected/660f449a-d30e-46e5-9dea-657ae07592ef-kube-api-access-j7xdl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.885784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.885761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.885844 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.885801    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.885908 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.885886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.887713 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.887687    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/660f449a-d30e-46e5-9dea-657ae07592ef-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.888082 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.888065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/660f449a-d30e-46e5-9dea-657ae07592ef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:05.895432 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:05.895412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7xdl\" (UniqueName: \"kubernetes.io/projected/660f449a-d30e-46e5-9dea-657ae07592ef-kube-api-access-j7xdl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6w9qm\" (UID: \"660f449a-d30e-46e5-9dea-657ae07592ef\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:06.018796 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:06.018721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:06.290772 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:06.290745    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"]
Sep 10 20:50:06.292876 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:50:06.292849    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660f449a_d30e_46e5_9dea_657ae07592ef.slice/crio-e2ea220b20e3c18b4eb92749ad1f4460be90007e2ef11eda8af4de096d116b02 WatchSource:0}: Error finding container e2ea220b20e3c18b4eb92749ad1f4460be90007e2ef11eda8af4de096d116b02: Status 404 returned error can't find the container with id e2ea220b20e3c18b4eb92749ad1f4460be90007e2ef11eda8af4de096d116b02
Sep 10 20:50:06.850826 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:06.850742    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm" event={"ID":"660f449a-d30e-46e5-9dea-657ae07592ef","Type":"ContainerStarted","Data":"d7046a9b8f5b914c69f51f77b4673440b67028316cd806a08ab182dab10a2a54"}
Sep 10 20:50:06.851173 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:06.850828    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm" event={"ID":"660f449a-d30e-46e5-9dea-657ae07592ef","Type":"ContainerStarted","Data":"e2ea220b20e3c18b4eb92749ad1f4460be90007e2ef11eda8af4de096d116b02"}
Sep 10 20:50:06.869833 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:06.869782    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm" podStartSLOduration=1.5983070609999999 podStartE2EDuration="1.869764725s" totalImagesPullingTime="271.457664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:50:06.868768149 +0000 UTC m=+831.905669670" watchObservedRunningTime="2026-09-10 20:50:06.869764725 +0000 UTC m=+831.906666238"
Sep 10 20:50:10.729421 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.729388    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:50:10.800385 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.800349    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"]
Sep 10 20:50:10.804004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.803982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:10.806817 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.806791    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 20:50:10.814477 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.814454    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"]
Sep 10 20:50:10.824547 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.824523    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:50:10.929976 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.929937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/425b4f92-481f-44b5-a0ef-0732bbefcee7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:10.930173 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.930012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:10.930173 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.930061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:10.930173 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.930110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mz9s\" (UniqueName: \"kubernetes.io/projected/425b4f92-481f-44b5-a0ef-0732bbefcee7-kube-api-access-8mz9s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:10.930302 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.930184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:10.930302 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:10.930203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.031328 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.031223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.031328 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.031269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.031328 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.031291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/425b4f92-481f-44b5-a0ef-0732bbefcee7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.031611 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.031336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.031611 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.031363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.031611 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.031390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mz9s\" (UniqueName: \"kubernetes.io/projected/425b4f92-481f-44b5-a0ef-0732bbefcee7-kube-api-access-8mz9s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.031807 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.031681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.031807 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.031739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.031878 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.031838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.033785 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.033756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/425b4f92-481f-44b5-a0ef-0732bbefcee7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.033901 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.033878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/425b4f92-481f-44b5-a0ef-0732bbefcee7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.040479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.040452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mz9s\" (UniqueName: \"kubernetes.io/projected/425b4f92-481f-44b5-a0ef-0732bbefcee7-kube-api-access-8mz9s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf\" (UID: \"425b4f92-481f-44b5-a0ef-0732bbefcee7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.115720 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.115670    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:11.387735 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.387709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"]
Sep 10 20:50:11.389245 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:50:11.389224    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425b4f92_481f_44b5_a0ef_0732bbefcee7.slice/crio-faf1fdb9cc940c417584905851266cdd01bd63b27f0952bbf34374efceb5d7d1 WatchSource:0}: Error finding container faf1fdb9cc940c417584905851266cdd01bd63b27f0952bbf34374efceb5d7d1: Status 404 returned error can't find the container with id faf1fdb9cc940c417584905851266cdd01bd63b27f0952bbf34374efceb5d7d1
Sep 10 20:50:11.876677 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.876620    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf" event={"ID":"425b4f92-481f-44b5-a0ef-0732bbefcee7","Type":"ContainerStarted","Data":"dd9c1e2495e887a25ba167a1725d36ad01e8ee104e8465a8696af8f3b5c3ee97"}
Sep 10 20:50:11.877051 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.876692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf" event={"ID":"425b4f92-481f-44b5-a0ef-0732bbefcee7","Type":"ContainerStarted","Data":"faf1fdb9cc940c417584905851266cdd01bd63b27f0952bbf34374efceb5d7d1"}
Sep 10 20:50:11.897920 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:11.897812    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf" podStartSLOduration=1.69895559 podStartE2EDuration="1.897790157s" totalImagesPullingTime="198.834567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:50:11.895434632 +0000 UTC m=+836.932336145" watchObservedRunningTime="2026-09-10 20:50:11.897790157 +0000 UTC m=+836.934691671"
Sep 10 20:50:16.019236 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:16.019202    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:16.019712 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:16.019257    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:16.031623 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:16.031596    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:16.910686 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:16.910650    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6w9qm"
Sep 10 20:50:17.820780 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:17.820746    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:50:21.116187 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:21.116152    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:21.116586 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:21.116452    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:21.129023 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:21.128999    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:21.932179 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:21.932147    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf"
Sep 10 20:50:46.523692 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:50:46.523657    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:51:34.396723 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:51:34.396686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:51:51.260782 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:51:51.260745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:51:52.326623 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:51:52.326586    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:51:52.428876 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:51:52.428846    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:51:53.527048 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:51:53.527015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:51:53.622961 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:51:53.622918    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:16.329423 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:16.329376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:16.428955 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:16.428921    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:16.692573 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:16.692528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:16.792862 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:16.792831    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:17.819020 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:17.818985    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:17.920288 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:17.920259    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:18.343707 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:18.343675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:19.827594 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:19.827552    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:19.928153 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:19.928117    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:20.979906 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:20.979876    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"]
Sep 10 20:52:20.983471 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:20.983447    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:20.987071 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:20.987035    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-80aa25-serving-cert\""
Sep 10 20:52:21.002314 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.002284    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"]
Sep 10 20:52:21.026433 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.026406    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:21.077972 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.077945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.078073 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.078009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gwb7\" (UniqueName: \"kubernetes.io/projected/6b648fc7-38fa-4fea-957f-885f381ee0e9-kube-api-access-7gwb7\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.078147 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.078126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b648fc7-38fa-4fea-957f-885f381ee0e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.078190 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.078158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-metrics-certs\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.105538 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.105510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:21.178853 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.178818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b648fc7-38fa-4fea-957f-885f381ee0e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.178853 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.178851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-metrics-certs\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.179033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.178889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.179033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.178936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gwb7\" (UniqueName: \"kubernetes.io/projected/6b648fc7-38fa-4fea-957f-885f381ee0e9-kube-api-access-7gwb7\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.179142 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:52:21.179030    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-serving-cert: secret "maas-api-e2e-inf-a-80aa25-serving-cert" not found
Sep 10 20:52:21.179142 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:52:21.179102    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-maas-api-tls podName:6b648fc7-38fa-4fea-957f-885f381ee0e9 nodeName:}" failed. No retries permitted until 2026-09-10 20:52:21.679085237 +0000 UTC m=+966.715986734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-maas-api-tls") pod "maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2" (UID: "6b648fc7-38fa-4fea-957f-885f381ee0e9") : secret "maas-api-e2e-inf-a-80aa25-serving-cert" not found
Sep 10 20:52:21.179615 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.179592    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b648fc7-38fa-4fea-957f-885f381ee0e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.181228 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.181210    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-metrics-certs\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.196989 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.196968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gwb7\" (UniqueName: \"kubernetes.io/projected/6b648fc7-38fa-4fea-957f-885f381ee0e9-kube-api-access-7gwb7\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.241559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.241484    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:21.672919 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.672877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:21.684046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.684021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.686237 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.686219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:21.758056 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.758018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:21.893951 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:21.893916    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:22.167745 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:22.167720    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"]
Sep 10 20:52:22.169985 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:52:22.169952    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b648fc7_38fa_4fea_957f_885f381ee0e9.slice/crio-531b8da9acc68bbefc624b99d7f6f00fac08aaa41f5f5089a324a98fe9288752 WatchSource:0}: Error finding container 531b8da9acc68bbefc624b99d7f6f00fac08aaa41f5f5089a324a98fe9288752: Status 404 returned error can't find the container with id 531b8da9acc68bbefc624b99d7f6f00fac08aaa41f5f5089a324a98fe9288752
Sep 10 20:52:22.447475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:22.447439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2" event={"ID":"6b648fc7-38fa-4fea-957f-885f381ee0e9","Type":"ContainerStarted","Data":"531b8da9acc68bbefc624b99d7f6f00fac08aaa41f5f5089a324a98fe9288752"}
Sep 10 20:52:23.454561 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:23.454528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2" event={"ID":"6b648fc7-38fa-4fea-957f-885f381ee0e9","Type":"ContainerStarted","Data":"cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076"}
Sep 10 20:52:23.455019 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:23.454654    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:23.480397 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:23.480344    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2" podStartSLOduration=2.96153597 podStartE2EDuration="3.480325683s" totalImagesPullingTime="518.789713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:52:23.477403403 +0000 UTC m=+968.514304928" watchObservedRunningTime="2026-09-10 20:52:23.480325683 +0000 UTC m=+968.517227193"
Sep 10 20:52:24.736497 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:24.736461    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:24.794140 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:24.794103    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:24.965778 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:24.965743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:25.274240 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:25.274206    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:25.524884 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:25.524779    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:25.625893 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:25.625848    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:25.727184 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:25.727154    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:25.939788 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:25.939758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:26.091369 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:26.091338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:27.841612 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:27.841574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:27.919429 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:27.919396    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:29.004044 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.004004    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"]
Sep 10 20:52:29.007678 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.007659    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.010648 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.010610    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c62a32a3-serving-cert\""
Sep 10 20:52:29.022793 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.022770    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"]
Sep 10 20:52:29.096468 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.096436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:29.150667 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.150611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6k5r\" (UniqueName: \"kubernetes.io/projected/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-kube-api-access-n6k5r\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.150822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.150680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-maas-api-tls\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.150822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.150706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-openshift-service-ca\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.150822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.150742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-metrics-certs\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.199552 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.199519    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:29.251856 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.251822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6k5r\" (UniqueName: \"kubernetes.io/projected/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-kube-api-access-n6k5r\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.252014 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.251863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-maas-api-tls\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.252014 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.251887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-openshift-service-ca\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.252014 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.251923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-metrics-certs\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.252014 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:52:29.251983    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-serving-cert: secret "maas-api-e2e-ait-c62a32a3-serving-cert" not found
Sep 10 20:52:29.252175 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:52:29.252055    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-maas-api-tls podName:8ce76345-99ba-4aa2-9763-f5d73abd7ff4 nodeName:}" failed. No retries permitted until 2026-09-10 20:52:29.752033788 +0000 UTC m=+974.788935289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-maas-api-tls") pod "maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd" (UID: "8ce76345-99ba-4aa2-9763-f5d73abd7ff4") : secret "maas-api-e2e-ait-c62a32a3-serving-cert" not found
Sep 10 20:52:29.252679 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.252656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-openshift-service-ca\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.254543 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.254484    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-metrics-certs\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.260617 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.260597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6k5r\" (UniqueName: \"kubernetes.io/projected/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-kube-api-access-n6k5r\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.297439 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.297384    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:29.403058 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.403015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:29.465115 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.465090    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:52:29.756763 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.756721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-maas-api-tls\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.759826 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.759798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-maas-api-tls\") pod \"maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.821021 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.820983    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:29.917726 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.917693    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:29.924026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:29.923987    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:30.001645 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.001609    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"]
Sep 10 20:52:30.005178 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.005158    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:30.008390 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.008322    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c62a32a3\""
Sep 10 20:52:30.008500 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.008479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c62a32a3-dockercfg-sj6mk\""
Sep 10 20:52:30.017490 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.017468    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"]
Sep 10 20:52:30.059927 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.059887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf\" (UID: \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:30.060111 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.059990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk9pv\" (UniqueName: \"kubernetes.io/projected/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-kube-api-access-tk9pv\") pod \"payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf\" (UID: \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:30.160420 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.160388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk9pv\" (UniqueName: \"kubernetes.io/projected/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-kube-api-access-tk9pv\") pod \"payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf\" (UID: \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:30.160587 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.160458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf\" (UID: \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:30.161162 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.161136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf\" (UID: \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:30.170419 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.170392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk9pv\" (UniqueName: \"kubernetes.io/projected/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-kube-api-access-tk9pv\") pod \"payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf\" (UID: \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:30.195397 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.195358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"]
Sep 10 20:52:30.197619 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:52:30.197590    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce76345_99ba_4aa2_9763_f5d73abd7ff4.slice/crio-ccb8adc47b229f740f33913e3bbcc8149e457cb5a1997494fe723b9abdc5275c WatchSource:0}: Error finding container ccb8adc47b229f740f33913e3bbcc8149e457cb5a1997494fe723b9abdc5275c: Status 404 returned error can't find the container with id ccb8adc47b229f740f33913e3bbcc8149e457cb5a1997494fe723b9abdc5275c
Sep 10 20:52:30.319704 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.319613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:30.490078 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.490048    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd" event={"ID":"8ce76345-99ba-4aa2-9763-f5d73abd7ff4","Type":"ContainerStarted","Data":"ccb8adc47b229f740f33913e3bbcc8149e457cb5a1997494fe723b9abdc5275c"}
Sep 10 20:52:30.596550 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.596522    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"]
Sep 10 20:52:30.600054 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:52:30.600027    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa02cab_bbfe_40ee_bd52_e21b8fb855b1.slice/crio-61284de7a962728032096cfd23d2b7f8ce1a119c5635c046b590c38ef6b688fa WatchSource:0}: Error finding container 61284de7a962728032096cfd23d2b7f8ce1a119c5635c046b590c38ef6b688fa: Status 404 returned error can't find the container with id 61284de7a962728032096cfd23d2b7f8ce1a119c5635c046b590c38ef6b688fa
Sep 10 20:52:30.865886 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.865804    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"]
Sep 10 20:52:30.869870 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.869850    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:30.872524 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.872506    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-5d9b44-serving-cert\""
Sep 10 20:52:30.880765 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.880738    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"]
Sep 10 20:52:30.904119 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.904088    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:30.966246 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.966210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-metrics-certs\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:30.966412 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.966259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99999755-2887-4643-9897-a2653c6e3553-openshift-service-ca\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:30.966412 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.966322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-maas-api-tls\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:30.966512 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:30.966428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljdk4\" (UniqueName: \"kubernetes.io/projected/99999755-2887-4643-9897-a2653c6e3553-kube-api-access-ljdk4\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.005281 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.005256    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:31.067340 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.067312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljdk4\" (UniqueName: \"kubernetes.io/projected/99999755-2887-4643-9897-a2653c6e3553-kube-api-access-ljdk4\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.067495 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.067369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-metrics-certs\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.067495 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.067397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99999755-2887-4643-9897-a2653c6e3553-openshift-service-ca\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.067495 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.067424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-maas-api-tls\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.067714 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:52:31.067520    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-serving-cert: secret "maas-api-e2e-autores-5d9b44-serving-cert" not found
Sep 10 20:52:31.067714 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:52:31.067569    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-maas-api-tls podName:99999755-2887-4643-9897-a2653c6e3553 nodeName:}" failed. No retries permitted until 2026-09-10 20:52:31.567554041 +0000 UTC m=+976.604455532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-maas-api-tls") pod "maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb" (UID: "99999755-2887-4643-9897-a2653c6e3553") : secret "maas-api-e2e-autores-5d9b44-serving-cert" not found
Sep 10 20:52:31.068149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.068124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99999755-2887-4643-9897-a2653c6e3553-openshift-service-ca\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.069642 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.069616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-metrics-certs\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.076215 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.076198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljdk4\" (UniqueName: \"kubernetes.io/projected/99999755-2887-4643-9897-a2653c6e3553-kube-api-access-ljdk4\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.240804 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.240747    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:31.407072 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.407038    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:31.498595 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.498498    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd" event={"ID":"8ce76345-99ba-4aa2-9763-f5d73abd7ff4","Type":"ContainerStarted","Data":"de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4"}
Sep 10 20:52:31.498784 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.498760    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:31.500863 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.500800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf" event={"ID":"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1","Type":"ContainerStarted","Data":"61284de7a962728032096cfd23d2b7f8ce1a119c5635c046b590c38ef6b688fa"}
Sep 10 20:52:31.515974 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.515947    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:31.520645 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.520590    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd" podStartSLOduration=3.130196889 podStartE2EDuration="3.520575849s" totalImagesPullingTime="390.37896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:52:31.519045997 +0000 UTC m=+976.555947511" watchObservedRunningTime="2026-09-10 20:52:31.520575849 +0000 UTC m=+976.557477362"
Sep 10 20:52:31.572269 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.572235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-maas-api-tls\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.575963 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.575939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-maas-api-tls\") pod \"maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:31.782251 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:31.782163    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:32.063423 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:32.063387    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"]
Sep 10 20:52:32.833753 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:52:32.833712    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99999755_2887_4643_9897_a2653c6e3553.slice/crio-f87d393d5a2a6c1ba7221dcd0822cf336ad77e70a03fd3cdf6a7d51fd11bbee2 WatchSource:0}: Error finding container f87d393d5a2a6c1ba7221dcd0822cf336ad77e70a03fd3cdf6a7d51fd11bbee2: Status 404 returned error can't find the container with id f87d393d5a2a6c1ba7221dcd0822cf336ad77e70a03fd3cdf6a7d51fd11bbee2
Sep 10 20:52:33.517557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:33.517457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb" event={"ID":"99999755-2887-4643-9897-a2653c6e3553","Type":"ContainerStarted","Data":"5d5d5181c6586711e2ca808358d867063092d6e8799f4855d217b6d3afce19b7"}
Sep 10 20:52:33.518026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:33.517555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb" event={"ID":"99999755-2887-4643-9897-a2653c6e3553","Type":"ContainerStarted","Data":"f87d393d5a2a6c1ba7221dcd0822cf336ad77e70a03fd3cdf6a7d51fd11bbee2"}
Sep 10 20:52:33.518026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:33.517591    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:33.519087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:33.519063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf" event={"ID":"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1","Type":"ContainerStarted","Data":"d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049"}
Sep 10 20:52:33.519200 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:33.519187    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:33.539486 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:33.539432    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb" podStartSLOduration=3.222361836 podStartE2EDuration="3.539412978s" totalImagesPullingTime="317.051142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:52:33.535675123 +0000 UTC m=+978.572576637" watchObservedRunningTime="2026-09-10 20:52:33.539412978 +0000 UTC m=+978.576314486"
Sep 10 20:52:33.554618 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:33.554568    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf" podStartSLOduration=2.274110711 podStartE2EDuration="4.554553238s" totalImagesPullingTime="2.280442527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:52:33.552875302 +0000 UTC m=+978.589776818" watchObservedRunningTime="2026-09-10 20:52:33.554553238 +0000 UTC m=+978.591454750"
Sep 10 20:52:37.349446 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:37.349413    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:37.510437 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:37.510413    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:52:37.525958 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:37.525916    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:37.615985 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:37.615893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:37.713044 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:37.713016    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:39.529026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:39.528994    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:52:40.560488 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:40.560438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:41.917861 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:41.917830    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:42.017162 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:42.017134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:42.200916 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:42.200829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:42.684039 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:42.684010    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:42.809339 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:42.809308    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:43.137397 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:43.137314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:44.525814 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:44.525782    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:52:44.862515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:44.862433    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:45.219331 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:45.219296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:45.542777 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:45.542683    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:45.796421 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:45.796298    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:48.623009 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:48.622968    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:48.722059 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:48.722025    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:49.172699 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.172655    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:49.276400 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.276362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:49.374915 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.374877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:49.547799 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.547719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:49.780653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.780602    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"]
Sep 10 20:52:49.786511 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.786487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:49.789719 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.789606    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-467fc3-serving-cert\""
Sep 10 20:52:49.799262 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.799203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"]
Sep 10 20:52:49.821997 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.821963    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:49.878515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.878471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:49.943617 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.943582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-maas-api-tls\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:49.943617 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.943614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-metrics-certs\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:49.943900 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.943727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5ck\" (UniqueName: \"kubernetes.io/projected/ef77290d-42fd-410f-9149-fa922334a7b2-kube-api-access-4w5ck\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:49.943900 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:49.943815    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77290d-42fd-410f-9149-fa922334a7b2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.044861 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.044827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-maas-api-tls\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.044861 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.044858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-metrics-certs\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.045110 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.044896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5ck\" (UniqueName: \"kubernetes.io/projected/ef77290d-42fd-410f-9149-fa922334a7b2-kube-api-access-4w5ck\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.045110 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.044959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77290d-42fd-410f-9149-fa922334a7b2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.045110 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:52:50.044981    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-serving-cert: secret "maas-api-e2e-inf-b-467fc3-serving-cert" not found
Sep 10 20:52:50.045110 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:52:50.045048    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-maas-api-tls podName:ef77290d-42fd-410f-9149-fa922334a7b2 nodeName:}" failed. No retries permitted until 2026-09-10 20:52:50.545030753 +0000 UTC m=+995.581932244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-maas-api-tls") pod "maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n" (UID: "ef77290d-42fd-410f-9149-fa922334a7b2") : secret "maas-api-e2e-inf-b-467fc3-serving-cert" not found
Sep 10 20:52:50.045661 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.045643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77290d-42fd-410f-9149-fa922334a7b2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.047300 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.047275    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-metrics-certs\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.054357 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.054302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5ck\" (UniqueName: \"kubernetes.io/projected/ef77290d-42fd-410f-9149-fa922334a7b2-kube-api-access-4w5ck\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.224561 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.224520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:50.326483 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.326394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:50.430330 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.430297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:50.434839 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.434813    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"]
Sep 10 20:52:50.438766 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.438748    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:52:50.468637 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.468601    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-467fc3-dockercfg-ghjmr\""
Sep 10 20:52:50.468814 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.468722    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-467fc3\""
Sep 10 20:52:50.469960 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.469936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"]
Sep 10 20:52:50.550831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.550797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-maas-api-tls\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.551000 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.550851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/268b41a8-e723-4fa2-a176-cd7abf86a74c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt\" (UID: \"268b41a8-e723-4fa2-a176-cd7abf86a74c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:52:50.551000 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.550923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwt74\" (UniqueName: \"kubernetes.io/projected/268b41a8-e723-4fa2-a176-cd7abf86a74c-kube-api-access-dwt74\") pod \"payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt\" (UID: \"268b41a8-e723-4fa2-a176-cd7abf86a74c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:52:50.553332 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.553294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-maas-api-tls\") pod \"maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.651597 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.651562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwt74\" (UniqueName: \"kubernetes.io/projected/268b41a8-e723-4fa2-a176-cd7abf86a74c-kube-api-access-dwt74\") pod \"payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt\" (UID: \"268b41a8-e723-4fa2-a176-cd7abf86a74c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:52:50.651816 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.651717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/268b41a8-e723-4fa2-a176-cd7abf86a74c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt\" (UID: \"268b41a8-e723-4fa2-a176-cd7abf86a74c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:52:50.652487 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.652465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/268b41a8-e723-4fa2-a176-cd7abf86a74c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt\" (UID: \"268b41a8-e723-4fa2-a176-cd7abf86a74c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:52:50.661045 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.661019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwt74\" (UniqueName: \"kubernetes.io/projected/268b41a8-e723-4fa2-a176-cd7abf86a74c-kube-api-access-dwt74\") pod \"payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt\" (UID: \"268b41a8-e723-4fa2-a176-cd7abf86a74c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:52:50.698539 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.698493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:50.749885 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.749841    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:52:50.979046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.979019    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"]
Sep 10 20:52:50.981581 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:52:50.981549    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef77290d_42fd_410f_9149_fa922334a7b2.slice/crio-084e69c520b82ba5f818de716753198f031745ca31d5e9be6b2759a5aa3f0cc6 WatchSource:0}: Error finding container 084e69c520b82ba5f818de716753198f031745ca31d5e9be6b2759a5aa3f0cc6: Status 404 returned error can't find the container with id 084e69c520b82ba5f818de716753198f031745ca31d5e9be6b2759a5aa3f0cc6
Sep 10 20:52:50.982941 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:50.982917    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:51.037444 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.037420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"]
Sep 10 20:52:51.039334 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:52:51.039296    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268b41a8_e723_4fa2_a176_cd7abf86a74c.slice/crio-5b3c0ac40ed15715b588efae5019ac219e630b5e36780f7965f24cc04525e94d WatchSource:0}: Error finding container 5b3c0ac40ed15715b588efae5019ac219e630b5e36780f7965f24cc04525e94d: Status 404 returned error can't find the container with id 5b3c0ac40ed15715b588efae5019ac219e630b5e36780f7965f24cc04525e94d
Sep 10 20:52:51.605313 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.605275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt" event={"ID":"268b41a8-e723-4fa2-a176-cd7abf86a74c","Type":"ContainerStarted","Data":"021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71"}
Sep 10 20:52:51.605515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.605338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt" event={"ID":"268b41a8-e723-4fa2-a176-cd7abf86a74c","Type":"ContainerStarted","Data":"5b3c0ac40ed15715b588efae5019ac219e630b5e36780f7965f24cc04525e94d"}
Sep 10 20:52:51.605515 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.605419    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:52:51.607084 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.607053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n" event={"ID":"ef77290d-42fd-410f-9149-fa922334a7b2","Type":"ContainerStarted","Data":"85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71"}
Sep 10 20:52:51.607203 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.607099    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n" event={"ID":"ef77290d-42fd-410f-9149-fa922334a7b2","Type":"ContainerStarted","Data":"084e69c520b82ba5f818de716753198f031745ca31d5e9be6b2759a5aa3f0cc6"}
Sep 10 20:52:51.607203 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.607128    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:51.626583 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.626500    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt" podStartSLOduration=1.6264796480000001 podStartE2EDuration="1.626479648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:52:51.623394267 +0000 UTC m=+996.660295794" watchObservedRunningTime="2026-09-10 20:52:51.626479648 +0000 UTC m=+996.663381162"
Sep 10 20:52:51.643545 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.643483    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n" podStartSLOduration=2.155836824 podStartE2EDuration="2.643463159s" totalImagesPullingTime="487.626335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:52:51.641362437 +0000 UTC m=+996.678263952" watchObservedRunningTime="2026-09-10 20:52:51.643463159 +0000 UTC m=+996.680364669"
Sep 10 20:52:51.750576 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:51.750494    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:52.600666 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:52.600594    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:53.403097 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:53.403062    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:53.679561 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:53.679476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:53.779938 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:53.779907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:54.241947 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:54.241908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:55.123797 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:55.123743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:56.203397 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:56.203354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:56.261687 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:56.261658    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:56.715451 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:56.715417    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:56.816366 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:56.816332    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:52:57.617048 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:57.617018    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:52:58.988459 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:52:58.988426    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:02.614052 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:02.614016    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:53:09.229771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:09.229737    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:10.050964 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.050926    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"]
Sep 10 20:53:10.051210 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.051184    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd" podUID="8ce76345-99ba-4aa2-9763-f5d73abd7ff4" containerName="maas-api" containerID="cri-o://de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4" gracePeriod=30
Sep 10 20:53:10.111351 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.111311    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"]
Sep 10 20:53:10.111599 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.111569    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf" podUID="1fa02cab-bbfe-40ee-bd52-e21b8fb855b1" containerName="payload-pre-processing" containerID="cri-o://d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049" gracePeriod=30
Sep 10 20:53:10.113591 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.113558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:10.209841 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.209795    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:10.294678 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.294531    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:10.350680 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.350652    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:10.367760 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.367736    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:53:10.427479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.427042    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-maas-api-tls\") pod \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") "
Sep 10 20:53:10.427479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.427126    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-openshift-service-ca\") pod \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") "
Sep 10 20:53:10.427479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.427193    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6k5r\" (UniqueName: \"kubernetes.io/projected/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-kube-api-access-n6k5r\") pod \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") "
Sep 10 20:53:10.427479 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.427298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-metrics-certs\") pod \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\" (UID: \"8ce76345-99ba-4aa2-9763-f5d73abd7ff4\") "
Sep 10 20:53:10.427879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.427792    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ce76345-99ba-4aa2-9763-f5d73abd7ff4" (UID: "8ce76345-99ba-4aa2-9763-f5d73abd7ff4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:53:10.435337 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.432587    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-kube-api-access-n6k5r" (OuterVolumeSpecName: "kube-api-access-n6k5r") pod "8ce76345-99ba-4aa2-9763-f5d73abd7ff4" (UID: "8ce76345-99ba-4aa2-9763-f5d73abd7ff4"). InnerVolumeSpecName "kube-api-access-n6k5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:53:10.435337 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.432999    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8ce76345-99ba-4aa2-9763-f5d73abd7ff4" (UID: "8ce76345-99ba-4aa2-9763-f5d73abd7ff4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:53:10.436999 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.436973    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:53:10.437780 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.437752    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ce76345-99ba-4aa2-9763-f5d73abd7ff4" (UID: "8ce76345-99ba-4aa2-9763-f5d73abd7ff4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:53:10.452756 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.452723    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:10.528840 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.528809    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-plugins-config-volume\") pod \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\" (UID: \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\") "
Sep 10 20:53:10.529016 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.528859    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk9pv\" (UniqueName: \"kubernetes.io/projected/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-kube-api-access-tk9pv\") pod \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\" (UID: \"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1\") "
Sep 10 20:53:10.529159 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.529139    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6k5r\" (UniqueName: \"kubernetes.io/projected/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-kube-api-access-n6k5r\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:10.529198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.529167    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:10.529198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.529182    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:10.529198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.529195    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce76345-99ba-4aa2-9763-f5d73abd7ff4-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:10.529291 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.529216    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fa02cab-bbfe-40ee-bd52-e21b8fb855b1" (UID: "1fa02cab-bbfe-40ee-bd52-e21b8fb855b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:53:10.531033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.531002    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-kube-api-access-tk9pv" (OuterVolumeSpecName: "kube-api-access-tk9pv") pod "1fa02cab-bbfe-40ee-bd52-e21b8fb855b1" (UID: "1fa02cab-bbfe-40ee-bd52-e21b8fb855b1"). InnerVolumeSpecName "kube-api-access-tk9pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:53:10.630915 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.630828    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:10.630915 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.630876    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk9pv\" (UniqueName: \"kubernetes.io/projected/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1-kube-api-access-tk9pv\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:10.699571 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.699534    2579 generic.go:356] "Generic (PLEG): container finished" podID="8ce76345-99ba-4aa2-9763-f5d73abd7ff4" containerID="de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4" exitCode=0
Sep 10 20:53:10.699771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.699592    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"
Sep 10 20:53:10.699771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.699613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd" event={"ID":"8ce76345-99ba-4aa2-9763-f5d73abd7ff4","Type":"ContainerDied","Data":"de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4"}
Sep 10 20:53:10.699771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.699703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd" event={"ID":"8ce76345-99ba-4aa2-9763-f5d73abd7ff4","Type":"ContainerDied","Data":"ccb8adc47b229f740f33913e3bbcc8149e457cb5a1997494fe723b9abdc5275c"}
Sep 10 20:53:10.699771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.699737    2579 scope.go:117] "RemoveContainer" containerID="de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4"
Sep 10 20:53:10.701108 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.701077    2579 generic.go:356] "Generic (PLEG): container finished" podID="1fa02cab-bbfe-40ee-bd52-e21b8fb855b1" containerID="d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049" exitCode=0
Sep 10 20:53:10.701246 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.701127    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"
Sep 10 20:53:10.701246 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.701141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf" event={"ID":"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1","Type":"ContainerDied","Data":"d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049"}
Sep 10 20:53:10.701246 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.701183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf" event={"ID":"1fa02cab-bbfe-40ee-bd52-e21b8fb855b1","Type":"ContainerDied","Data":"61284de7a962728032096cfd23d2b7f8ce1a119c5635c046b590c38ef6b688fa"}
Sep 10 20:53:10.710419 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.710405    2579 scope.go:117] "RemoveContainer" containerID="de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4"
Sep 10 20:53:10.710721 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:53:10.710695    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4\": container with ID starting with de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4 not found: ID does not exist" containerID="de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4"
Sep 10 20:53:10.710833 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.710729    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4"} err="failed to get container status \"de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4\": rpc error: code = NotFound desc = could not find container \"de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4\": container with ID starting with de1838bfe35be65d551f7f4ff6263e15753b956a9bcc07e6d8f1738b7bc5dcf4 not found: ID does not exist"
Sep 10 20:53:10.710833 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.710751    2579 scope.go:117] "RemoveContainer" containerID="d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049"
Sep 10 20:53:10.718990 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.718969    2579 scope.go:117] "RemoveContainer" containerID="d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049"
Sep 10 20:53:10.719292 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:53:10.719273    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049\": container with ID starting with d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049 not found: ID does not exist" containerID="d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049"
Sep 10 20:53:10.719349 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.719299    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049"} err="failed to get container status \"d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049\": rpc error: code = NotFound desc = could not find container \"d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049\": container with ID starting with d7a09467b36cef244f959f2b03890ec5a942ecb16d7d76c35f9123b382a11049 not found: ID does not exist"
Sep 10 20:53:10.727476 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.727452    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"]
Sep 10 20:53:10.733670 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.733648    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf"]
Sep 10 20:53:10.746112 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.746084    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"]
Sep 10 20:53:10.751478 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.751452    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c62a32a3-66f4654f44-mfqnd"]
Sep 10 20:53:10.883829 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.883743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:10.980417 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:10.980380    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:11.093831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:11.093800    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:11.185617 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:11.185587    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:11.419904 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:11.419867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:11.479831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:11.479750    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:11.487443 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:11.487417    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa02cab-bbfe-40ee-bd52-e21b8fb855b1" path="/var/lib/kubelet/pods/1fa02cab-bbfe-40ee-bd52-e21b8fb855b1/volumes"
Sep 10 20:53:11.487877 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:11.487861    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce76345-99ba-4aa2-9763-f5d73abd7ff4" path="/var/lib/kubelet/pods/8ce76345-99ba-4aa2-9763-f5d73abd7ff4/volumes"
Sep 10 20:53:13.611446 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.611411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:13.711593 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.711557    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:13.789377 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.789341    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"]
Sep 10 20:53:13.789953 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.789931    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce76345-99ba-4aa2-9763-f5d73abd7ff4" containerName="maas-api"
Sep 10 20:53:13.789953 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.789953    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce76345-99ba-4aa2-9763-f5d73abd7ff4" containerName="maas-api"
Sep 10 20:53:13.790119 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.789972    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa02cab-bbfe-40ee-bd52-e21b8fb855b1" containerName="payload-pre-processing"
Sep 10 20:53:13.790119 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.789981    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa02cab-bbfe-40ee-bd52-e21b8fb855b1" containerName="payload-pre-processing"
Sep 10 20:53:13.790119 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.790090    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce76345-99ba-4aa2-9763-f5d73abd7ff4" containerName="maas-api"
Sep 10 20:53:13.790119 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.790103    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa02cab-bbfe-40ee-bd52-e21b8fb855b1" containerName="payload-pre-processing"
Sep 10 20:53:13.793030 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.793002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:13.793618 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.793604    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.796443 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.796420    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-090c5b75-serving-cert\""
Sep 10 20:53:13.803481 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.803458    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"]
Sep 10 20:53:13.846789 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.846750    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:13.861970 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.861887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/524b7921-f94f-418e-bd3a-a254e473db87-openshift-service-ca\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.862122 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.862008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-maas-api-tls\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.862122 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.862038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trgbd\" (UniqueName: \"kubernetes.io/projected/524b7921-f94f-418e-bd3a-a254e473db87-kube-api-access-trgbd\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.862122 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.862079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-metrics-certs\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.963556 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.963518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-maas-api-tls\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.963556 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.963554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trgbd\" (UniqueName: \"kubernetes.io/projected/524b7921-f94f-418e-bd3a-a254e473db87-kube-api-access-trgbd\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.963846 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.963616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-metrics-certs\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.963846 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:53:13.963713    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-serving-cert: secret "maas-api-e2e-migrate-090c5b75-serving-cert" not found
Sep 10 20:53:13.963846 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.963739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/524b7921-f94f-418e-bd3a-a254e473db87-openshift-service-ca\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.963846 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:53:13.963782    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-maas-api-tls podName:524b7921-f94f-418e-bd3a-a254e473db87 nodeName:}" failed. No retries permitted until 2026-09-10 20:53:14.463761777 +0000 UTC m=+1019.500663269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-maas-api-tls") pod "maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg" (UID: "524b7921-f94f-418e-bd3a-a254e473db87") : secret "maas-api-e2e-migrate-090c5b75-serving-cert" not found
Sep 10 20:53:13.964316 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.964299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/524b7921-f94f-418e-bd3a-a254e473db87-openshift-service-ca\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.965910 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.965889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-metrics-certs\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:13.972813 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:13.972783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trgbd\" (UniqueName: \"kubernetes.io/projected/524b7921-f94f-418e-bd3a-a254e473db87-kube-api-access-trgbd\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:14.130702 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.130594    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:14.333242 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.333207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:14.401778 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.401745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:14.449728 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.449688    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"]
Sep 10 20:53:14.453059 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.453040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:14.456072 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.456053    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-090c5b75\""
Sep 10 20:53:14.456194 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.456080    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-090c5b75-dockercfg-qnvpd\""
Sep 10 20:53:14.464714 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.464692    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"]
Sep 10 20:53:14.469654 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.469614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-maas-api-tls\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:14.471951 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.471929    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-maas-api-tls\") pod \"maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:14.482057 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.482032    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"]
Sep 10 20:53:14.485426 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.485406    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:14.493218 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.493194    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"]
Sep 10 20:53:14.570848 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.570817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6\" (UID: \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:14.571046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.570892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-plugins-config-volume\") pod \"payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp\" (UID: \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\") " pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:14.571046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.570977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j67f8\" (UniqueName: \"kubernetes.io/projected/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-kube-api-access-j67f8\") pod \"payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6\" (UID: \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:14.571046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.571041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8n2p\" (UniqueName: \"kubernetes.io/projected/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-kube-api-access-t8n2p\") pod \"payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp\" (UID: \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\") " pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:14.672088 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.672007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6\" (UID: \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:14.672088 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.672054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-plugins-config-volume\") pod \"payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp\" (UID: \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\") " pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:14.672483 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.672190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67f8\" (UniqueName: \"kubernetes.io/projected/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-kube-api-access-j67f8\") pod \"payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6\" (UID: \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:14.672483 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.672273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8n2p\" (UniqueName: \"kubernetes.io/projected/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-kube-api-access-t8n2p\") pod \"payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp\" (UID: \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\") " pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:14.672724 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.672706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6\" (UID: \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:14.672767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.672755    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-plugins-config-volume\") pod \"payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp\" (UID: \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\") " pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:14.680848 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.680828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j67f8\" (UniqueName: \"kubernetes.io/projected/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-kube-api-access-j67f8\") pod \"payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6\" (UID: \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:14.681264 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.681241    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8n2p\" (UniqueName: \"kubernetes.io/projected/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-kube-api-access-t8n2p\") pod \"payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp\" (UID: \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\") " pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:14.705967 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.705938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:14.765464 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.765222    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:14.796930 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.796902    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:14.980195 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:14.980151    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"]
Sep 10 20:53:14.982764 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:53:14.982734    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524b7921_f94f_418e_bd3a_a254e473db87.slice/crio-0b653dee21bd7a11d7165257a9886d58dca3e5c028a1e32b83ad5d239323098b WatchSource:0}: Error finding container 0b653dee21bd7a11d7165257a9886d58dca3e5c028a1e32b83ad5d239323098b: Status 404 returned error can't find the container with id 0b653dee21bd7a11d7165257a9886d58dca3e5c028a1e32b83ad5d239323098b
Sep 10 20:53:15.060174 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.056205    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"]
Sep 10 20:53:15.063480 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:53:15.063445    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1e7bd7_2d0f_4faa_aed4_8b0f904801fb.slice/crio-efe8375dfd52ed6ff9d6ce7ad33e5493de29bc7b2a3a9a903254492b25d9b517 WatchSource:0}: Error finding container efe8375dfd52ed6ff9d6ce7ad33e5493de29bc7b2a3a9a903254492b25d9b517: Status 404 returned error can't find the container with id efe8375dfd52ed6ff9d6ce7ad33e5493de29bc7b2a3a9a903254492b25d9b517
Sep 10 20:53:15.079157 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.079132    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"]
Sep 10 20:53:15.082001 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:53:15.081977    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5cf5af2_0ae3_4f28_ae6c_b9397ff3ec96.slice/crio-59e30043dd1d22dd159d2b054c4073fcaac4a63e09368340e953efde82c917d0 WatchSource:0}: Error finding container 59e30043dd1d22dd159d2b054c4073fcaac4a63e09368340e953efde82c917d0: Status 404 returned error can't find the container with id 59e30043dd1d22dd159d2b054c4073fcaac4a63e09368340e953efde82c917d0
Sep 10 20:53:15.727548 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.727492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp" event={"ID":"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96","Type":"ContainerStarted","Data":"f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87"}
Sep 10 20:53:15.728077 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.727657    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:15.728077 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.727716    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp" event={"ID":"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96","Type":"ContainerStarted","Data":"59e30043dd1d22dd159d2b054c4073fcaac4a63e09368340e953efde82c917d0"}
Sep 10 20:53:15.729253 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.729230    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6" event={"ID":"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb","Type":"ContainerStarted","Data":"a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27"}
Sep 10 20:53:15.729399 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.729274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6" event={"ID":"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb","Type":"ContainerStarted","Data":"efe8375dfd52ed6ff9d6ce7ad33e5493de29bc7b2a3a9a903254492b25d9b517"}
Sep 10 20:53:15.729399 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.729350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:15.730874 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.730852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg" event={"ID":"524b7921-f94f-418e-bd3a-a254e473db87","Type":"ContainerStarted","Data":"567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f"}
Sep 10 20:53:15.730950 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.730888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg" event={"ID":"524b7921-f94f-418e-bd3a-a254e473db87","Type":"ContainerStarted","Data":"0b653dee21bd7a11d7165257a9886d58dca3e5c028a1e32b83ad5d239323098b"}
Sep 10 20:53:15.731010 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.730997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:15.746456 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.746402    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp" podStartSLOduration=1.746385421 podStartE2EDuration="1.746385421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:53:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:53:15.745821631 +0000 UTC m=+1020.782723137" watchObservedRunningTime="2026-09-10 20:53:15.746385421 +0000 UTC m=+1020.783286939"
Sep 10 20:53:15.767382 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.767333    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg" podStartSLOduration=2.442677584 podStartE2EDuration="2.767317181s" totalImagesPullingTime="324.639597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:53:15.765013905 +0000 UTC m=+1020.801915421" watchObservedRunningTime="2026-09-10 20:53:15.767317181 +0000 UTC m=+1020.804218694"
Sep 10 20:53:15.784369 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:15.784320    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6" podStartSLOduration=1.78430278 podStartE2EDuration="1.78430278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:53:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:53:15.783276959 +0000 UTC m=+1020.820178474" watchObservedRunningTime="2026-09-10 20:53:15.78430278 +0000 UTC m=+1020.821204495"
Sep 10 20:53:21.741448 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:21.741420    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:26.736826 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:26.736794    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:26.737280 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:26.737046    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:44.470887 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.470595    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"]
Sep 10 20:53:44.471520 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.471485    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg" podUID="524b7921-f94f-418e-bd3a-a254e473db87" containerName="maas-api" containerID="cri-o://567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f" gracePeriod=30
Sep 10 20:53:44.498925 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.498891    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:44.529849 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.529822    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"]
Sep 10 20:53:44.530044 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.530019    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp" podUID="f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96" containerName="payload-processing" containerID="cri-o://f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87" gracePeriod=30
Sep 10 20:53:44.537205 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.537178    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"]
Sep 10 20:53:44.537439 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.537406    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6" podUID="cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb" containerName="payload-pre-processing" containerID="cri-o://a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27" gracePeriod=30
Sep 10 20:53:44.599547 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.599493    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:44.704524 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.704454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:44.789882 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.789718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:44.818819 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.818521    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:44.836818 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.836794    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:44.841522 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.841501    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:44.864549 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.864073    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-plugins-config-volume\") pod \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\" (UID: \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\") "
Sep 10 20:53:44.864549 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.864153    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8n2p\" (UniqueName: \"kubernetes.io/projected/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-kube-api-access-t8n2p\") pod \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\" (UID: \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\") "
Sep 10 20:53:44.864822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.864690    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb" (UID: "cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:53:44.864822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.864781    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j67f8\" (UniqueName: \"kubernetes.io/projected/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-kube-api-access-j67f8\") pod \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\" (UID: \"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb\") "
Sep 10 20:53:44.864978 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.864862    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-maas-api-tls\") pod \"524b7921-f94f-418e-bd3a-a254e473db87\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") "
Sep 10 20:53:44.864978 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.864929    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trgbd\" (UniqueName: \"kubernetes.io/projected/524b7921-f94f-418e-bd3a-a254e473db87-kube-api-access-trgbd\") pod \"524b7921-f94f-418e-bd3a-a254e473db87\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") "
Sep 10 20:53:44.864978 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.864952    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-metrics-certs\") pod \"524b7921-f94f-418e-bd3a-a254e473db87\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") "
Sep 10 20:53:44.865135 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.864979    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/524b7921-f94f-418e-bd3a-a254e473db87-openshift-service-ca\") pod \"524b7921-f94f-418e-bd3a-a254e473db87\" (UID: \"524b7921-f94f-418e-bd3a-a254e473db87\") "
Sep 10 20:53:44.865135 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.865029    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-plugins-config-volume\") pod \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\" (UID: \"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96\") "
Sep 10 20:53:44.866062 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.865360    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:44.866062 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.865803    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96" (UID: "f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:53:44.867896 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.867673    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/524b7921-f94f-418e-bd3a-a254e473db87-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "524b7921-f94f-418e-bd3a-a254e473db87" (UID: "524b7921-f94f-418e-bd3a-a254e473db87"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:53:44.868031 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.867895    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "524b7921-f94f-418e-bd3a-a254e473db87" (UID: "524b7921-f94f-418e-bd3a-a254e473db87"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:53:44.869682 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.869646    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/524b7921-f94f-418e-bd3a-a254e473db87-kube-api-access-trgbd" (OuterVolumeSpecName: "kube-api-access-trgbd") pod "524b7921-f94f-418e-bd3a-a254e473db87" (UID: "524b7921-f94f-418e-bd3a-a254e473db87"). InnerVolumeSpecName "kube-api-access-trgbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:53:44.869948 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.869922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "524b7921-f94f-418e-bd3a-a254e473db87" (UID: "524b7921-f94f-418e-bd3a-a254e473db87"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:53:44.870777 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.870752    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-kube-api-access-t8n2p" (OuterVolumeSpecName: "kube-api-access-t8n2p") pod "f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96" (UID: "f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96"). InnerVolumeSpecName "kube-api-access-t8n2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:53:44.870939 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.870752    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-kube-api-access-j67f8" (OuterVolumeSpecName: "kube-api-access-j67f8") pod "cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb" (UID: "cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb"). InnerVolumeSpecName "kube-api-access-j67f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:53:44.875412 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.875384    2579 generic.go:356] "Generic (PLEG): container finished" podID="524b7921-f94f-418e-bd3a-a254e473db87" containerID="567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f" exitCode=0
Sep 10 20:53:44.875529 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.875445    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"
Sep 10 20:53:44.875529 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.875501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg" event={"ID":"524b7921-f94f-418e-bd3a-a254e473db87","Type":"ContainerDied","Data":"567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f"}
Sep 10 20:53:44.875662 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.875598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg" event={"ID":"524b7921-f94f-418e-bd3a-a254e473db87","Type":"ContainerDied","Data":"0b653dee21bd7a11d7165257a9886d58dca3e5c028a1e32b83ad5d239323098b"}
Sep 10 20:53:44.875662 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.875653    2579 scope.go:117] "RemoveContainer" containerID="567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f"
Sep 10 20:53:44.880125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.880105    2579 generic.go:356] "Generic (PLEG): container finished" podID="f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96" containerID="f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87" exitCode=0
Sep 10 20:53:44.880427 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.880293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp" event={"ID":"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96","Type":"ContainerDied","Data":"f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87"}
Sep 10 20:53:44.880427 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.880381    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp" event={"ID":"f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96","Type":"ContainerDied","Data":"59e30043dd1d22dd159d2b054c4073fcaac4a63e09368340e953efde82c917d0"}
Sep 10 20:53:44.880743 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.880292    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"
Sep 10 20:53:44.892441 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.891711    2579 generic.go:356] "Generic (PLEG): container finished" podID="cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb" containerID="a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27" exitCode=0
Sep 10 20:53:44.892441 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.891749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6" event={"ID":"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb","Type":"ContainerDied","Data":"a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27"}
Sep 10 20:53:44.892441 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.891790    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6" event={"ID":"cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb","Type":"ContainerDied","Data":"efe8375dfd52ed6ff9d6ce7ad33e5493de29bc7b2a3a9a903254492b25d9b517"}
Sep 10 20:53:44.892441 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.891819    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"
Sep 10 20:53:44.895379 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.895295    2579 scope.go:117] "RemoveContainer" containerID="567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f"
Sep 10 20:53:44.900497 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:53:44.900469    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f\": container with ID starting with 567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f not found: ID does not exist" containerID="567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f"
Sep 10 20:53:44.900608 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.900510    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f"} err="failed to get container status \"567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f\": rpc error: code = NotFound desc = could not find container \"567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f\": container with ID starting with 567140c4516fe5bae7462e646f1c8d884d23b0f50199a8221a3f6af0b7b4d11f not found: ID does not exist"
Sep 10 20:53:44.900608 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.900535    2579 scope.go:117] "RemoveContainer" containerID="f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87"
Sep 10 20:53:44.910755 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.910581    2579 scope.go:117] "RemoveContainer" containerID="f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87"
Sep 10 20:53:44.911234 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:53:44.911194    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87\": container with ID starting with f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87 not found: ID does not exist" containerID="f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87"
Sep 10 20:53:44.911326 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.911245    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87"} err="failed to get container status \"f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87\": rpc error: code = NotFound desc = could not find container \"f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87\": container with ID starting with f6c1a52e25fdc531efbd6e936e781cc5a905d75a035210a58d6994e937475f87 not found: ID does not exist"
Sep 10 20:53:44.911326 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.911270    2579 scope.go:117] "RemoveContainer" containerID="a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27"
Sep 10 20:53:44.912912 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.912891    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"]
Sep 10 20:53:44.917858 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.917800    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:44.918345 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.918326    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-090c5b75-6b89b7f54c-khzrg"]
Sep 10 20:53:44.921471 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.921455    2579 scope.go:117] "RemoveContainer" containerID="a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27"
Sep 10 20:53:44.921797 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:53:44.921775    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27\": container with ID starting with a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27 not found: ID does not exist" containerID="a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27"
Sep 10 20:53:44.921867 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.921800    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27"} err="failed to get container status \"a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27\": rpc error: code = NotFound desc = could not find container \"a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27\": container with ID starting with a7009b3a17e3a81334444788748779c5ec65d5b81b280265285d016281707d27 not found: ID does not exist"
Sep 10 20:53:44.936519 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.936499    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"]
Sep 10 20:53:44.942609 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.942588    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp"]
Sep 10 20:53:44.954520 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.954500    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"]
Sep 10 20:53:44.963318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.963298    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6"]
Sep 10 20:53:44.966093 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.966075    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trgbd\" (UniqueName: \"kubernetes.io/projected/524b7921-f94f-418e-bd3a-a254e473db87-kube-api-access-trgbd\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:44.966158 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.966096    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:44.966158 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.966106    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/524b7921-f94f-418e-bd3a-a254e473db87-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:44.966158 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.966115    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:44.966158 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.966123    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8n2p\" (UniqueName: \"kubernetes.io/projected/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96-kube-api-access-t8n2p\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:44.966158 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.966132    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j67f8\" (UniqueName: \"kubernetes.io/projected/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb-kube-api-access-j67f8\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:44.966158 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:44.966140    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/524b7921-f94f-418e-bd3a-a254e473db87-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:53:45.375306 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:45.375274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:45.487645 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:45.487596    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="524b7921-f94f-418e-bd3a-a254e473db87" path="/var/lib/kubelet/pods/524b7921-f94f-418e-bd3a-a254e473db87/volumes"
Sep 10 20:53:45.488185 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:45.488163    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb" path="/var/lib/kubelet/pods/cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb/volumes"
Sep 10 20:53:45.488650 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:45.488603    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96" path="/var/lib/kubelet/pods/f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96/volumes"
Sep 10 20:53:45.694047 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:45.694017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:46.118336 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:46.118250    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:48.494967 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:48.494935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:48.589771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:48.589725    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:49.679840 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.679806    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"]
Sep 10 20:53:49.680434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.680414    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb" containerName="payload-pre-processing"
Sep 10 20:53:49.680482 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.680438    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb" containerName="payload-pre-processing"
Sep 10 20:53:49.680482 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.680464    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524b7921-f94f-418e-bd3a-a254e473db87" containerName="maas-api"
Sep 10 20:53:49.680482 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.680473    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="524b7921-f94f-418e-bd3a-a254e473db87" containerName="maas-api"
Sep 10 20:53:49.680574 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.680497    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96" containerName="payload-processing"
Sep 10 20:53:49.680574 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.680506    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96" containerName="payload-processing"
Sep 10 20:53:49.680657 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.680621    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="524b7921-f94f-418e-bd3a-a254e473db87" containerName="maas-api"
Sep 10 20:53:49.680696 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.680658    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1e7bd7-2d0f-4faa-aed4-8b0f904801fb" containerName="payload-pre-processing"
Sep 10 20:53:49.680696 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.680671    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5cf5af2-0ae3-4f28-ae6c-b9397ff3ec96" containerName="payload-processing"
Sep 10 20:53:49.685789 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.685763    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.689286 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.689263    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-50a00efc-serving-cert\""
Sep 10 20:53:49.695986 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.695947    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"]
Sep 10 20:53:49.711067 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.711040    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-metrics-certs\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.711181 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.711160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-maas-api-tls\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.711224 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.711192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b4cdea-5e1d-4bb9-9b83-edef55250c85-openshift-service-ca\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.711224 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.711214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzk7s\" (UniqueName: \"kubernetes.io/projected/95b4cdea-5e1d-4bb9-9b83-edef55250c85-kube-api-access-dzk7s\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.726700 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.726672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:49.790789 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.790755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:49.811958 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.811931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-maas-api-tls\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.812073 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.811965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b4cdea-5e1d-4bb9-9b83-edef55250c85-openshift-service-ca\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.812073 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.811989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk7s\" (UniqueName: \"kubernetes.io/projected/95b4cdea-5e1d-4bb9-9b83-edef55250c85-kube-api-access-dzk7s\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.812158 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.812068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-metrics-certs\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.812701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.812678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b4cdea-5e1d-4bb9-9b83-edef55250c85-openshift-service-ca\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.814405 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.814379    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-maas-api-tls\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.814494 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.814451    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-metrics-certs\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.823815 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.823794    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzk7s\" (UniqueName: \"kubernetes.io/projected/95b4cdea-5e1d-4bb9-9b83-edef55250c85-kube-api-access-dzk7s\") pod \"maas-api-e2e-ait-50a00efc-955fd597f-lnrld\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:49.890997 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.890962    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:49.997232 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:49.997154    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:50.277740 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.277708    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"]
Sep 10 20:53:50.279511 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:53:50.279486    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b4cdea_5e1d_4bb9_9b83_edef55250c85.slice/crio-422c45570d347412c6222f66451e24e57398528d9f8575628a437ac176baeab3 WatchSource:0}: Error finding container 422c45570d347412c6222f66451e24e57398528d9f8575628a437ac176baeab3: Status 404 returned error can't find the container with id 422c45570d347412c6222f66451e24e57398528d9f8575628a437ac176baeab3
Sep 10 20:53:50.289282 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.289259    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:50.387502 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.387467    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:50.487854 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.487819    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"]
Sep 10 20:53:50.492434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.492412    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:53:50.496194 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.496176    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-50a00efc\""
Sep 10 20:53:50.496318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.496216    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-50a00efc-dockercfg-bzr2p\""
Sep 10 20:53:50.504745 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.504724    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"]
Sep 10 20:53:50.518124 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.518098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9slk8\" (UniqueName: \"kubernetes.io/projected/9c88afd0-6993-48f2-b81d-dceefdc6b952-kube-api-access-9slk8\") pod \"payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq\" (UID: \"9c88afd0-6993-48f2-b81d-dceefdc6b952\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:53:50.518275 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.518237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c88afd0-6993-48f2-b81d-dceefdc6b952-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq\" (UID: \"9c88afd0-6993-48f2-b81d-dceefdc6b952\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:53:50.619357 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.619273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c88afd0-6993-48f2-b81d-dceefdc6b952-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq\" (UID: \"9c88afd0-6993-48f2-b81d-dceefdc6b952\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:53:50.619508 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.619363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9slk8\" (UniqueName: \"kubernetes.io/projected/9c88afd0-6993-48f2-b81d-dceefdc6b952-kube-api-access-9slk8\") pod \"payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq\" (UID: \"9c88afd0-6993-48f2-b81d-dceefdc6b952\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:53:50.620226 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.620207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c88afd0-6993-48f2-b81d-dceefdc6b952-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq\" (UID: \"9c88afd0-6993-48f2-b81d-dceefdc6b952\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:53:50.628707 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.628676    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9slk8\" (UniqueName: \"kubernetes.io/projected/9c88afd0-6993-48f2-b81d-dceefdc6b952-kube-api-access-9slk8\") pod \"payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq\" (UID: \"9c88afd0-6993-48f2-b81d-dceefdc6b952\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:53:50.802622 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.802591    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:53:50.926356 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.926323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld" event={"ID":"95b4cdea-5e1d-4bb9-9b83-edef55250c85","Type":"ContainerStarted","Data":"2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03"}
Sep 10 20:53:50.926537 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.926377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld" event={"ID":"95b4cdea-5e1d-4bb9-9b83-edef55250c85","Type":"ContainerStarted","Data":"422c45570d347412c6222f66451e24e57398528d9f8575628a437ac176baeab3"}
Sep 10 20:53:50.926537 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.926450    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:53:50.945435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:50.945379    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld" podStartSLOduration=1.555832033 podStartE2EDuration="1.945360564s" totalImagesPullingTime="389.528531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:53:50.94446418 +0000 UTC m=+1055.981365694" watchObservedRunningTime="2026-09-10 20:53:50.945360564 +0000 UTC m=+1055.982262076"
Sep 10 20:53:51.077354 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:51.077328    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"]
Sep 10 20:53:51.078956 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:53:51.078928    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c88afd0_6993_48f2_b81d_dceefdc6b952.slice/crio-a2e08e1d6de76f75a873e6a64eb111d997b0dcacbf9f56ec23fd293f2bb961f3 WatchSource:0}: Error finding container a2e08e1d6de76f75a873e6a64eb111d997b0dcacbf9f56ec23fd293f2bb961f3: Status 404 returned error can't find the container with id a2e08e1d6de76f75a873e6a64eb111d997b0dcacbf9f56ec23fd293f2bb961f3
Sep 10 20:53:51.933114 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:51.933069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq" event={"ID":"9c88afd0-6993-48f2-b81d-dceefdc6b952","Type":"ContainerStarted","Data":"5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d"}
Sep 10 20:53:51.933598 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:51.933137    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:53:51.933598 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:51.933164    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq" event={"ID":"9c88afd0-6993-48f2-b81d-dceefdc6b952","Type":"ContainerStarted","Data":"a2e08e1d6de76f75a873e6a64eb111d997b0dcacbf9f56ec23fd293f2bb961f3"}
Sep 10 20:53:51.953804 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:51.953750    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq" podStartSLOduration=1.953736239 podStartE2EDuration="1.953736239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:53:51.951927641 +0000 UTC m=+1056.988829159" watchObservedRunningTime="2026-09-10 20:53:51.953736239 +0000 UTC m=+1056.990637751"
Sep 10 20:53:55.715135 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:55.715086    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:53:56.938454 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:53:56.938426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:54:02.940617 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:02.940581    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:54:10.704138 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:10.704056    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:13.616330 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:13.616287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:18.002340 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:18.002303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:20.024486 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.024440    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:20.648701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.648662    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"]
Sep 10 20:54:20.648955 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.648928    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld" podUID="95b4cdea-5e1d-4bb9-9b83-edef55250c85" containerName="maas-api" containerID="cri-o://2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03" gracePeriod=30
Sep 10 20:54:20.676907 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.676853    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:20.714503 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.714459    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"]
Sep 10 20:54:20.714762 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.714728    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq" podUID="9c88afd0-6993-48f2-b81d-dceefdc6b952" containerName="payload-pre-processing" containerID="cri-o://5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d" gracePeriod=30
Sep 10 20:54:20.776441 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.776405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:20.877816 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.877784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:20.975466 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.975441    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:54:20.978649 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:20.978605    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:21.004529 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.004499    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:54:21.008856 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.008832    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzk7s\" (UniqueName: \"kubernetes.io/projected/95b4cdea-5e1d-4bb9-9b83-edef55250c85-kube-api-access-dzk7s\") pod \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") "
Sep 10 20:54:21.008975 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.008876    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-maas-api-tls\") pod \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") "
Sep 10 20:54:21.009016 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.008989    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c88afd0-6993-48f2-b81d-dceefdc6b952-plugins-config-volume\") pod \"9c88afd0-6993-48f2-b81d-dceefdc6b952\" (UID: \"9c88afd0-6993-48f2-b81d-dceefdc6b952\") "
Sep 10 20:54:21.009059 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.009045    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-metrics-certs\") pod \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") "
Sep 10 20:54:21.009123 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.009075    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9slk8\" (UniqueName: \"kubernetes.io/projected/9c88afd0-6993-48f2-b81d-dceefdc6b952-kube-api-access-9slk8\") pod \"9c88afd0-6993-48f2-b81d-dceefdc6b952\" (UID: \"9c88afd0-6993-48f2-b81d-dceefdc6b952\") "
Sep 10 20:54:21.009177 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.009123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b4cdea-5e1d-4bb9-9b83-edef55250c85-openshift-service-ca\") pod \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\" (UID: \"95b4cdea-5e1d-4bb9-9b83-edef55250c85\") "
Sep 10 20:54:21.009475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.009437    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c88afd0-6993-48f2-b81d-dceefdc6b952-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c88afd0-6993-48f2-b81d-dceefdc6b952" (UID: "9c88afd0-6993-48f2-b81d-dceefdc6b952"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:54:21.009729 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.009709    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b4cdea-5e1d-4bb9-9b83-edef55250c85-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95b4cdea-5e1d-4bb9-9b83-edef55250c85" (UID: "95b4cdea-5e1d-4bb9-9b83-edef55250c85"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:54:21.011165 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.011140    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "95b4cdea-5e1d-4bb9-9b83-edef55250c85" (UID: "95b4cdea-5e1d-4bb9-9b83-edef55250c85"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:54:21.011278 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.011166    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c88afd0-6993-48f2-b81d-dceefdc6b952-kube-api-access-9slk8" (OuterVolumeSpecName: "kube-api-access-9slk8") pod "9c88afd0-6993-48f2-b81d-dceefdc6b952" (UID: "9c88afd0-6993-48f2-b81d-dceefdc6b952"). InnerVolumeSpecName "kube-api-access-9slk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:54:21.011419 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.011398    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b4cdea-5e1d-4bb9-9b83-edef55250c85-kube-api-access-dzk7s" (OuterVolumeSpecName: "kube-api-access-dzk7s") pod "95b4cdea-5e1d-4bb9-9b83-edef55250c85" (UID: "95b4cdea-5e1d-4bb9-9b83-edef55250c85"). InnerVolumeSpecName "kube-api-access-dzk7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:54:21.011511 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.011404    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95b4cdea-5e1d-4bb9-9b83-edef55250c85" (UID: "95b4cdea-5e1d-4bb9-9b83-edef55250c85"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:54:21.069528 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.069490    2579 generic.go:356] "Generic (PLEG): container finished" podID="95b4cdea-5e1d-4bb9-9b83-edef55250c85" containerID="2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03" exitCode=0
Sep 10 20:54:21.069967 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.069541    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"
Sep 10 20:54:21.069967 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.069580    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld" event={"ID":"95b4cdea-5e1d-4bb9-9b83-edef55250c85","Type":"ContainerDied","Data":"2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03"}
Sep 10 20:54:21.069967 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.069665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld" event={"ID":"95b4cdea-5e1d-4bb9-9b83-edef55250c85","Type":"ContainerDied","Data":"422c45570d347412c6222f66451e24e57398528d9f8575628a437ac176baeab3"}
Sep 10 20:54:21.069967 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.069694    2579 scope.go:117] "RemoveContainer" containerID="2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03"
Sep 10 20:54:21.070959 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.070930    2579 generic.go:356] "Generic (PLEG): container finished" podID="9c88afd0-6993-48f2-b81d-dceefdc6b952" containerID="5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d" exitCode=0
Sep 10 20:54:21.071098 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.070968    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"
Sep 10 20:54:21.071098 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.070991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq" event={"ID":"9c88afd0-6993-48f2-b81d-dceefdc6b952","Type":"ContainerDied","Data":"5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d"}
Sep 10 20:54:21.071098 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.071030    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq" event={"ID":"9c88afd0-6993-48f2-b81d-dceefdc6b952","Type":"ContainerDied","Data":"a2e08e1d6de76f75a873e6a64eb111d997b0dcacbf9f56ec23fd293f2bb961f3"}
Sep 10 20:54:21.079686 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.079579    2579 scope.go:117] "RemoveContainer" containerID="2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03"
Sep 10 20:54:21.079964 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:54:21.079932    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03\": container with ID starting with 2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03 not found: ID does not exist" containerID="2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03"
Sep 10 20:54:21.080055 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.079974    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03"} err="failed to get container status \"2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03\": rpc error: code = NotFound desc = could not find container \"2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03\": container with ID starting with 2e279f33dab3919822856cbcc63aa39596e3284eff0adde7913b0dff4ce6bb03 not found: ID does not exist"
Sep 10 20:54:21.080055 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.079995    2579 scope.go:117] "RemoveContainer" containerID="5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d"
Sep 10 20:54:21.088262 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.088244    2579 scope.go:117] "RemoveContainer" containerID="5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d"
Sep 10 20:54:21.088498 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:54:21.088480    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d\": container with ID starting with 5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d not found: ID does not exist" containerID="5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d"
Sep 10 20:54:21.088544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.088504    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d"} err="failed to get container status \"5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d\": rpc error: code = NotFound desc = could not find container \"5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d\": container with ID starting with 5cc4ea305f2daedcc4b541a5bb356b1444bdee3ba59c3f07966439aacf65a31d not found: ID does not exist"
Sep 10 20:54:21.095719 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.095698    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"]
Sep 10 20:54:21.099385 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.099361    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50a00efc-955fd597f-lnrld"]
Sep 10 20:54:21.110092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.110070    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:21.110092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.110092    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c88afd0-6993-48f2-b81d-dceefdc6b952-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:21.110222 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.110101    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95b4cdea-5e1d-4bb9-9b83-edef55250c85-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:21.110222 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.110113    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9slk8\" (UniqueName: \"kubernetes.io/projected/9c88afd0-6993-48f2-b81d-dceefdc6b952-kube-api-access-9slk8\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:21.110222 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.110121    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b4cdea-5e1d-4bb9-9b83-edef55250c85-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:21.110222 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.110129    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzk7s\" (UniqueName: \"kubernetes.io/projected/95b4cdea-5e1d-4bb9-9b83-edef55250c85-kube-api-access-dzk7s\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:21.111724 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.111704    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"]
Sep 10 20:54:21.115428 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.115406    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq"]
Sep 10 20:54:21.486962 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.486932    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b4cdea-5e1d-4bb9-9b83-edef55250c85" path="/var/lib/kubelet/pods/95b4cdea-5e1d-4bb9-9b83-edef55250c85/volumes"
Sep 10 20:54:21.487315 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:21.487302    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c88afd0-6993-48f2-b81d-dceefdc6b952" path="/var/lib/kubelet/pods/9c88afd0-6993-48f2-b81d-dceefdc6b952/volumes"
Sep 10 20:54:22.006667 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.006606    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:22.411674 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.411623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:22.705955 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.705869    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"]
Sep 10 20:54:22.706397 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.706376    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c88afd0-6993-48f2-b81d-dceefdc6b952" containerName="payload-pre-processing"
Sep 10 20:54:22.706475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.706400    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c88afd0-6993-48f2-b81d-dceefdc6b952" containerName="payload-pre-processing"
Sep 10 20:54:22.706475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.706431    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b4cdea-5e1d-4bb9-9b83-edef55250c85" containerName="maas-api"
Sep 10 20:54:22.706475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.706440    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b4cdea-5e1d-4bb9-9b83-edef55250c85" containerName="maas-api"
Sep 10 20:54:22.706569 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.706529    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c88afd0-6993-48f2-b81d-dceefdc6b952" containerName="payload-pre-processing"
Sep 10 20:54:22.706569 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.706545    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b4cdea-5e1d-4bb9-9b83-edef55250c85" containerName="maas-api"
Sep 10 20:54:22.711456 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.711435    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.714503 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.714484    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b1672bb6-openshift-default-dockercfg-v64jg\""
Sep 10 20:54:22.722344 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzxnp\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-kube-api-access-wzxnp\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.722439 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722367    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-certs\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.722439 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"]
Sep 10 20:54:22.722439 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-socket\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.722559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722443    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-podinfo\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.722559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-envoy\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.722559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istiod-ca-cert\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.722559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-credential-socket\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.722559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-token\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.722811 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.722701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-data\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.727541 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.727516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:22.823446 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.823410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-socket\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.823446 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.823447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-podinfo\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.823759 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.823466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-envoy\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.823759 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.823504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istiod-ca-cert\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.823759 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.823685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-credential-socket\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.823759 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.823741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-token\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.823979 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.823891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-data\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.823979 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.823961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzxnp\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-kube-api-access-wzxnp\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.823979 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.823971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-socket\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.824133 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.824002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-certs\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.824271 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.824250    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-data\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.824342 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.824273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-credential-socket\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.824379 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.824362    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-certs\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.824505 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.824487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istiod-ca-cert\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.825884 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.825867    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-envoy\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.826232 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.826214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-podinfo\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.832841 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.832816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-token\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:22.832946 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:22.832930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzxnp\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-kube-api-access-wzxnp\") pod \"e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") " pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:23.022463 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:23.022383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:23.133963 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:23.133933    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:23.298542 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:23.298514    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"]
Sep 10 20:54:23.300712 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:54:23.300686    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99ecd8e_b4cd_4e42_9656_9adce3d57c62.slice/crio-23b996ee93a688bdf2a2ec1f887cea8d34de476ed8c4acddc2ea9311bdc2402b WatchSource:0}: Error finding container 23b996ee93a688bdf2a2ec1f887cea8d34de476ed8c4acddc2ea9311bdc2402b: Status 404 returned error can't find the container with id 23b996ee93a688bdf2a2ec1f887cea8d34de476ed8c4acddc2ea9311bdc2402b
Sep 10 20:54:24.097859 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:24.097825    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" event={"ID":"c99ecd8e-b4cd-4e42-9656-9adce3d57c62","Type":"ContainerStarted","Data":"23b996ee93a688bdf2a2ec1f887cea8d34de476ed8c4acddc2ea9311bdc2402b"}
Sep 10 20:54:26.092591 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:26.092553    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:54:26.092890 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:26.092625    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:54:26.092890 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:26.092682    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:54:27.115595 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:27.115558    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" event={"ID":"c99ecd8e-b4cd-4e42-9656-9adce3d57c62","Type":"ContainerStarted","Data":"08e6a11ca4fb55e306385e896564871bc793ecc78c5aaa3ff4fee1a673881808"}
Sep 10 20:54:27.143188 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:27.143137    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" podStartSLOduration=2.354103293 podStartE2EDuration="5.143120897s" totalImagesPullingTime="2.789017604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:54:27.140424965 +0000 UTC m=+1092.177326482" watchObservedRunningTime="2026-09-10 20:54:27.143120897 +0000 UTC m=+1092.180022410"
Sep 10 20:54:28.023538 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:28.023503    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:28.028824 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:28.028797    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:28.120613 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:28.120578    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:28.121517 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:28.121500    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:28.473382 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:28.473351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:28.570717 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:28.570690    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:29.834516 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.834478    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"]
Sep 10 20:54:29.839122 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.839103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.842151 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.842130    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b1672bb6-serving-cert\""
Sep 10 20:54:29.850660 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.850641    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"]
Sep 10 20:54:29.874377 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.874339    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:29.888691 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.888663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1b2b92-9741-4992-b147-f02f070c7595-openshift-service-ca\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.888831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.888719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-maas-api-tls\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.888831 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.888784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92nbs\" (UniqueName: \"kubernetes.io/projected/fc1b2b92-9741-4992-b147-f02f070c7595-kube-api-access-92nbs\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.888946 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.888831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-metrics-certs\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.976267 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.976234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:29.989686 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.989658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1b2b92-9741-4992-b147-f02f070c7595-openshift-service-ca\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.989812 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.989744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-maas-api-tls\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.989812 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.989779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92nbs\" (UniqueName: \"kubernetes.io/projected/fc1b2b92-9741-4992-b147-f02f070c7595-kube-api-access-92nbs\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.989916 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.989810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-metrics-certs\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.989916 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:54:29.989881    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-serving-cert: secret "maas-api-e2e-derive-b1672bb6-serving-cert" not found
Sep 10 20:54:29.990029 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:54:29.989973    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-maas-api-tls podName:fc1b2b92-9741-4992-b147-f02f070c7595 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:30.48995671 +0000 UTC m=+1095.526858201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-maas-api-tls") pod "maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t" (UID: "fc1b2b92-9741-4992-b147-f02f070c7595") : secret "maas-api-e2e-derive-b1672bb6-serving-cert" not found
Sep 10 20:54:29.990295 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.990275    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1b2b92-9741-4992-b147-f02f070c7595-openshift-service-ca\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:29.992250 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:29.992233    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-metrics-certs\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:30.000194 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.000171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92nbs\" (UniqueName: \"kubernetes.io/projected/fc1b2b92-9741-4992-b147-f02f070c7595-kube-api-access-92nbs\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:30.123859 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.123745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:30.476903 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.476869    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:30.495154 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.495123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-maas-api-tls\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:30.497695 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.497666    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-maas-api-tls\") pod \"maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:30.581578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.581540    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:30.590522 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.590494    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"]
Sep 10 20:54:30.594549 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.594528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:30.597920 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.597902    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-b1672bb6\""
Sep 10 20:54:30.601128 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.601107    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"]
Sep 10 20:54:30.604590 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.604572    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:30.607674 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.607655    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-b1672bb6-dockercfg-5wfpd\""
Sep 10 20:54:30.612581 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.612556    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"]
Sep 10 20:54:30.615920 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.615901    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"]
Sep 10 20:54:30.696756 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.696720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2cabae0-50da-4cff-89f9-97022a46e6f3-plugins-config-volume\") pod \"payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv\" (UID: \"d2cabae0-50da-4cff-89f9-97022a46e6f3\") " pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:30.696922 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.696774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d89cea80-96d0-49a5-bc50-02ad666bb231-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g\" (UID: \"d89cea80-96d0-49a5-bc50-02ad666bb231\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:30.696922 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.696848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lzlk\" (UniqueName: \"kubernetes.io/projected/d2cabae0-50da-4cff-89f9-97022a46e6f3-kube-api-access-4lzlk\") pod \"payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv\" (UID: \"d2cabae0-50da-4cff-89f9-97022a46e6f3\") " pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:30.696922 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.696882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-994gs\" (UniqueName: \"kubernetes.io/projected/d89cea80-96d0-49a5-bc50-02ad666bb231-kube-api-access-994gs\") pod \"payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g\" (UID: \"d89cea80-96d0-49a5-bc50-02ad666bb231\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:30.751847 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.751763    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:30.798040 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.798005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lzlk\" (UniqueName: \"kubernetes.io/projected/d2cabae0-50da-4cff-89f9-97022a46e6f3-kube-api-access-4lzlk\") pod \"payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv\" (UID: \"d2cabae0-50da-4cff-89f9-97022a46e6f3\") " pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:30.798206 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.798058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-994gs\" (UniqueName: \"kubernetes.io/projected/d89cea80-96d0-49a5-bc50-02ad666bb231-kube-api-access-994gs\") pod \"payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g\" (UID: \"d89cea80-96d0-49a5-bc50-02ad666bb231\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:30.798206 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.798144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2cabae0-50da-4cff-89f9-97022a46e6f3-plugins-config-volume\") pod \"payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv\" (UID: \"d2cabae0-50da-4cff-89f9-97022a46e6f3\") " pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:30.798417 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.798204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d89cea80-96d0-49a5-bc50-02ad666bb231-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g\" (UID: \"d89cea80-96d0-49a5-bc50-02ad666bb231\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:30.799405 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.799378    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d89cea80-96d0-49a5-bc50-02ad666bb231-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g\" (UID: \"d89cea80-96d0-49a5-bc50-02ad666bb231\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:30.799405 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.799397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2cabae0-50da-4cff-89f9-97022a46e6f3-plugins-config-volume\") pod \"payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv\" (UID: \"d2cabae0-50da-4cff-89f9-97022a46e6f3\") " pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:30.808895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.808844    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-994gs\" (UniqueName: \"kubernetes.io/projected/d89cea80-96d0-49a5-bc50-02ad666bb231-kube-api-access-994gs\") pod \"payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g\" (UID: \"d89cea80-96d0-49a5-bc50-02ad666bb231\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:30.809463 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.809432    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lzlk\" (UniqueName: \"kubernetes.io/projected/d2cabae0-50da-4cff-89f9-97022a46e6f3-kube-api-access-4lzlk\") pod \"payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv\" (UID: \"d2cabae0-50da-4cff-89f9-97022a46e6f3\") " pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:30.905612 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.905562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:30.916170 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:30.916145    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:31.029203 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:31.029177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"]
Sep 10 20:54:31.030226 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:54:31.030198    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1b2b92_9741_4992_b147_f02f070c7595.slice/crio-9674cedb91823f6ba977d9e71da76ea57412c395addcb0d102afa7eb0c999539 WatchSource:0}: Error finding container 9674cedb91823f6ba977d9e71da76ea57412c395addcb0d102afa7eb0c999539: Status 404 returned error can't find the container with id 9674cedb91823f6ba977d9e71da76ea57412c395addcb0d102afa7eb0c999539
Sep 10 20:54:31.135041 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:31.135011    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t" event={"ID":"fc1b2b92-9741-4992-b147-f02f070c7595","Type":"ContainerStarted","Data":"9674cedb91823f6ba977d9e71da76ea57412c395addcb0d102afa7eb0c999539"}
Sep 10 20:54:31.184643 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:31.184606    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"]
Sep 10 20:54:31.186017 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:54:31.185994    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89cea80_96d0_49a5_bc50_02ad666bb231.slice/crio-94844dd8d557a653989c735fee4e4e87d29a34c020107f7af0b222d40858568b WatchSource:0}: Error finding container 94844dd8d557a653989c735fee4e4e87d29a34c020107f7af0b222d40858568b: Status 404 returned error can't find the container with id 94844dd8d557a653989c735fee4e4e87d29a34c020107f7af0b222d40858568b
Sep 10 20:54:31.211723 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:31.211697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"]
Sep 10 20:54:31.212982 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:54:31.212959    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cabae0_50da_4cff_89f9_97022a46e6f3.slice/crio-387b603e70ebd3550b86be982f1f07353f4f29c284e1640cb4bf3a01edb2edc6 WatchSource:0}: Error finding container 387b603e70ebd3550b86be982f1f07353f4f29c284e1640cb4bf3a01edb2edc6: Status 404 returned error can't find the container with id 387b603e70ebd3550b86be982f1f07353f4f29c284e1640cb4bf3a01edb2edc6
Sep 10 20:54:32.142512 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.142473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t" event={"ID":"fc1b2b92-9741-4992-b147-f02f070c7595","Type":"ContainerStarted","Data":"3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af"}
Sep 10 20:54:32.142952 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.142617    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:32.144160 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.144134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g" event={"ID":"d89cea80-96d0-49a5-bc50-02ad666bb231","Type":"ContainerStarted","Data":"1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0"}
Sep 10 20:54:32.144316 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.144175    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g" event={"ID":"d89cea80-96d0-49a5-bc50-02ad666bb231","Type":"ContainerStarted","Data":"94844dd8d557a653989c735fee4e4e87d29a34c020107f7af0b222d40858568b"}
Sep 10 20:54:32.144316 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.144224    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:32.145727 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.145706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv" event={"ID":"d2cabae0-50da-4cff-89f9-97022a46e6f3","Type":"ContainerStarted","Data":"fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945"}
Sep 10 20:54:32.145856 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.145740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv" event={"ID":"d2cabae0-50da-4cff-89f9-97022a46e6f3","Type":"ContainerStarted","Data":"387b603e70ebd3550b86be982f1f07353f4f29c284e1640cb4bf3a01edb2edc6"}
Sep 10 20:54:32.145856 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.145778    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:32.164509 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.164462    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t" podStartSLOduration=2.833790841 podStartE2EDuration="3.164445467s" totalImagesPullingTime="330.654626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:54:32.162237012 +0000 UTC m=+1097.199138547" watchObservedRunningTime="2026-09-10 20:54:32.164445467 +0000 UTC m=+1097.201346980"
Sep 10 20:54:32.179738 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.179698    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g" podStartSLOduration=2.179680625 podStartE2EDuration="2.179680625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:54:32.17931644 +0000 UTC m=+1097.216217955" watchObservedRunningTime="2026-09-10 20:54:32.179680625 +0000 UTC m=+1097.216582140"
Sep 10 20:54:32.197886 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:32.197845    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv" podStartSLOduration=2.197829786 podStartE2EDuration="2.197829786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:54:32.197122747 +0000 UTC m=+1097.234024260" watchObservedRunningTime="2026-09-10 20:54:32.197829786 +0000 UTC m=+1097.234731301"
Sep 10 20:54:38.156771 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:38.156737    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:54:43.152908 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:43.152878    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:54:43.153339 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:43.152945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:54:47.299503 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:47.299466    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:50.938284 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:50.938245    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:53.254420 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:53.254385    2579 generic.go:356] "Generic (PLEG): container finished" podID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerID="08e6a11ca4fb55e306385e896564871bc793ecc78c5aaa3ff4fee1a673881808" exitCode=0
Sep 10 20:54:53.254871 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:53.254461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" event={"ID":"c99ecd8e-b4cd-4e42-9656-9adce3d57c62","Type":"ContainerDied","Data":"08e6a11ca4fb55e306385e896564871bc793ecc78c5aaa3ff4fee1a673881808"}
Sep 10 20:54:53.254949 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:53.254931    2579 scope.go:117] "RemoveContainer" containerID="08e6a11ca4fb55e306385e896564871bc793ecc78c5aaa3ff4fee1a673881808"
Sep 10 20:54:53.256092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:53.256064    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:54:53.256163 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:53.256133    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:54:53.256199 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:53.256161    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:54:54.262244 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:54.262206    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" event={"ID":"c99ecd8e-b4cd-4e42-9656-9adce3d57c62","Type":"ContainerStarted","Data":"b3b766b5b0d95ed58849d9f55159bca9416f9d30c8a6a3defe9beb6f31eabd5e"}
Sep 10 20:54:55.023121 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:55.023085    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:55.024698 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:55.024312    2579 patch_prober.go:28] interesting pod/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:54:55.024698 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:55.024388    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 10 20:54:56.023080 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:56.023040    2579 patch_prober.go:28] interesting pod/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:54:56.023699 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:56.023662    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 10 20:54:57.022911 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:57.022873    2579 patch_prober.go:28] interesting pod/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:54:57.023202 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:57.023176    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 10 20:54:57.326804 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:57.326715    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:58.023525 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.023487    2579 patch_prober.go:28] interesting pod/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:54:58.024159 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.024126    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 10 20:54:58.092120 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.092055    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"]
Sep 10 20:54:58.092293 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.092268    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb" podUID="99999755-2887-4643-9897-a2653c6e3553" containerName="maas-api" containerID="cri-o://5d5d5181c6586711e2ca808358d867063092d6e8799f4855d217b6d3afce19b7" gracePeriod=30
Sep 10 20:54:58.125314 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.123581    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:54:58.125314 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.125193    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:58.211191 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.211150    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:58.284638 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.284536    2579 generic.go:356] "Generic (PLEG): container finished" podID="99999755-2887-4643-9897-a2653c6e3553" containerID="5d5d5181c6586711e2ca808358d867063092d6e8799f4855d217b6d3afce19b7" exitCode=0
Sep 10 20:54:58.284795 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.284620    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb" event={"ID":"99999755-2887-4643-9897-a2653c6e3553","Type":"ContainerDied","Data":"5d5d5181c6586711e2ca808358d867063092d6e8799f4855d217b6d3afce19b7"}
Sep 10 20:54:58.311226 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.311187    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:58.404434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.404409    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:54:58.413399 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.413372    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:58.479280 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.479248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:58.571649 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.571541    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljdk4\" (UniqueName: \"kubernetes.io/projected/99999755-2887-4643-9897-a2653c6e3553-kube-api-access-ljdk4\") pod \"99999755-2887-4643-9897-a2653c6e3553\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") "
Sep 10 20:54:58.571649 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.571599    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99999755-2887-4643-9897-a2653c6e3553-openshift-service-ca\") pod \"99999755-2887-4643-9897-a2653c6e3553\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") "
Sep 10 20:54:58.571875 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.571660    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-metrics-certs\") pod \"99999755-2887-4643-9897-a2653c6e3553\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") "
Sep 10 20:54:58.571875 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.571738    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-maas-api-tls\") pod \"99999755-2887-4643-9897-a2653c6e3553\" (UID: \"99999755-2887-4643-9897-a2653c6e3553\") "
Sep 10 20:54:58.571995 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.571907    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99999755-2887-4643-9897-a2653c6e3553-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "99999755-2887-4643-9897-a2653c6e3553" (UID: "99999755-2887-4643-9897-a2653c6e3553"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:54:58.572108 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.572085    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99999755-2887-4643-9897-a2653c6e3553-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:58.573792 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.573761    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "99999755-2887-4643-9897-a2653c6e3553" (UID: "99999755-2887-4643-9897-a2653c6e3553"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:54:58.573941 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.573808    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99999755-2887-4643-9897-a2653c6e3553-kube-api-access-ljdk4" (OuterVolumeSpecName: "kube-api-access-ljdk4") pod "99999755-2887-4643-9897-a2653c6e3553" (UID: "99999755-2887-4643-9897-a2653c6e3553"). InnerVolumeSpecName "kube-api-access-ljdk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:54:58.573941 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.573852    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "99999755-2887-4643-9897-a2653c6e3553" (UID: "99999755-2887-4643-9897-a2653c6e3553"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:54:58.673161 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.673125    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljdk4\" (UniqueName: \"kubernetes.io/projected/99999755-2887-4643-9897-a2653c6e3553-kube-api-access-ljdk4\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:58.673161 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.673157    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:58.673161 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.673167    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99999755-2887-4643-9897-a2653c6e3553-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:54:58.782133 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:58.782101    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:54:59.022872 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:59.022828    2579 patch_prober.go:28] interesting pod/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:54:59.023087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:59.022897    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 10 20:54:59.290916 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:59.290835    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"
Sep 10 20:54:59.291336 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:59.290839    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb" event={"ID":"99999755-2887-4643-9897-a2653c6e3553","Type":"ContainerDied","Data":"f87d393d5a2a6c1ba7221dcd0822cf336ad77e70a03fd3cdf6a7d51fd11bbee2"}
Sep 10 20:54:59.291336 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:59.290978    2579 scope.go:117] "RemoveContainer" containerID="5d5d5181c6586711e2ca808358d867063092d6e8799f4855d217b6d3afce19b7"
Sep 10 20:54:59.314923 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:59.314896    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"]
Sep 10 20:54:59.334654 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:59.331162    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5d9b44-597cc5778d-pfwjb"]
Sep 10 20:54:59.487527 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:59.487485    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99999755-2887-4643-9897-a2653c6e3553" path="/var/lib/kubelet/pods/99999755-2887-4643-9897-a2653c6e3553/volumes"
Sep 10 20:54:59.944791 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:54:59.944752    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:00.022984 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.022936    2579 patch_prober.go:28] interesting pod/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 10 20:55:00.023183 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.023008    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 10 20:55:00.089060 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.089029    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:00.634087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.634052    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"]
Sep 10 20:55:00.634519 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.634294    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t" podUID="fc1b2b92-9741-4992-b147-f02f070c7595" containerName="maas-api" containerID="cri-o://3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af" gracePeriod=30
Sep 10 20:55:00.672116 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.672082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:00.701163 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.701120    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"]
Sep 10 20:55:00.701393 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.701364    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv" podUID="d2cabae0-50da-4cff-89f9-97022a46e6f3" containerName="payload-processing" containerID="cri-o://fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945" gracePeriod=30
Sep 10 20:55:00.708286 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.708069    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"]
Sep 10 20:55:00.708422 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.708342    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g" podUID="d89cea80-96d0-49a5-bc50-02ad666bb231" containerName="payload-pre-processing" containerID="cri-o://1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0" gracePeriod=30
Sep 10 20:55:00.744230 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.744197    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:00.839041 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.839003    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:00.924522 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.924483    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:00.968991 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.968964    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:55:00.993652 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:00.993573    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:01.016500 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.016475    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:55:01.020790 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.020765    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:55:01.078013 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.077977    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"]
Sep 10 20:55:01.078256 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.078226    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy" containerID="cri-o://b3b766b5b0d95ed58849d9f55159bca9416f9d30c8a6a3defe9beb6f31eabd5e" gracePeriod=30
Sep 10 20:55:01.086823 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.086788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:01.094937 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.094910    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lzlk\" (UniqueName: \"kubernetes.io/projected/d2cabae0-50da-4cff-89f9-97022a46e6f3-kube-api-access-4lzlk\") pod \"d2cabae0-50da-4cff-89f9-97022a46e6f3\" (UID: \"d2cabae0-50da-4cff-89f9-97022a46e6f3\") "
Sep 10 20:55:01.095087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.094969    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2cabae0-50da-4cff-89f9-97022a46e6f3-plugins-config-volume\") pod \"d2cabae0-50da-4cff-89f9-97022a46e6f3\" (UID: \"d2cabae0-50da-4cff-89f9-97022a46e6f3\") "
Sep 10 20:55:01.095396 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.095372    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2cabae0-50da-4cff-89f9-97022a46e6f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2cabae0-50da-4cff-89f9-97022a46e6f3" (UID: "d2cabae0-50da-4cff-89f9-97022a46e6f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:55:01.097555 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.097527    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2cabae0-50da-4cff-89f9-97022a46e6f3-kube-api-access-4lzlk" (OuterVolumeSpecName: "kube-api-access-4lzlk") pod "d2cabae0-50da-4cff-89f9-97022a46e6f3" (UID: "d2cabae0-50da-4cff-89f9-97022a46e6f3"). InnerVolumeSpecName "kube-api-access-4lzlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:55:01.194148 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.194054    2579 patch_prober.go:28] interesting pod/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 20:55:01.194148 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.194129    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 20:55:01.196348 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.196319    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-maas-api-tls\") pod \"fc1b2b92-9741-4992-b147-f02f070c7595\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") "
Sep 10 20:55:01.196472 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.196373    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-metrics-certs\") pod \"fc1b2b92-9741-4992-b147-f02f070c7595\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") "
Sep 10 20:55:01.196519 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.196478    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92nbs\" (UniqueName: \"kubernetes.io/projected/fc1b2b92-9741-4992-b147-f02f070c7595-kube-api-access-92nbs\") pod \"fc1b2b92-9741-4992-b147-f02f070c7595\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") "
Sep 10 20:55:01.196554 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.196531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-994gs\" (UniqueName: \"kubernetes.io/projected/d89cea80-96d0-49a5-bc50-02ad666bb231-kube-api-access-994gs\") pod \"d89cea80-96d0-49a5-bc50-02ad666bb231\" (UID: \"d89cea80-96d0-49a5-bc50-02ad666bb231\") "
Sep 10 20:55:01.196599 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.196580    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d89cea80-96d0-49a5-bc50-02ad666bb231-plugins-config-volume\") pod \"d89cea80-96d0-49a5-bc50-02ad666bb231\" (UID: \"d89cea80-96d0-49a5-bc50-02ad666bb231\") "
Sep 10 20:55:01.196672 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.196620    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1b2b92-9741-4992-b147-f02f070c7595-openshift-service-ca\") pod \"fc1b2b92-9741-4992-b147-f02f070c7595\" (UID: \"fc1b2b92-9741-4992-b147-f02f070c7595\") "
Sep 10 20:55:01.197435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.196966    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lzlk\" (UniqueName: \"kubernetes.io/projected/d2cabae0-50da-4cff-89f9-97022a46e6f3-kube-api-access-4lzlk\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:01.197435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.196967    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d89cea80-96d0-49a5-bc50-02ad666bb231-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d89cea80-96d0-49a5-bc50-02ad666bb231" (UID: "d89cea80-96d0-49a5-bc50-02ad666bb231"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:55:01.197435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.196989    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2cabae0-50da-4cff-89f9-97022a46e6f3-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:01.197435 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.197046    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1b2b92-9741-4992-b147-f02f070c7595-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc1b2b92-9741-4992-b147-f02f070c7595" (UID: "fc1b2b92-9741-4992-b147-f02f070c7595"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:55:01.198894 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.198869    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d89cea80-96d0-49a5-bc50-02ad666bb231-kube-api-access-994gs" (OuterVolumeSpecName: "kube-api-access-994gs") pod "d89cea80-96d0-49a5-bc50-02ad666bb231" (UID: "d89cea80-96d0-49a5-bc50-02ad666bb231"). InnerVolumeSpecName "kube-api-access-994gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:55:01.199005 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.198869    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc1b2b92-9741-4992-b147-f02f070c7595" (UID: "fc1b2b92-9741-4992-b147-f02f070c7595"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:55:01.199005 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.198980    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1b2b92-9741-4992-b147-f02f070c7595-kube-api-access-92nbs" (OuterVolumeSpecName: "kube-api-access-92nbs") pod "fc1b2b92-9741-4992-b147-f02f070c7595" (UID: "fc1b2b92-9741-4992-b147-f02f070c7595"). InnerVolumeSpecName "kube-api-access-92nbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:55:01.199093 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.199052    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fc1b2b92-9741-4992-b147-f02f070c7595" (UID: "fc1b2b92-9741-4992-b147-f02f070c7595"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:55:01.297611 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.297573    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92nbs\" (UniqueName: \"kubernetes.io/projected/fc1b2b92-9741-4992-b147-f02f070c7595-kube-api-access-92nbs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:01.297611 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.297604    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-994gs\" (UniqueName: \"kubernetes.io/projected/d89cea80-96d0-49a5-bc50-02ad666bb231-kube-api-access-994gs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:01.297611 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.297613    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d89cea80-96d0-49a5-bc50-02ad666bb231-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:01.297872 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.297621    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1b2b92-9741-4992-b147-f02f070c7595-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:01.297872 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.297662    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:01.297872 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.297671    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc1b2b92-9741-4992-b147-f02f070c7595-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:01.305726 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.305696    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2cabae0-50da-4cff-89f9-97022a46e6f3" containerID="fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945" exitCode=0
Sep 10 20:55:01.305873 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.305746    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"
Sep 10 20:55:01.305873 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.305785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv" event={"ID":"d2cabae0-50da-4cff-89f9-97022a46e6f3","Type":"ContainerDied","Data":"fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945"}
Sep 10 20:55:01.305873 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.305841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv" event={"ID":"d2cabae0-50da-4cff-89f9-97022a46e6f3","Type":"ContainerDied","Data":"387b603e70ebd3550b86be982f1f07353f4f29c284e1640cb4bf3a01edb2edc6"}
Sep 10 20:55:01.305873 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.305868    2579 scope.go:117] "RemoveContainer" containerID="fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945"
Sep 10 20:55:01.307275 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.307250    2579 generic.go:356] "Generic (PLEG): container finished" podID="fc1b2b92-9741-4992-b147-f02f070c7595" containerID="3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af" exitCode=0
Sep 10 20:55:01.307395 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.307341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t" event={"ID":"fc1b2b92-9741-4992-b147-f02f070c7595","Type":"ContainerDied","Data":"3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af"}
Sep 10 20:55:01.307395 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.307356    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"
Sep 10 20:55:01.307510 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.307392    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t" event={"ID":"fc1b2b92-9741-4992-b147-f02f070c7595","Type":"ContainerDied","Data":"9674cedb91823f6ba977d9e71da76ea57412c395addcb0d102afa7eb0c999539"}
Sep 10 20:55:01.308981 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.308956    2579 generic.go:356] "Generic (PLEG): container finished" podID="d89cea80-96d0-49a5-bc50-02ad666bb231" containerID="1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0" exitCode=0
Sep 10 20:55:01.309103 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.308994    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"
Sep 10 20:55:01.309103 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.308995    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g" event={"ID":"d89cea80-96d0-49a5-bc50-02ad666bb231","Type":"ContainerDied","Data":"1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0"}
Sep 10 20:55:01.309227 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.309138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g" event={"ID":"d89cea80-96d0-49a5-bc50-02ad666bb231","Type":"ContainerDied","Data":"94844dd8d557a653989c735fee4e4e87d29a34c020107f7af0b222d40858568b"}
Sep 10 20:55:01.314772 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.314752    2579 scope.go:117] "RemoveContainer" containerID="fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945"
Sep 10 20:55:01.315025 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:55:01.315006    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945\": container with ID starting with fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945 not found: ID does not exist" containerID="fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945"
Sep 10 20:55:01.315103 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.315032    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945"} err="failed to get container status \"fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945\": rpc error: code = NotFound desc = could not find container \"fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945\": container with ID starting with fbb2f9d4e076cc87e21a8c18bb96eb6650325f09511a73331e9ae5bcdd64a945 not found: ID does not exist"
Sep 10 20:55:01.315103 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.315053    2579 scope.go:117] "RemoveContainer" containerID="3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af"
Sep 10 20:55:01.324221 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.324207    2579 scope.go:117] "RemoveContainer" containerID="3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af"
Sep 10 20:55:01.324490 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:55:01.324474    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af\": container with ID starting with 3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af not found: ID does not exist" containerID="3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af"
Sep 10 20:55:01.324544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.324499    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af"} err="failed to get container status \"3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af\": rpc error: code = NotFound desc = could not find container \"3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af\": container with ID starting with 3790c192a236599a2305850e07e249a34b29657dd1a43b72ae56f9cfd6c1b9af not found: ID does not exist"
Sep 10 20:55:01.324544 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.324515    2579 scope.go:117] "RemoveContainer" containerID="1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0"
Sep 10 20:55:01.331657 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.331622    2579 scope.go:117] "RemoveContainer" containerID="1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0"
Sep 10 20:55:01.331932 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:55:01.331914    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0\": container with ID starting with 1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0 not found: ID does not exist" containerID="1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0"
Sep 10 20:55:01.332001 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.331937    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0"} err="failed to get container status \"1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0\": rpc error: code = NotFound desc = could not find container \"1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0\": container with ID starting with 1878299a851e42b43f8a0ff9b19bf657802fdcf6d0fcd74bb99012f9c93faba0 not found: ID does not exist"
Sep 10 20:55:01.343389 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.343367    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"]
Sep 10 20:55:01.348313 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.348293    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b1672bb6-55bfccdbb8-xgg9t"]
Sep 10 20:55:01.370042 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.370018    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"]
Sep 10 20:55:01.379152 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.379133    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g"]
Sep 10 20:55:01.402229 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.402204    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"]
Sep 10 20:55:01.413159 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.413136    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv"]
Sep 10 20:55:01.487096 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.487022    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2cabae0-50da-4cff-89f9-97022a46e6f3" path="/var/lib/kubelet/pods/d2cabae0-50da-4cff-89f9-97022a46e6f3/volumes"
Sep 10 20:55:01.487371 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.487358    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d89cea80-96d0-49a5-bc50-02ad666bb231" path="/var/lib/kubelet/pods/d89cea80-96d0-49a5-bc50-02ad666bb231/volumes"
Sep 10 20:55:01.487725 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.487712    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc1b2b92-9741-4992-b147-f02f070c7595" path="/var/lib/kubelet/pods/fc1b2b92-9741-4992-b147-f02f070c7595/volumes"
Sep 10 20:55:01.763092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.762990    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:01.863061 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.863025    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:01.963065 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:01.963031    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:03.312966 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:03.312930    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:03.710201 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:03.710151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:03.810750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:03.810710    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:04.793248 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:04.793207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:06.340616 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.340581    2579 generic.go:356] "Generic (PLEG): container finished" podID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerID="b3b766b5b0d95ed58849d9f55159bca9416f9d30c8a6a3defe9beb6f31eabd5e" exitCode=0
Sep 10 20:55:06.341008 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.340655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" event={"ID":"c99ecd8e-b4cd-4e42-9656-9adce3d57c62","Type":"ContainerDied","Data":"b3b766b5b0d95ed58849d9f55159bca9416f9d30c8a6a3defe9beb6f31eabd5e"}
Sep 10 20:55:06.341008 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.340716    2579 scope.go:117] "RemoveContainer" containerID="08e6a11ca4fb55e306385e896564871bc793ecc78c5aaa3ff4fee1a673881808"
Sep 10 20:55:06.427972 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.427947    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:55:06.446012 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.445986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzxnp\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-kube-api-access-wzxnp\") pod \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") "
Sep 10 20:55:06.446145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446058    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-envoy\") pod \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") "
Sep 10 20:55:06.446145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446079    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-token\") pod \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") "
Sep 10 20:55:06.446145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446109    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-certs\") pod \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") "
Sep 10 20:55:06.446536 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446144    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-data\") pod \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") "
Sep 10 20:55:06.446536 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istiod-ca-cert\") pod \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") "
Sep 10 20:55:06.446536 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-podinfo\") pod \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") "
Sep 10 20:55:06.446536 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446244    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-socket\") pod \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") "
Sep 10 20:55:06.446536 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446273    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-credential-socket\") pod \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\" (UID: \"c99ecd8e-b4cd-4e42-9656-9adce3d57c62\") "
Sep 10 20:55:06.446536 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446447    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c99ecd8e-b4cd-4e42-9656-9adce3d57c62" (UID: "c99ecd8e-b4cd-4e42-9656-9adce3d57c62"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:55:06.446946 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446653    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:06.446946 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446656    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c99ecd8e-b4cd-4e42-9656-9adce3d57c62" (UID: "c99ecd8e-b4cd-4e42-9656-9adce3d57c62"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:55:06.446946 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446758    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c99ecd8e-b4cd-4e42-9656-9adce3d57c62" (UID: "c99ecd8e-b4cd-4e42-9656-9adce3d57c62"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:55:06.446946 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446855    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c99ecd8e-b4cd-4e42-9656-9adce3d57c62" (UID: "c99ecd8e-b4cd-4e42-9656-9adce3d57c62"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:55:06.447162 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.446954    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-data" (OuterVolumeSpecName: "istio-data") pod "c99ecd8e-b4cd-4e42-9656-9adce3d57c62" (UID: "c99ecd8e-b4cd-4e42-9656-9adce3d57c62"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:55:06.448518 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.448493    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c99ecd8e-b4cd-4e42-9656-9adce3d57c62" (UID: "c99ecd8e-b4cd-4e42-9656-9adce3d57c62"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:55:06.448607 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.448519    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-kube-api-access-wzxnp" (OuterVolumeSpecName: "kube-api-access-wzxnp") pod "c99ecd8e-b4cd-4e42-9656-9adce3d57c62" (UID: "c99ecd8e-b4cd-4e42-9656-9adce3d57c62"). InnerVolumeSpecName "kube-api-access-wzxnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:55:06.448787 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.448761    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-token" (OuterVolumeSpecName: "istio-token") pod "c99ecd8e-b4cd-4e42-9656-9adce3d57c62" (UID: "c99ecd8e-b4cd-4e42-9656-9adce3d57c62"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:55:06.448787 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.448757    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c99ecd8e-b4cd-4e42-9656-9adce3d57c62" (UID: "c99ecd8e-b4cd-4e42-9656-9adce3d57c62"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:55:06.547108 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.547080    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:06.547108 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.547103    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:06.547108 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.547111    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:06.547319 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.547120    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:06.547319 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.547129    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:06.547319 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.547138    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzxnp\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-kube-api-access-wzxnp\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:06.547319 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.547146    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:06.547319 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:06.547154    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99ecd8e-b4cd-4e42-9656-9adce3d57c62-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:55:07.346420 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:07.346384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp" event={"ID":"c99ecd8e-b4cd-4e42-9656-9adce3d57c62","Type":"ContainerDied","Data":"23b996ee93a688bdf2a2ec1f887cea8d34de476ed8c4acddc2ea9311bdc2402b"}
Sep 10 20:55:07.346872 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:07.346445    2579 scope.go:117] "RemoveContainer" containerID="b3b766b5b0d95ed58849d9f55159bca9416f9d30c8a6a3defe9beb6f31eabd5e"
Sep 10 20:55:07.346872 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:07.346396    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"
Sep 10 20:55:07.370750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:07.370723    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"]
Sep 10 20:55:07.377270 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:07.377251    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp"]
Sep 10 20:55:07.487765 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:07.487738    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" path="/var/lib/kubelet/pods/c99ecd8e-b4cd-4e42-9656-9adce3d57c62/volumes"
Sep 10 20:55:07.829615 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:07.829583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:09.872668 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:09.872614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:09.987869 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:09.987816    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:10.084596 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:10.084555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:10.504925 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:10.504884    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:17.915781 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:17.915739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:36.393969 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:36.393910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:36.926661 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:36.926613    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:42.050805 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:42.050713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:42.295198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:42.295167    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:42.704439 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:42.704404    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:42.807083 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:42.807053    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:42.910580 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:42.910496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:43.014234 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014133    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"]
Sep 10 20:55:43.014580 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014548    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy"
Sep 10 20:55:43.014580 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014567    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy"
Sep 10 20:55:43.014580 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014580    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014589    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014603    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99999755-2887-4643-9897-a2653c6e3553" containerName="maas-api"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014611    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="99999755-2887-4643-9897-a2653c6e3553" containerName="maas-api"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014620    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d89cea80-96d0-49a5-bc50-02ad666bb231" containerName="payload-pre-processing"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014650    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d89cea80-96d0-49a5-bc50-02ad666bb231" containerName="payload-pre-processing"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014659    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2cabae0-50da-4cff-89f9-97022a46e6f3" containerName="payload-processing"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014664    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2cabae0-50da-4cff-89f9-97022a46e6f3" containerName="payload-processing"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014674    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1b2b92-9741-4992-b147-f02f070c7595" containerName="maas-api"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014682    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1b2b92-9741-4992-b147-f02f070c7595" containerName="maas-api"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014750    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2cabae0-50da-4cff-89f9-97022a46e6f3" containerName="payload-processing"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014758    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d89cea80-96d0-49a5-bc50-02ad666bb231" containerName="payload-pre-processing"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014766    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="99999755-2887-4643-9897-a2653c6e3553" containerName="maas-api"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014772    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1b2b92-9741-4992-b147-f02f070c7595" containerName="maas-api"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014780    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy"
Sep 10 20:55:43.014834 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.014786    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c99ecd8e-b4cd-4e42-9656-9adce3d57c62" containerName="istio-proxy"
Sep 10 20:55:43.016144 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.016118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:43.019415 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.019399    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.022349 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.022333    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-75dcbb-openshift-default-dockercfg-hgcfk\""
Sep 10 20:55:43.032767 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.032743    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"]
Sep 10 20:55:43.076853 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.076823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:43.172652 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.172609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8p5n\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-kube-api-access-z8p5n\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.172838 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.172669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-token\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.172838 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.172721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-certs\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.172838 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.172765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-data\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.173015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.172845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-podinfo\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.173015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.172873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-socket\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.173015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.172893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d96bb02c-543b-441a-8b02-de400ce96ef4-istiod-ca-cert\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.173015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.172981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-credential-socket\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.173015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.173013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-envoy\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274409 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8p5n\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-kube-api-access-z8p5n\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274409 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-token\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274409 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-certs\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274409 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-data\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274731 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-podinfo\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274731 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-socket\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274731 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d96bb02c-543b-441a-8b02-de400ce96ef4-istiod-ca-cert\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274840 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-credential-socket\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274840 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-envoy\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274840 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-data\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.274840 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274770    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-certs\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.275030 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.274930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-socket\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.275030 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.275009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-credential-socket\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.275320 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.275293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d96bb02c-543b-441a-8b02-de400ce96ef4-istiod-ca-cert\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.277417 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.277393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-envoy\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.278070 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.278047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-podinfo\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.282726 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.282698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-token\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.282991 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.282972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8p5n\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-kube-api-access-z8p5n\") pod \"e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") " pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.330003 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.329979    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:43.570985 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.570903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:43.607340 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.607313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"]
Sep 10 20:55:43.610489 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:55:43.610458    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96bb02c_543b_441a_8b02_de400ce96ef4.slice/crio-7c8b09705da12f1eca7386fb01cb66d522187a08770c7c02374a99e89015571a WatchSource:0}: Error finding container 7c8b09705da12f1eca7386fb01cb66d522187a08770c7c02374a99e89015571a: Status 404 returned error can't find the container with id 7c8b09705da12f1eca7386fb01cb66d522187a08770c7c02374a99e89015571a
Sep 10 20:55:43.612849 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.612775    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:55:43.613037 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.612867    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:55:43.613037 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:43.612912    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:55:44.517188 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:44.517158    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" event={"ID":"d96bb02c-543b-441a-8b02-de400ce96ef4","Type":"ContainerStarted","Data":"67a4be3e8c11184843499452bdb6bf9b7359856f5f764a57a4672c6b1c26acb6"}
Sep 10 20:55:44.517539 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:44.517200    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" event={"ID":"d96bb02c-543b-441a-8b02-de400ce96ef4","Type":"ContainerStarted","Data":"7c8b09705da12f1eca7386fb01cb66d522187a08770c7c02374a99e89015571a"}
Sep 10 20:55:44.540744 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:44.540700    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" podStartSLOduration=2.540679879 podStartE2EDuration="2.540679879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:44.539072704 +0000 UTC m=+1169.575974229" watchObservedRunningTime="2026-09-10 20:55:44.540679879 +0000 UTC m=+1169.577581394"
Sep 10 20:55:45.330273 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:45.330241    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:45.335468 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:45.335442    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:45.521888 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:45.521844    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:45.522723 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:45.522706    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:55:46.433601 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:46.433568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:46.523279 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:46.523249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:47.726402 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:47.726366    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:47.824298 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:47.824260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:48.222389 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.222354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:48.295381 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.295342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:48.363781 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.363749    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"]
Sep 10 20:55:48.367217 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.367198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:55:48.370051 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.370025    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-75dcbb\""
Sep 10 20:55:48.370171 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.370146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-75dcbb-dockercfg-xh9dd\""
Sep 10 20:55:48.376686 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.376664    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"]
Sep 10 20:55:48.407326 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.407302    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"]
Sep 10 20:55:48.410713 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.410697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:55:48.420666 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.420644    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"]
Sep 10 20:55:48.424839 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.424813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmrdc\" (UniqueName: \"kubernetes.io/projected/d7adf05c-6f21-459a-bd4c-26388f5d92d4-kube-api-access-gmrdc\") pod \"payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr\" (UID: \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\") " pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:55:48.424951 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.424855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52hlg\" (UniqueName: \"kubernetes.io/projected/670bebca-c044-4750-a520-c35161bee18f-kube-api-access-52hlg\") pod \"payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2\" (UID: \"670bebca-c044-4750-a520-c35161bee18f\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:55:48.424951 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.424933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7adf05c-6f21-459a-bd4c-26388f5d92d4-plugins-config-volume\") pod \"payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr\" (UID: \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\") " pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:55:48.425071 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.424979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/670bebca-c044-4750-a520-c35161bee18f-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2\" (UID: \"670bebca-c044-4750-a520-c35161bee18f\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:55:48.525743 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.525663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/670bebca-c044-4750-a520-c35161bee18f-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2\" (UID: \"670bebca-c044-4750-a520-c35161bee18f\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:55:48.525743 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.525712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmrdc\" (UniqueName: \"kubernetes.io/projected/d7adf05c-6f21-459a-bd4c-26388f5d92d4-kube-api-access-gmrdc\") pod \"payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr\" (UID: \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\") " pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:55:48.525989 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.525823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52hlg\" (UniqueName: \"kubernetes.io/projected/670bebca-c044-4750-a520-c35161bee18f-kube-api-access-52hlg\") pod \"payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2\" (UID: \"670bebca-c044-4750-a520-c35161bee18f\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:55:48.525989 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.525929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7adf05c-6f21-459a-bd4c-26388f5d92d4-plugins-config-volume\") pod \"payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr\" (UID: \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\") " pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:55:48.526458 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.526434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/670bebca-c044-4750-a520-c35161bee18f-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2\" (UID: \"670bebca-c044-4750-a520-c35161bee18f\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:55:48.526669 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.526624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7adf05c-6f21-459a-bd4c-26388f5d92d4-plugins-config-volume\") pod \"payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr\" (UID: \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\") " pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:55:48.536311 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.536290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52hlg\" (UniqueName: \"kubernetes.io/projected/670bebca-c044-4750-a520-c35161bee18f-kube-api-access-52hlg\") pod \"payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2\" (UID: \"670bebca-c044-4750-a520-c35161bee18f\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:55:48.536580 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.536559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmrdc\" (UniqueName: \"kubernetes.io/projected/d7adf05c-6f21-459a-bd4c-26388f5d92d4-kube-api-access-gmrdc\") pod \"payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr\" (UID: \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\") " pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:55:48.679272 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.679238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:55:48.721457 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.721415    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:55:48.959915 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:55:48.959883    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7adf05c_6f21_459a_bd4c_26388f5d92d4.slice/crio-03cd18bdfaec7390941f3c5cc5100050a7ab8e240fea1efce82296bd831c95bd WatchSource:0}: Error finding container 03cd18bdfaec7390941f3c5cc5100050a7ab8e240fea1efce82296bd831c95bd: Status 404 returned error can't find the container with id 03cd18bdfaec7390941f3c5cc5100050a7ab8e240fea1efce82296bd831c95bd
Sep 10 20:55:48.960926 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:48.960899    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"]
Sep 10 20:55:49.025811 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:49.025783    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"]
Sep 10 20:55:49.026726 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:55:49.026706    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670bebca_c044_4750_a520_c35161bee18f.slice/crio-cb5030df88fa9226f591092eba9d1e570e966f31a49785a15864027fda4e2892 WatchSource:0}: Error finding container cb5030df88fa9226f591092eba9d1e570e966f31a49785a15864027fda4e2892: Status 404 returned error can't find the container with id cb5030df88fa9226f591092eba9d1e570e966f31a49785a15864027fda4e2892
Sep 10 20:55:49.544604 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:49.544567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr" event={"ID":"d7adf05c-6f21-459a-bd4c-26388f5d92d4","Type":"ContainerStarted","Data":"319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b"}
Sep 10 20:55:49.544886 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:49.544865    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:55:49.545054 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:49.545024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr" event={"ID":"d7adf05c-6f21-459a-bd4c-26388f5d92d4","Type":"ContainerStarted","Data":"03cd18bdfaec7390941f3c5cc5100050a7ab8e240fea1efce82296bd831c95bd"}
Sep 10 20:55:49.546421 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:49.546401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2" event={"ID":"670bebca-c044-4750-a520-c35161bee18f","Type":"ContainerStarted","Data":"542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53"}
Sep 10 20:55:49.546528 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:49.546440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2" event={"ID":"670bebca-c044-4750-a520-c35161bee18f","Type":"ContainerStarted","Data":"cb5030df88fa9226f591092eba9d1e570e966f31a49785a15864027fda4e2892"}
Sep 10 20:55:49.546601 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:49.546559    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:55:49.602595 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:49.602545    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2" podStartSLOduration=1.602529595 podStartE2EDuration="1.602529595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:49.600129927 +0000 UTC m=+1174.637031439" watchObservedRunningTime="2026-09-10 20:55:49.602529595 +0000 UTC m=+1174.639431107"
Sep 10 20:55:49.602892 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:49.602870    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr" podStartSLOduration=1.602864078 podStartE2EDuration="1.602864078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:49.573787204 +0000 UTC m=+1174.610688717" watchObservedRunningTime="2026-09-10 20:55:49.602864078 +0000 UTC m=+1174.639765594"
Sep 10 20:55:57.329387 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:57.329346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:55:58.810562 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:55:58.810518    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:00.553523 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:00.553494    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:56:01.558004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:01.557973    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:56:04.621684 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:04.621642    2579 generic.go:356] "Generic (PLEG): container finished" podID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerID="67a4be3e8c11184843499452bdb6bf9b7359856f5f764a57a4672c6b1c26acb6" exitCode=0
Sep 10 20:56:04.622098 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:04.621709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" event={"ID":"d96bb02c-543b-441a-8b02-de400ce96ef4","Type":"ContainerDied","Data":"67a4be3e8c11184843499452bdb6bf9b7359856f5f764a57a4672c6b1c26acb6"}
Sep 10 20:56:04.622157 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:04.622126    2579 scope.go:117] "RemoveContainer" containerID="67a4be3e8c11184843499452bdb6bf9b7359856f5f764a57a4672c6b1c26acb6"
Sep 10 20:56:04.623218 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:04.623187    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:04.623321 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:04.623255    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:04.623321 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:04.623289    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:05.382917 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:05.382886    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:05.439431 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:05.439390    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:05.507282 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:05.507249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:05.607842 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:05.607799    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:05.631608 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:05.631571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" event={"ID":"d96bb02c-543b-441a-8b02-de400ce96ef4","Type":"ContainerStarted","Data":"bfbb2ff558f845c57ed72f94084561411a04d3a2a05da3a998355f012aca9c80"}
Sep 10 20:56:06.330423 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:06.330389    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:56:06.330808 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:06.330783    2579 patch_prober.go:28] interesting pod/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:56:06.330970 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:06.330945    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 20:56:07.331014 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:07.330485    2579 patch_prober.go:28] interesting pod/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:56:07.331014 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:07.330592    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 20:56:08.331227 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:08.331188    2579 patch_prober.go:28] interesting pod/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:56:08.331945 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:08.331902    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 20:56:09.330965 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:09.330925    2579 patch_prober.go:28] interesting pod/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:56:09.332052 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:09.332017    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 20:56:10.331653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:10.330972    2579 patch_prober.go:28] interesting pod/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 20:56:10.331653 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:10.331039    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 20:56:11.335061 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:11.335024    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:56:11.335470 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:11.335306    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:56:11.335948 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:11.335930    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:56:11.389223 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:11.389163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:16.071062 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:16.071025    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:16.865052 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:16.865019    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:22.937101 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:22.937066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:23.045242 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:23.045201    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:23.136802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:23.136768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:23.238863 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:23.238785    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:23.639167 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:23.639075    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:23.837455 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:23.837416    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:23.941584 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:23.941554    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:24.038694 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:24.038666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:25.460088 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:25.460052    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:32.939543 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:32.939510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:33.036854 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:33.036822    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:33.409538 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:33.409499    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:33.692979 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:33.692888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:40.407292 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:40.407251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:40.972796 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:40.972760    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"]
Sep 10 20:56:40.977761 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:40.977745    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:40.980754 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:40.980731    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fc6e011f-openshift-default-dockercfg-jc5sf\""
Sep 10 20:56:40.989598 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:40.989571    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"]
Sep 10 20:56:41.035468 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.035444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bceecb-fdb8-4afe-bffe-e90d9b224549-istiod-ca-cert\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.035590 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.035483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-socket\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.035590 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.035508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-token\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.035590 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.035526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-credential-socket\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.035720 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.035612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-podinfo\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.035720 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.035657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-envoy\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.035720 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.035706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shx4m\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-kube-api-access-shx4m\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.035813 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.035728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-data\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.035813 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.035752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-certs\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.136749 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.136714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-envoy\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.136923 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.136762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shx4m\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-kube-api-access-shx4m\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.136923 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.136785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-data\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.136923 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.136804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-certs\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.136923 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.136851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bceecb-fdb8-4afe-bffe-e90d9b224549-istiod-ca-cert\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.137149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.136942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-socket\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.137149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.136997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-token\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.137149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.137028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-credential-socket\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.137149 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.137084    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-podinfo\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.137358 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.137237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-data\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.137358 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.137294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-certs\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.137475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.137433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-socket\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.137475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.137440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-credential-socket\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.137608 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.137590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bceecb-fdb8-4afe-bffe-e90d9b224549-istiod-ca-cert\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.139004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.138983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-envoy\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.139376 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.139359    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-podinfo\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.150202 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.150177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-token\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.150933 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.150909    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shx4m\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-kube-api-access-shx4m\") pod \"e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") " pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.288542 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.288460    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:41.568886 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.568849    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"]
Sep 10 20:56:41.571421 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:56:41.571397    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11bceecb_fdb8_4afe_bffe_e90d9b224549.slice/crio-3f501fc75f4f0c6d7e25a229a91aca021711c7918c317d54e0961ffa5f22fd85 WatchSource:0}: Error finding container 3f501fc75f4f0c6d7e25a229a91aca021711c7918c317d54e0961ffa5f22fd85: Status 404 returned error can't find the container with id 3f501fc75f4f0c6d7e25a229a91aca021711c7918c317d54e0961ffa5f22fd85
Sep 10 20:56:41.574167 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.574132    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:41.574275 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.574208    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:41.574275 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.574254    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:41.813621 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.813584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" event={"ID":"11bceecb-fdb8-4afe-bffe-e90d9b224549","Type":"ContainerStarted","Data":"0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac"}
Sep 10 20:56:41.813811 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.813671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" event={"ID":"11bceecb-fdb8-4afe-bffe-e90d9b224549","Type":"ContainerStarted","Data":"3f501fc75f4f0c6d7e25a229a91aca021711c7918c317d54e0961ffa5f22fd85"}
Sep 10 20:56:41.842552 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.842482    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:41.844088 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:41.844044    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" podStartSLOduration=1.844027488 podStartE2EDuration="1.844027488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:56:41.841227296 +0000 UTC m=+1226.878128809" watchObservedRunningTime="2026-09-10 20:56:41.844027488 +0000 UTC m=+1226.880929056"
Sep 10 20:56:42.288946 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:42.288911    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:42.293947 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:42.293924    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:42.818762 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:42.818728    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:42.819647 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:42.819616    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:43.724881 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:43.724837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:43.824559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:43.824519    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:43.878145 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:43.878113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:44.247345 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.247303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:44.305700 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.305670    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"]
Sep 10 20:56:44.305901 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.305875    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr" podUID="d7adf05c-6f21-459a-bd4c-26388f5d92d4" containerName="payload-processing" containerID="cri-o://319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b" gracePeriod=30
Sep 10 20:56:44.320830 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.320806    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"]
Sep 10 20:56:44.321068 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.321013    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2" podUID="670bebca-c044-4750-a520-c35161bee18f" containerName="payload-pre-processing" containerID="cri-o://542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53" gracePeriod=30
Sep 10 20:56:44.354915 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.354890    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:44.457996 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.457953    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:44.550802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.550686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:44.577883 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.577861    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:56:44.602906 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.602884    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:56:44.614243 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.614217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:44.673124 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.673096    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7adf05c-6f21-459a-bd4c-26388f5d92d4-plugins-config-volume\") pod \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\" (UID: \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\") "
Sep 10 20:56:44.673124 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.673128    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/670bebca-c044-4750-a520-c35161bee18f-plugins-config-volume\") pod \"670bebca-c044-4750-a520-c35161bee18f\" (UID: \"670bebca-c044-4750-a520-c35161bee18f\") "
Sep 10 20:56:44.673318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.673218    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52hlg\" (UniqueName: \"kubernetes.io/projected/670bebca-c044-4750-a520-c35161bee18f-kube-api-access-52hlg\") pod \"670bebca-c044-4750-a520-c35161bee18f\" (UID: \"670bebca-c044-4750-a520-c35161bee18f\") "
Sep 10 20:56:44.673318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.673250    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmrdc\" (UniqueName: \"kubernetes.io/projected/d7adf05c-6f21-459a-bd4c-26388f5d92d4-kube-api-access-gmrdc\") pod \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\" (UID: \"d7adf05c-6f21-459a-bd4c-26388f5d92d4\") "
Sep 10 20:56:44.673459 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.673438    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7adf05c-6f21-459a-bd4c-26388f5d92d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d7adf05c-6f21-459a-bd4c-26388f5d92d4" (UID: "d7adf05c-6f21-459a-bd4c-26388f5d92d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:56:44.673600 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.673577    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/670bebca-c044-4750-a520-c35161bee18f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "670bebca-c044-4750-a520-c35161bee18f" (UID: "670bebca-c044-4750-a520-c35161bee18f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:56:44.675179 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.675155    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7adf05c-6f21-459a-bd4c-26388f5d92d4-kube-api-access-gmrdc" (OuterVolumeSpecName: "kube-api-access-gmrdc") pod "d7adf05c-6f21-459a-bd4c-26388f5d92d4" (UID: "d7adf05c-6f21-459a-bd4c-26388f5d92d4"). InnerVolumeSpecName "kube-api-access-gmrdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:56:44.675239 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.675224    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/670bebca-c044-4750-a520-c35161bee18f-kube-api-access-52hlg" (OuterVolumeSpecName: "kube-api-access-52hlg") pod "670bebca-c044-4750-a520-c35161bee18f" (UID: "670bebca-c044-4750-a520-c35161bee18f"). InnerVolumeSpecName "kube-api-access-52hlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:56:44.774685 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.774612    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52hlg\" (UniqueName: \"kubernetes.io/projected/670bebca-c044-4750-a520-c35161bee18f-kube-api-access-52hlg\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:44.774685 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.774685    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmrdc\" (UniqueName: \"kubernetes.io/projected/d7adf05c-6f21-459a-bd4c-26388f5d92d4-kube-api-access-gmrdc\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:44.774895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.774697    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7adf05c-6f21-459a-bd4c-26388f5d92d4-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:44.774895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.774707    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/670bebca-c044-4750-a520-c35161bee18f-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:44.830523 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.830448    2579 generic.go:356] "Generic (PLEG): container finished" podID="670bebca-c044-4750-a520-c35161bee18f" containerID="542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53" exitCode=0
Sep 10 20:56:44.830523 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.830489    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"
Sep 10 20:56:44.830990 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.830525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2" event={"ID":"670bebca-c044-4750-a520-c35161bee18f","Type":"ContainerDied","Data":"542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53"}
Sep 10 20:56:44.830990 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.830573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2" event={"ID":"670bebca-c044-4750-a520-c35161bee18f","Type":"ContainerDied","Data":"cb5030df88fa9226f591092eba9d1e570e966f31a49785a15864027fda4e2892"}
Sep 10 20:56:44.830990 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.830603    2579 scope.go:117] "RemoveContainer" containerID="542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53"
Sep 10 20:56:44.832123 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.832096    2579 generic.go:356] "Generic (PLEG): container finished" podID="d7adf05c-6f21-459a-bd4c-26388f5d92d4" containerID="319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b" exitCode=0
Sep 10 20:56:44.832245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.832135    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"
Sep 10 20:56:44.832245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.832187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr" event={"ID":"d7adf05c-6f21-459a-bd4c-26388f5d92d4","Type":"ContainerDied","Data":"319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b"}
Sep 10 20:56:44.832362 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.832251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr" event={"ID":"d7adf05c-6f21-459a-bd4c-26388f5d92d4","Type":"ContainerDied","Data":"03cd18bdfaec7390941f3c5cc5100050a7ab8e240fea1efce82296bd831c95bd"}
Sep 10 20:56:44.841152 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.841131    2579 scope.go:117] "RemoveContainer" containerID="542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53"
Sep 10 20:56:44.841469 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:56:44.841453    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53\": container with ID starting with 542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53 not found: ID does not exist" containerID="542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53"
Sep 10 20:56:44.841531 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.841477    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53"} err="failed to get container status \"542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53\": rpc error: code = NotFound desc = could not find container \"542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53\": container with ID starting with 542ffb97531bcc2fda7166ec1fbddc5d55a65f9e7df69439debf26312c010f53 not found: ID does not exist"
Sep 10 20:56:44.841531 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.841494    2579 scope.go:117] "RemoveContainer" containerID="319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b"
Sep 10 20:56:44.849672 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.849656    2579 scope.go:117] "RemoveContainer" containerID="319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b"
Sep 10 20:56:44.849906 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:56:44.849889    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b\": container with ID starting with 319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b not found: ID does not exist" containerID="319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b"
Sep 10 20:56:44.849969 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.849913    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b"} err="failed to get container status \"319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b\": rpc error: code = NotFound desc = could not find container \"319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b\": container with ID starting with 319b90c629c5268cd59f9cf32deccde91105109732721a96d7de4e4c4720624b not found: ID does not exist"
Sep 10 20:56:44.858868 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.858847    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"]
Sep 10 20:56:44.863467 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.863448    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2"]
Sep 10 20:56:44.876013 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.875995    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"]
Sep 10 20:56:44.880246 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.880226    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr"]
Sep 10 20:56:44.892204 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.892184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:44.965248 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:44.965215    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:45.039286 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.039239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:45.150262 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.150231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:45.487470 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.487396    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="670bebca-c044-4750-a520-c35161bee18f" path="/var/lib/kubelet/pods/670bebca-c044-4750-a520-c35161bee18f/volumes"
Sep 10 20:56:45.487820 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.487800    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7adf05c-6f21-459a-bd4c-26388f5d92d4" path="/var/lib/kubelet/pods/d7adf05c-6f21-459a-bd4c-26388f5d92d4/volumes"
Sep 10 20:56:45.629395 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.629364    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:45.730747 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.730710    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:45.862574 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.862497    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"]
Sep 10 20:56:45.863033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.862984    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7adf05c-6f21-459a-bd4c-26388f5d92d4" containerName="payload-processing"
Sep 10 20:56:45.863033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.863002    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7adf05c-6f21-459a-bd4c-26388f5d92d4" containerName="payload-processing"
Sep 10 20:56:45.863033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.863017    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="670bebca-c044-4750-a520-c35161bee18f" containerName="payload-pre-processing"
Sep 10 20:56:45.863033 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.863023    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="670bebca-c044-4750-a520-c35161bee18f" containerName="payload-pre-processing"
Sep 10 20:56:45.863203 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.863105    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7adf05c-6f21-459a-bd4c-26388f5d92d4" containerName="payload-processing"
Sep 10 20:56:45.863203 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.863113    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="670bebca-c044-4750-a520-c35161bee18f" containerName="payload-pre-processing"
Sep 10 20:56:45.867623 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.867604    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:45.870839 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.870822    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-fc6e011f-dockercfg-jvmvl\""
Sep 10 20:56:45.871754 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.871731    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-fc6e011f\""
Sep 10 20:56:45.883005 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.882983    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"]
Sep 10 20:56:45.987094 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.987056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfjxl\" (UniqueName: \"kubernetes.io/projected/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-kube-api-access-cfjxl\") pod \"payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b\" (UID: \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:45.987254 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:45.987223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b\" (UID: \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:46.088514 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.088475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfjxl\" (UniqueName: \"kubernetes.io/projected/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-kube-api-access-cfjxl\") pod \"payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b\" (UID: \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:46.088677 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.088569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b\" (UID: \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:46.089292 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.089273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b\" (UID: \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:46.098560 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.098533    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfjxl\" (UniqueName: \"kubernetes.io/projected/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-kube-api-access-cfjxl\") pod \"payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b\" (UID: \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:46.179816 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.179779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:46.456302 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.456275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"]
Sep 10 20:56:46.457703 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:56:46.457673    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd8e332_2a25_4d12_822e_6d9dccb44ffb.slice/crio-0a39898c507a1ec98ed8bc053bbb4159428daf8756c9fd27759ca791deb4a899 WatchSource:0}: Error finding container 0a39898c507a1ec98ed8bc053bbb4159428daf8756c9fd27759ca791deb4a899: Status 404 returned error can't find the container with id 0a39898c507a1ec98ed8bc053bbb4159428daf8756c9fd27759ca791deb4a899
Sep 10 20:56:46.846069 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.845970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b" event={"ID":"bbd8e332-2a25-4d12-822e-6d9dccb44ffb","Type":"ContainerStarted","Data":"ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db"}
Sep 10 20:56:46.846069 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.846036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b" event={"ID":"bbd8e332-2a25-4d12-822e-6d9dccb44ffb","Type":"ContainerStarted","Data":"0a39898c507a1ec98ed8bc053bbb4159428daf8756c9fd27759ca791deb4a899"}
Sep 10 20:56:46.846267 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.846094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:46.871647 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:46.871588    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b" podStartSLOduration=1.871574323 podStartE2EDuration="1.871574323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:56:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:56:46.871416825 +0000 UTC m=+1231.908318338" watchObservedRunningTime="2026-09-10 20:56:46.871574323 +0000 UTC m=+1231.908475835"
Sep 10 20:56:51.365699 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:51.365661    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:51.449038 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:51.449004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:51.639712 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:51.636296    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"]
Sep 10 20:56:51.639712 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:51.636547    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy" containerID="cri-o://bfbb2ff558f845c57ed72f94084561411a04d3a2a05da3a998355f012aca9c80" gracePeriod=30
Sep 10 20:56:51.658013 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:51.657280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:52.131426 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.131381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:52.578268 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.578242    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"]
Sep 10 20:56:52.578741 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.578580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:52.582306 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.582289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.586388 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.586365    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-3671a4-openshift-default-dockercfg-rz7gz\""
Sep 10 20:56:52.602981 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.602960    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"]
Sep 10 20:56:52.662847 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.662801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-envoy\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.663026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.662861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-data\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.663026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.662896    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-certs\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.663026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.662924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-credential-socket\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.663026 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.662986    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-token\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.663231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.663052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-socket\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.663231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.663132    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2322d19e-6e90-4406-97c5-929dcee6cc62-istiod-ca-cert\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.663231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.663185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-podinfo\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.663231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.663220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x7r4\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-kube-api-access-5x7r4\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764153 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-envoy\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764335 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-data\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764335 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-certs\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764423 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-credential-socket\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764423 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-token\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764514 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-socket\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764576 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2322d19e-6e90-4406-97c5-929dcee6cc62-istiod-ca-cert\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764664 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-podinfo\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764664 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x7r4\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-kube-api-access-5x7r4\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.764759 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.764701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-certs\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.765040 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.765005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-credential-socket\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.765040 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.765030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-data\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.765253 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.765052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-socket\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.765492 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.765466    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2322d19e-6e90-4406-97c5-929dcee6cc62-istiod-ca-cert\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.766496 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.766472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-envoy\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.767166 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.767143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-podinfo\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.780369 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.780347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-token\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.780545 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.780527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x7r4\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-kube-api-access-5x7r4\") pod \"e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") " pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:52.892226 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:52.892200    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:53.092441 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:53.092408    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:53.200288 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:53.200260    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"]
Sep 10 20:56:53.203278 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:56:53.203241    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2322d19e_6e90_4406_97c5_929dcee6cc62.slice/crio-b1cefd0944ceec19e60fdac9d516b179c35f069cd6973c397393009848330490 WatchSource:0}: Error finding container b1cefd0944ceec19e60fdac9d516b179c35f069cd6973c397393009848330490: Status 404 returned error can't find the container with id b1cefd0944ceec19e60fdac9d516b179c35f069cd6973c397393009848330490
Sep 10 20:56:53.205230 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:53.205199    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:53.205302 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:53.205266    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:53.205302 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:53.205293    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:53.881679 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:53.881645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v" event={"ID":"2322d19e-6e90-4406-97c5-929dcee6cc62","Type":"ContainerStarted","Data":"4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd"}
Sep 10 20:56:53.882168 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:53.881707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v" event={"ID":"2322d19e-6e90-4406-97c5-929dcee6cc62","Type":"ContainerStarted","Data":"b1cefd0944ceec19e60fdac9d516b179c35f069cd6973c397393009848330490"}
Sep 10 20:56:53.892596 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:53.892574    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:53.911951 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:53.911905    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v" podStartSLOduration=1.91188805 podStartE2EDuration="1.91188805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:56:53.911843879 +0000 UTC m=+1238.948745392" watchObservedRunningTime="2026-09-10 20:56:53.91188805 +0000 UTC m=+1238.948789564"
Sep 10 20:56:54.223386 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:54.223346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:54.315058 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:54.315021    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:54.454030 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:54.453996    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:56:54.899813 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:54.899786    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:55.892690 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:55.892661    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:55.893838 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:55.893813    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:56:56.338117 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:56.338082    2579 patch_prober.go:28] interesting pod/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 20:56:56.338566 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:56.338140    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 20:56:56.898613 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:56.898585    2579 generic.go:356] "Generic (PLEG): container finished" podID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerID="bfbb2ff558f845c57ed72f94084561411a04d3a2a05da3a998355f012aca9c80" exitCode=0
Sep 10 20:56:56.898733 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:56.898666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" event={"ID":"d96bb02c-543b-441a-8b02-de400ce96ef4","Type":"ContainerDied","Data":"bfbb2ff558f845c57ed72f94084561411a04d3a2a05da3a998355f012aca9c80"}
Sep 10 20:56:56.898733 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:56.898726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6" event={"ID":"d96bb02c-543b-441a-8b02-de400ce96ef4","Type":"ContainerDied","Data":"7c8b09705da12f1eca7386fb01cb66d522187a08770c7c02374a99e89015571a"}
Sep 10 20:56:56.898809 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:56.898744    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c8b09705da12f1eca7386fb01cb66d522187a08770c7c02374a99e89015571a"
Sep 10 20:56:56.898809 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:56.898758    2579 scope.go:117] "RemoveContainer" containerID="67a4be3e8c11184843499452bdb6bf9b7359856f5f764a57a4672c6b1c26acb6"
Sep 10 20:56:56.906170 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:56.906112    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:56:57.007860 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.007829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-data\") pod \"d96bb02c-543b-441a-8b02-de400ce96ef4\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") "
Sep 10 20:56:57.008015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.007872    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-certs\") pod \"d96bb02c-543b-441a-8b02-de400ce96ef4\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") "
Sep 10 20:56:57.008015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.007908    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-socket\") pod \"d96bb02c-543b-441a-8b02-de400ce96ef4\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") "
Sep 10 20:56:57.008015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.007963    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-token\") pod \"d96bb02c-543b-441a-8b02-de400ce96ef4\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") "
Sep 10 20:56:57.008015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.007999    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-podinfo\") pod \"d96bb02c-543b-441a-8b02-de400ce96ef4\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") "
Sep 10 20:56:57.008015 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008014    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d96bb02c-543b-441a-8b02-de400ce96ef4-istiod-ca-cert\") pod \"d96bb02c-543b-441a-8b02-de400ce96ef4\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") "
Sep 10 20:56:57.008245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008046    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-credential-socket\") pod \"d96bb02c-543b-441a-8b02-de400ce96ef4\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") "
Sep 10 20:56:57.008245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008146    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-data" (OuterVolumeSpecName: "istio-data") pod "d96bb02c-543b-441a-8b02-de400ce96ef4" (UID: "d96bb02c-543b-441a-8b02-de400ce96ef4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:56:57.008245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-envoy\") pod \"d96bb02c-543b-441a-8b02-de400ce96ef4\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") "
Sep 10 20:56:57.008245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008164    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d96bb02c-543b-441a-8b02-de400ce96ef4" (UID: "d96bb02c-543b-441a-8b02-de400ce96ef4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:56:57.008245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008210    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8p5n\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-kube-api-access-z8p5n\") pod \"d96bb02c-543b-441a-8b02-de400ce96ef4\" (UID: \"d96bb02c-543b-441a-8b02-de400ce96ef4\") "
Sep 10 20:56:57.008245 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008224    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d96bb02c-543b-441a-8b02-de400ce96ef4" (UID: "d96bb02c-543b-441a-8b02-de400ce96ef4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:56:57.008542 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d96bb02c-543b-441a-8b02-de400ce96ef4" (UID: "d96bb02c-543b-441a-8b02-de400ce96ef4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:56:57.009032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008898    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d96bb02c-543b-441a-8b02-de400ce96ef4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d96bb02c-543b-441a-8b02-de400ce96ef4" (UID: "d96bb02c-543b-441a-8b02-de400ce96ef4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:56:57.009032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008942    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:57.009032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008962    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:57.009032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008976    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:57.009032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.008993    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:57.010460 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.010432    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-kube-api-access-z8p5n" (OuterVolumeSpecName: "kube-api-access-z8p5n") pod "d96bb02c-543b-441a-8b02-de400ce96ef4" (UID: "d96bb02c-543b-441a-8b02-de400ce96ef4"). InnerVolumeSpecName "kube-api-access-z8p5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:56:57.010721 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.010692    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d96bb02c-543b-441a-8b02-de400ce96ef4" (UID: "d96bb02c-543b-441a-8b02-de400ce96ef4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:56:57.010807 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.010736    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d96bb02c-543b-441a-8b02-de400ce96ef4" (UID: "d96bb02c-543b-441a-8b02-de400ce96ef4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:56:57.010807 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.010761    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-token" (OuterVolumeSpecName: "istio-token") pod "d96bb02c-543b-441a-8b02-de400ce96ef4" (UID: "d96bb02c-543b-441a-8b02-de400ce96ef4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:56:57.109865 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.109825    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:57.109865 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.109853    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8p5n\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-kube-api-access-z8p5n\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:57.109865 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.109862    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:57.109865 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.109870    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d96bb02c-543b-441a-8b02-de400ce96ef4-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:57.110116 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.109878    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d96bb02c-543b-441a-8b02-de400ce96ef4-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:56:57.820036 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.820005    2579 patch_prober.go:28] interesting pod/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 20:56:57.820411 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.820073    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 20:56:57.853253 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.853221    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:56:57.906080 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.906052    2579 generic.go:356] "Generic (PLEG): container finished" podID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerID="0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac" exitCode=0
Sep 10 20:56:57.906251 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.906136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" event={"ID":"11bceecb-fdb8-4afe-bffe-e90d9b224549","Type":"ContainerDied","Data":"0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac"}
Sep 10 20:56:57.906605 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.906580    2579 scope.go:117] "RemoveContainer" containerID="0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac"
Sep 10 20:56:57.907977 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.907704    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"
Sep 10 20:56:57.907977 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.907886    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:57.908132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.907998    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:57.908132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.908053    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:56:57.975514 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.975481    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"]
Sep 10 20:56:57.980293 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:57.980262    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6"]
Sep 10 20:56:58.914270 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:58.914237    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" event={"ID":"11bceecb-fdb8-4afe-bffe-e90d9b224549","Type":"ContainerStarted","Data":"96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72"}
Sep 10 20:56:59.289468 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:59.289379    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:56:59.289650 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:59.289603    2579 patch_prober.go:28] interesting pod/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 20:56:59.289714 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:59.289675    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 20:56:59.487353 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:56:59.487318    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" path="/var/lib/kubelet/pods/d96bb02c-543b-441a-8b02-de400ce96ef4/volumes"
Sep 10 20:57:00.289382 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:00.289338    2579 patch_prober.go:28] interesting pod/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 20:57:00.289828 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:00.289399    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 20:57:01.289226 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:01.289189    2579 patch_prober.go:28] interesting pod/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 20:57:01.289406 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:01.289252    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 20:57:02.288999 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:02.288963    2579 patch_prober.go:28] interesting pod/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 20:57:02.289177 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:02.289030    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 20:57:03.289644 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:03.289597    2579 patch_prober.go:28] interesting pod/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 20:57:03.290006 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:03.289678    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 20:57:04.293470 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:04.293437    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:57:04.293920 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:04.293670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:57:04.294569 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:04.294552    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:57:08.706686 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:08.706596    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:09.422267 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:09.422231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:09.531255 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:09.531225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:09.879962 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:09.879883    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:17.291100 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:17.291059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:17.390288 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:17.390248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:28.310680 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.310607    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:28.355781 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.355751    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"]
Sep 10 20:57:28.355993 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.355965    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b" podUID="bbd8e332-2a25-4d12-822e-6d9dccb44ffb" containerName="payload-pre-processing" containerID="cri-o://ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db" gracePeriod=30
Sep 10 20:57:28.384564 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.384529    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:28.443596 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.443567    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:28.562529 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.562412    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:28.604102 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.604076    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:57:28.661694 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.661663    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:28.722728 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.722697    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-plugins-config-volume\") pod \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\" (UID: \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\") "
Sep 10 20:57:28.722894 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.722862    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfjxl\" (UniqueName: \"kubernetes.io/projected/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-kube-api-access-cfjxl\") pod \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\" (UID: \"bbd8e332-2a25-4d12-822e-6d9dccb44ffb\") "
Sep 10 20:57:28.723100 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.723075    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bbd8e332-2a25-4d12-822e-6d9dccb44ffb" (UID: "bbd8e332-2a25-4d12-822e-6d9dccb44ffb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:57:28.724879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.724855    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-kube-api-access-cfjxl" (OuterVolumeSpecName: "kube-api-access-cfjxl") pod "bbd8e332-2a25-4d12-822e-6d9dccb44ffb" (UID: "bbd8e332-2a25-4d12-822e-6d9dccb44ffb"). InnerVolumeSpecName "kube-api-access-cfjxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:57:28.823957 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.823870    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfjxl\" (UniqueName: \"kubernetes.io/projected/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-kube-api-access-cfjxl\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:28.823957 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.823899    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbd8e332-2a25-4d12-822e-6d9dccb44ffb-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:28.977716 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:28.977676    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:29.069080 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.069043    2579 generic.go:356] "Generic (PLEG): container finished" podID="bbd8e332-2a25-4d12-822e-6d9dccb44ffb" containerID="ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db" exitCode=0
Sep 10 20:57:29.069279 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.069098    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"
Sep 10 20:57:29.069279 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.069114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b" event={"ID":"bbd8e332-2a25-4d12-822e-6d9dccb44ffb","Type":"ContainerDied","Data":"ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db"}
Sep 10 20:57:29.069279 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.069163    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b" event={"ID":"bbd8e332-2a25-4d12-822e-6d9dccb44ffb","Type":"ContainerDied","Data":"0a39898c507a1ec98ed8bc053bbb4159428daf8756c9fd27759ca791deb4a899"}
Sep 10 20:57:29.069279 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.069188    2579 scope.go:117] "RemoveContainer" containerID="ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db"
Sep 10 20:57:29.078010 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.077987    2579 scope.go:117] "RemoveContainer" containerID="ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db"
Sep 10 20:57:29.078279 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:57:29.078260    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db\": container with ID starting with ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db not found: ID does not exist" containerID="ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db"
Sep 10 20:57:29.078327 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.078287    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db"} err="failed to get container status \"ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db\": rpc error: code = NotFound desc = could not find container \"ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db\": container with ID starting with ddd85ffa6b4a8f850bd46eea79f9787f6929c460d5ee080b4261256105d343db not found: ID does not exist"
Sep 10 20:57:29.095408 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.095383    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"]
Sep 10 20:57:29.097185 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.097168    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b"]
Sep 10 20:57:29.487322 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:29.487289    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbd8e332-2a25-4d12-822e-6d9dccb44ffb" path="/var/lib/kubelet/pods/bbd8e332-2a25-4d12-822e-6d9dccb44ffb/volumes"
Sep 10 20:57:32.019230 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:32.019194    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:34.191732 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:34.191692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:34.728809 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:34.728765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:34.987434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:34.987345    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:37.300818 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:37.300786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:37.395698 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:37.395661    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:37.621874 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:37.621786    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"]
Sep 10 20:57:37.622081 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:37.622052    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy" containerID="cri-o://96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72" gracePeriod=30
Sep 10 20:57:37.627895 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:37.627872    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:38.016652 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:38.016594    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:38.171775 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:38.171743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:38.265249 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:38.265218    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:42.864529 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.864506    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:57:42.962227 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962195    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-credential-socket\") pod \"11bceecb-fdb8-4afe-bffe-e90d9b224549\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") "
Sep 10 20:57:42.962394 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962243    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-podinfo\") pod \"11bceecb-fdb8-4afe-bffe-e90d9b224549\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") "
Sep 10 20:57:42.962394 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bceecb-fdb8-4afe-bffe-e90d9b224549-istiod-ca-cert\") pod \"11bceecb-fdb8-4afe-bffe-e90d9b224549\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") "
Sep 10 20:57:42.962394 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-envoy\") pod \"11bceecb-fdb8-4afe-bffe-e90d9b224549\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") "
Sep 10 20:57:42.962394 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962323    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-socket\") pod \"11bceecb-fdb8-4afe-bffe-e90d9b224549\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") "
Sep 10 20:57:42.962394 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962339    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-certs\") pod \"11bceecb-fdb8-4afe-bffe-e90d9b224549\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") "
Sep 10 20:57:42.962683 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962397    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shx4m\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-kube-api-access-shx4m\") pod \"11bceecb-fdb8-4afe-bffe-e90d9b224549\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") "
Sep 10 20:57:42.962683 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962455    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-token\") pod \"11bceecb-fdb8-4afe-bffe-e90d9b224549\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") "
Sep 10 20:57:42.962683 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962477    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-data\") pod \"11bceecb-fdb8-4afe-bffe-e90d9b224549\" (UID: \"11bceecb-fdb8-4afe-bffe-e90d9b224549\") "
Sep 10 20:57:42.962683 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962501    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11bceecb-fdb8-4afe-bffe-e90d9b224549" (UID: "11bceecb-fdb8-4afe-bffe-e90d9b224549"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:42.962900 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962713    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11bceecb-fdb8-4afe-bffe-e90d9b224549-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11bceecb-fdb8-4afe-bffe-e90d9b224549" (UID: "11bceecb-fdb8-4afe-bffe-e90d9b224549"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:57:42.962900 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962754    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:42.962900 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962740    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11bceecb-fdb8-4afe-bffe-e90d9b224549" (UID: "11bceecb-fdb8-4afe-bffe-e90d9b224549"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:42.962900 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962782    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11bceecb-fdb8-4afe-bffe-e90d9b224549" (UID: "11bceecb-fdb8-4afe-bffe-e90d9b224549"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:42.963076 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.962945    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-data" (OuterVolumeSpecName: "istio-data") pod "11bceecb-fdb8-4afe-bffe-e90d9b224549" (UID: "11bceecb-fdb8-4afe-bffe-e90d9b224549"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:42.964598 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.964572    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11bceecb-fdb8-4afe-bffe-e90d9b224549" (UID: "11bceecb-fdb8-4afe-bffe-e90d9b224549"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:57:42.964598 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.964575    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-kube-api-access-shx4m" (OuterVolumeSpecName: "kube-api-access-shx4m") pod "11bceecb-fdb8-4afe-bffe-e90d9b224549" (UID: "11bceecb-fdb8-4afe-bffe-e90d9b224549"). InnerVolumeSpecName "kube-api-access-shx4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:57:42.965010 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.964989    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-token" (OuterVolumeSpecName: "istio-token") pod "11bceecb-fdb8-4afe-bffe-e90d9b224549" (UID: "11bceecb-fdb8-4afe-bffe-e90d9b224549"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:57:42.965061 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:42.965006    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11bceecb-fdb8-4afe-bffe-e90d9b224549" (UID: "11bceecb-fdb8-4afe-bffe-e90d9b224549"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:43.063778 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.063745    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:43.063778 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.063774    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:43.063956 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.063787    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shx4m\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-kube-api-access-shx4m\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:43.063956 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.063796    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:43.063956 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.063806    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:43.063956 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.063813    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:43.063956 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.063821    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11bceecb-fdb8-4afe-bffe-e90d9b224549-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:43.063956 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.063829    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11bceecb-fdb8-4afe-bffe-e90d9b224549-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:43.134971 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.134940    2579 generic.go:356] "Generic (PLEG): container finished" podID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerID="96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72" exitCode=0
Sep 10 20:57:43.135092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.134992    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"
Sep 10 20:57:43.135092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.135015    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" event={"ID":"11bceecb-fdb8-4afe-bffe-e90d9b224549","Type":"ContainerDied","Data":"96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72"}
Sep 10 20:57:43.135092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.135062    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w" event={"ID":"11bceecb-fdb8-4afe-bffe-e90d9b224549","Type":"ContainerDied","Data":"3f501fc75f4f0c6d7e25a229a91aca021711c7918c317d54e0961ffa5f22fd85"}
Sep 10 20:57:43.135092 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.135085    2579 scope.go:117] "RemoveContainer" containerID="96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72"
Sep 10 20:57:43.146313 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.146296    2579 scope.go:117] "RemoveContainer" containerID="0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac"
Sep 10 20:57:43.154030 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.154014    2579 scope.go:117] "RemoveContainer" containerID="96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72"
Sep 10 20:57:43.154302 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:57:43.154284    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72\": container with ID starting with 96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72 not found: ID does not exist" containerID="96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72"
Sep 10 20:57:43.154353 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.154310    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72"} err="failed to get container status \"96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72\": rpc error: code = NotFound desc = could not find container \"96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72\": container with ID starting with 96004fdb927a3f1cead009e1fd27d13da0c2dd3f9b0e2fcd0966c8a582c9ec72 not found: ID does not exist"
Sep 10 20:57:43.154353 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.154327    2579 scope.go:117] "RemoveContainer" containerID="0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac"
Sep 10 20:57:43.154586 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:57:43.154566    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac\": container with ID starting with 0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac not found: ID does not exist" containerID="0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac"
Sep 10 20:57:43.154700 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.154588    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac"} err="failed to get container status \"0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac\": rpc error: code = NotFound desc = could not find container \"0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac\": container with ID starting with 0041b1340303eac7a30fcbfbe7838a00ab91b86ec733ded5fac63eaeecf859ac not found: ID does not exist"
Sep 10 20:57:43.169710 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.169688    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"]
Sep 10 20:57:43.173915 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.173890    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w"]
Sep 10 20:57:43.489615 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.489580    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" path="/var/lib/kubelet/pods/11bceecb-fdb8-4afe-bffe-e90d9b224549/volumes"
Sep 10 20:57:43.535609 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.535580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:43.635089 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.635056    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"]
Sep 10 20:57:43.635322 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.635300    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v" podUID="2322d19e-6e90-4406-97c5-929dcee6cc62" containerName="istio-proxy" containerID="cri-o://4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd" gracePeriod=30
Sep 10 20:57:43.645710 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.645681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:43.883300 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.883211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:43.989522 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:43.989476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:46.045750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.045718    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"]
Sep 10 20:57:46.046214 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.045977    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2" podUID="6b648fc7-38fa-4fea-957f-885f381ee0e9" containerName="maas-api" containerID="cri-o://cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076" gracePeriod=30
Sep 10 20:57:46.091414 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.091381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:46.228065 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.228006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:46.301219 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.301157    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:57:46.321600 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.321562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:46.393925 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.393896    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b648fc7-38fa-4fea-957f-885f381ee0e9-openshift-service-ca\") pod \"6b648fc7-38fa-4fea-957f-885f381ee0e9\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") "
Sep 10 20:57:46.394094 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.393945    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-maas-api-tls\") pod \"6b648fc7-38fa-4fea-957f-885f381ee0e9\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") "
Sep 10 20:57:46.394094 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.393993    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gwb7\" (UniqueName: \"kubernetes.io/projected/6b648fc7-38fa-4fea-957f-885f381ee0e9-kube-api-access-7gwb7\") pod \"6b648fc7-38fa-4fea-957f-885f381ee0e9\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") "
Sep 10 20:57:46.394094 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.394042    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-metrics-certs\") pod \"6b648fc7-38fa-4fea-957f-885f381ee0e9\" (UID: \"6b648fc7-38fa-4fea-957f-885f381ee0e9\") "
Sep 10 20:57:46.394300 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.394275    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b648fc7-38fa-4fea-957f-885f381ee0e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b648fc7-38fa-4fea-957f-885f381ee0e9" (UID: "6b648fc7-38fa-4fea-957f-885f381ee0e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:57:46.396156 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.396131    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6b648fc7-38fa-4fea-957f-885f381ee0e9" (UID: "6b648fc7-38fa-4fea-957f-885f381ee0e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:57:46.396281 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.396158    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b648fc7-38fa-4fea-957f-885f381ee0e9" (UID: "6b648fc7-38fa-4fea-957f-885f381ee0e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:57:46.396338 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.396287    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b648fc7-38fa-4fea-957f-885f381ee0e9-kube-api-access-7gwb7" (OuterVolumeSpecName: "kube-api-access-7gwb7") pod "6b648fc7-38fa-4fea-957f-885f381ee0e9" (UID: "6b648fc7-38fa-4fea-957f-885f381ee0e9"). InnerVolumeSpecName "kube-api-access-7gwb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:57:46.488395 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.488362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:46.495770 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.495739    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:46.495770 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.495771    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gwb7\" (UniqueName: \"kubernetes.io/projected/6b648fc7-38fa-4fea-957f-885f381ee0e9-kube-api-access-7gwb7\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:46.495982 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.495788    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b648fc7-38fa-4fea-957f-885f381ee0e9-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:46.495982 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.495805    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b648fc7-38fa-4fea-957f-885f381ee0e9-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:46.575743 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.575622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:46.836815 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.836730    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:46.948414 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:46.948375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:47.043753 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.043721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:47.157360 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.157323    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b648fc7-38fa-4fea-957f-885f381ee0e9" containerID="cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076" exitCode=0
Sep 10 20:57:47.157860 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.157361    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2" event={"ID":"6b648fc7-38fa-4fea-957f-885f381ee0e9","Type":"ContainerDied","Data":"cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076"}
Sep 10 20:57:47.157860 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.157399    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"
Sep 10 20:57:47.157860 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.157439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2" event={"ID":"6b648fc7-38fa-4fea-957f-885f381ee0e9","Type":"ContainerDied","Data":"531b8da9acc68bbefc624b99d7f6f00fac08aaa41f5f5089a324a98fe9288752"}
Sep 10 20:57:47.157860 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.157472    2579 scope.go:117] "RemoveContainer" containerID="cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076"
Sep 10 20:57:47.167500 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.167484    2579 scope.go:117] "RemoveContainer" containerID="cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076"
Sep 10 20:57:47.167872 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:57:47.167852    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076\": container with ID starting with cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076 not found: ID does not exist" containerID="cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076"
Sep 10 20:57:47.167955 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.167878    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076"} err="failed to get container status \"cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076\": rpc error: code = NotFound desc = could not find container \"cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076\": container with ID starting with cd4bafac32e654b5ee5d64eaa88ed5deee79951307990675d8f28f554eb3f076 not found: ID does not exist"
Sep 10 20:57:47.190150 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.190122    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"]
Sep 10 20:57:47.191754 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.191735    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-80aa25-84d579bdcc-7qds2"]
Sep 10 20:57:47.215815 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.215789    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:47.487693 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:47.487603    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b648fc7-38fa-4fea-957f-885f381ee0e9" path="/var/lib/kubelet/pods/6b648fc7-38fa-4fea-957f-885f381ee0e9/volumes"
Sep 10 20:57:48.888542 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.888509    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:57:48.916798 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.916770    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2322d19e-6e90-4406-97c5-929dcee6cc62-istiod-ca-cert\") pod \"2322d19e-6e90-4406-97c5-929dcee6cc62\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") "
Sep 10 20:57:48.916971 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.916806    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-socket\") pod \"2322d19e-6e90-4406-97c5-929dcee6cc62\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") "
Sep 10 20:57:48.916971 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.916829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-certs\") pod \"2322d19e-6e90-4406-97c5-929dcee6cc62\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") "
Sep 10 20:57:48.916971 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.916854    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-token\") pod \"2322d19e-6e90-4406-97c5-929dcee6cc62\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") "
Sep 10 20:57:48.916971 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.916902    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x7r4\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-kube-api-access-5x7r4\") pod \"2322d19e-6e90-4406-97c5-929dcee6cc62\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") "
Sep 10 20:57:48.916971 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.916932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-envoy\") pod \"2322d19e-6e90-4406-97c5-929dcee6cc62\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") "
Sep 10 20:57:48.917231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917017    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-podinfo\") pod \"2322d19e-6e90-4406-97c5-929dcee6cc62\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") "
Sep 10 20:57:48.917231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917073    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-data\") pod \"2322d19e-6e90-4406-97c5-929dcee6cc62\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") "
Sep 10 20:57:48.917231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917079    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2322d19e-6e90-4406-97c5-929dcee6cc62" (UID: "2322d19e-6e90-4406-97c5-929dcee6cc62"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:48.917231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917120    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-credential-socket\") pod \"2322d19e-6e90-4406-97c5-929dcee6cc62\" (UID: \"2322d19e-6e90-4406-97c5-929dcee6cc62\") "
Sep 10 20:57:48.917231 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917132    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2322d19e-6e90-4406-97c5-929dcee6cc62" (UID: "2322d19e-6e90-4406-97c5-929dcee6cc62"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:48.917475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917438    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:48.917475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917459    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:48.917580 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917517    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2322d19e-6e90-4406-97c5-929dcee6cc62-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2322d19e-6e90-4406-97c5-929dcee6cc62" (UID: "2322d19e-6e90-4406-97c5-929dcee6cc62"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:57:48.917654 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917610    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2322d19e-6e90-4406-97c5-929dcee6cc62" (UID: "2322d19e-6e90-4406-97c5-929dcee6cc62"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:48.917750 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.917720    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-data" (OuterVolumeSpecName: "istio-data") pod "2322d19e-6e90-4406-97c5-929dcee6cc62" (UID: "2322d19e-6e90-4406-97c5-929dcee6cc62"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:48.919561 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.919520    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2322d19e-6e90-4406-97c5-929dcee6cc62" (UID: "2322d19e-6e90-4406-97c5-929dcee6cc62"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 20:57:48.919701 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.919598    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2322d19e-6e90-4406-97c5-929dcee6cc62" (UID: "2322d19e-6e90-4406-97c5-929dcee6cc62"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 20:57:48.919933 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.919898    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-kube-api-access-5x7r4" (OuterVolumeSpecName: "kube-api-access-5x7r4") pod "2322d19e-6e90-4406-97c5-929dcee6cc62" (UID: "2322d19e-6e90-4406-97c5-929dcee6cc62"). InnerVolumeSpecName "kube-api-access-5x7r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:57:48.921162 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:48.921136    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-token" (OuterVolumeSpecName: "istio-token") pod "2322d19e-6e90-4406-97c5-929dcee6cc62" (UID: "2322d19e-6e90-4406-97c5-929dcee6cc62"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:57:49.018498 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.018464    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:49.018498 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.018493    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:49.018498 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.018503    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2322d19e-6e90-4406-97c5-929dcee6cc62-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:49.018770 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.018512    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:49.018770 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.018522    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x7r4\" (UniqueName: \"kubernetes.io/projected/2322d19e-6e90-4406-97c5-929dcee6cc62-kube-api-access-5x7r4\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:49.018770 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.018530    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:49.018770 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.018539    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2322d19e-6e90-4406-97c5-929dcee6cc62-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:57:49.078405 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.078368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:49.170433 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.170351    2579 generic.go:356] "Generic (PLEG): container finished" podID="2322d19e-6e90-4406-97c5-929dcee6cc62" containerID="4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd" exitCode=0
Sep 10 20:57:49.170433 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.170394    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"
Sep 10 20:57:49.170608 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.170432    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v" event={"ID":"2322d19e-6e90-4406-97c5-929dcee6cc62","Type":"ContainerDied","Data":"4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd"}
Sep 10 20:57:49.170608 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.170483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v" event={"ID":"2322d19e-6e90-4406-97c5-929dcee6cc62","Type":"ContainerDied","Data":"b1cefd0944ceec19e60fdac9d516b179c35f069cd6973c397393009848330490"}
Sep 10 20:57:49.170608 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.170507    2579 scope.go:117] "RemoveContainer" containerID="4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd"
Sep 10 20:57:49.180117 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.180091    2579 scope.go:117] "RemoveContainer" containerID="4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd"
Sep 10 20:57:49.180405 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:57:49.180388    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd\": container with ID starting with 4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd not found: ID does not exist" containerID="4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd"
Sep 10 20:57:49.180461 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.180413    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd"} err="failed to get container status \"4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd\": rpc error: code = NotFound desc = could not find container \"4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd\": container with ID starting with 4ef190e5740de0461da2c38c2b254b47a18a824fd3a965a71359638932fbd6cd not found: ID does not exist"
Sep 10 20:57:49.205413 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.205390    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"]
Sep 10 20:57:49.207084 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.207062    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v"]
Sep 10 20:57:49.488445 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:49.488366    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2322d19e-6e90-4406-97c5-929dcee6cc62" path="/var/lib/kubelet/pods/2322d19e-6e90-4406-97c5-929dcee6cc62/volumes"
Sep 10 20:57:54.019073 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:54.019033    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:54.101286 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:54.101253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:54.292025 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:54.291943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:54.547080 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:54.546993    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:54.627758 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:54.627723    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:54.746272 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:54.746234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:55.455400 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.455363    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:55.778097 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778023    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"]
Sep 10 20:57:55.778380 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778367    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2322d19e-6e90-4406-97c5-929dcee6cc62" containerName="istio-proxy"
Sep 10 20:57:55.778434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778381    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2322d19e-6e90-4406-97c5-929dcee6cc62" containerName="istio-proxy"
Sep 10 20:57:55.778434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778398    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy"
Sep 10 20:57:55.778434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778403    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy"
Sep 10 20:57:55.778434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778411    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy"
Sep 10 20:57:55.778434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778418    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy"
Sep 10 20:57:55.778434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778428    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy"
Sep 10 20:57:55.778434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778434    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778447    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b648fc7-38fa-4fea-957f-885f381ee0e9" containerName="maas-api"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778452    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b648fc7-38fa-4fea-957f-885f381ee0e9" containerName="maas-api"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778461    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd8e332-2a25-4d12-822e-6d9dccb44ffb" containerName="payload-pre-processing"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778466    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd8e332-2a25-4d12-822e-6d9dccb44ffb" containerName="payload-pre-processing"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778527    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778536    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778543    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd8e332-2a25-4d12-822e-6d9dccb44ffb" containerName="payload-pre-processing"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778551    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2322d19e-6e90-4406-97c5-929dcee6cc62" containerName="istio-proxy"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778560    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11bceecb-fdb8-4afe-bffe-e90d9b224549" containerName="istio-proxy"
Sep 10 20:57:55.778711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.778569    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b648fc7-38fa-4fea-957f-885f381ee0e9" containerName="maas-api"
Sep 10 20:57:55.783146 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.783123    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.788086 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.788068    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-cd89ac-openshift-default-dockercfg-pgbqc\""
Sep 10 20:57:55.801091 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.801060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"]
Sep 10 20:57:55.825409 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.825366    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:55.883933 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.883897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istiod-ca-cert\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.884132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.884115    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-envoy\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.884295 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.884268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncblp\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-kube-api-access-ncblp\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.884432 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.884302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-token\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.884432 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.884390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-certs\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.884432 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.884423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-podinfo\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.884606 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.884442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-data\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.884606 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.884546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-credential-socket\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.884606 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.884575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-socket\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986055 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-credential-socket\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986055 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-socket\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istiod-ca-cert\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-envoy\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncblp\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-kube-api-access-ncblp\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986154    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-token\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-certs\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-podinfo\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986250    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-data\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986696 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-credential-socket\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986696 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986594    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-socket\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986821 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-data\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986894 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-certs\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.986974 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.986952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istiod-ca-cert\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.988609 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.988588    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-envoy\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:55.989065 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:55.989044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-podinfo\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:56.007529 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:56.007503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-token\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:56.023497 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:56.023466    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncblp\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-kube-api-access-ncblp\") pod \"e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") " pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:56.092891 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:56.092780    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:56.272290 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:56.272253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:56.394959 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:56.394776    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"]
Sep 10 20:57:56.397676 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:57:56.397648    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0794470_e9b7_4311_9fa9_1aab7964fb7d.slice/crio-2eb19bc607ee374f5452f6b37422a826f88b3f60daec50276fcdc2348cd0df4a WatchSource:0}: Error finding container 2eb19bc607ee374f5452f6b37422a826f88b3f60daec50276fcdc2348cd0df4a: Status 404 returned error can't find the container with id 2eb19bc607ee374f5452f6b37422a826f88b3f60daec50276fcdc2348cd0df4a
Sep 10 20:57:56.399964 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:56.399925    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:57:56.400021 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:56.400003    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:57:56.400065 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:56.400032    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:57:57.212999 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:57.212958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" event={"ID":"d0794470-e9b7-4311-9fa9-1aab7964fb7d","Type":"ContainerStarted","Data":"85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f"}
Sep 10 20:57:57.213547 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:57.213017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" event={"ID":"d0794470-e9b7-4311-9fa9-1aab7964fb7d","Type":"ContainerStarted","Data":"2eb19bc607ee374f5452f6b37422a826f88b3f60daec50276fcdc2348cd0df4a"}
Sep 10 20:57:57.245963 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:57.245911    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" podStartSLOduration=2.245892299 podStartE2EDuration="2.245892299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:57.244458455 +0000 UTC m=+1302.281359969" watchObservedRunningTime="2026-09-10 20:57:57.245892299 +0000 UTC m=+1302.282793812"
Sep 10 20:57:58.093688 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:58.093651    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:58.098557 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:58.098533    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:58.217904 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:58.217874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:58.218851 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:58.218831    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:57:59.220499 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:59.220449    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:57:59.316477 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:57:59.316428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:00.434945 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:00.434910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:00.566441 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:00.566408    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:00.659993 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:00.659958    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:01.135853 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:01.135818    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:01.226882 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:01.226851    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:04.822936 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:04.822897    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:05.784120 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:05.784089    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"]
Sep 10 20:58:05.784348 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:05.784289    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n" podUID="ef77290d-42fd-410f-9149-fa922334a7b2" containerName="maas-api" containerID="cri-o://85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71" gracePeriod=30
Sep 10 20:58:05.866785 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:05.866752    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:05.961673 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:05.961640    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"]
Sep 10 20:58:05.961918 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:05.961892    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt" podUID="268b41a8-e723-4fa2-a176-cd7abf86a74c" containerName="payload-pre-processing" containerID="cri-o://021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71" gracePeriod=30
Sep 10 20:58:05.990989 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:05.990929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:06.091837 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.091810    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:58:06.094367 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.094311    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:06.189622 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.189592    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77290d-42fd-410f-9149-fa922334a7b2-openshift-service-ca\") pod \"ef77290d-42fd-410f-9149-fa922334a7b2\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") "
Sep 10 20:58:06.189824 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.189681    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-maas-api-tls\") pod \"ef77290d-42fd-410f-9149-fa922334a7b2\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") "
Sep 10 20:58:06.189824 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.189704    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-metrics-certs\") pod \"ef77290d-42fd-410f-9149-fa922334a7b2\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") "
Sep 10 20:58:06.189824 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.189726    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w5ck\" (UniqueName: \"kubernetes.io/projected/ef77290d-42fd-410f-9149-fa922334a7b2-kube-api-access-4w5ck\") pod \"ef77290d-42fd-410f-9149-fa922334a7b2\" (UID: \"ef77290d-42fd-410f-9149-fa922334a7b2\") "
Sep 10 20:58:06.190080 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.190037    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef77290d-42fd-410f-9149-fa922334a7b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef77290d-42fd-410f-9149-fa922334a7b2" (UID: "ef77290d-42fd-410f-9149-fa922334a7b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:58:06.192505 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.192475    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef77290d-42fd-410f-9149-fa922334a7b2-kube-api-access-4w5ck" (OuterVolumeSpecName: "kube-api-access-4w5ck") pod "ef77290d-42fd-410f-9149-fa922334a7b2" (UID: "ef77290d-42fd-410f-9149-fa922334a7b2"). InnerVolumeSpecName "kube-api-access-4w5ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:58:06.194390 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.194362    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ef77290d-42fd-410f-9149-fa922334a7b2" (UID: "ef77290d-42fd-410f-9149-fa922334a7b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:58:06.194486 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.194373    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef77290d-42fd-410f-9149-fa922334a7b2" (UID: "ef77290d-42fd-410f-9149-fa922334a7b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 20:58:06.245721 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.245672    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:58:06.257357 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.257322    2579 generic.go:356] "Generic (PLEG): container finished" podID="ef77290d-42fd-410f-9149-fa922334a7b2" containerID="85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71" exitCode=0
Sep 10 20:58:06.257559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.257365    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"
Sep 10 20:58:06.257559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.257402    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n" event={"ID":"ef77290d-42fd-410f-9149-fa922334a7b2","Type":"ContainerDied","Data":"85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71"}
Sep 10 20:58:06.257559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.257457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n" event={"ID":"ef77290d-42fd-410f-9149-fa922334a7b2","Type":"ContainerDied","Data":"084e69c520b82ba5f818de716753198f031745ca31d5e9be6b2759a5aa3f0cc6"}
Sep 10 20:58:06.257559 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.257480    2579 scope.go:117] "RemoveContainer" containerID="85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71"
Sep 10 20:58:06.259032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.259009    2579 generic.go:356] "Generic (PLEG): container finished" podID="268b41a8-e723-4fa2-a176-cd7abf86a74c" containerID="021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71" exitCode=0
Sep 10 20:58:06.259153 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.259055    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"
Sep 10 20:58:06.259153 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.259055    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt" event={"ID":"268b41a8-e723-4fa2-a176-cd7abf86a74c","Type":"ContainerDied","Data":"021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71"}
Sep 10 20:58:06.259269 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.259201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt" event={"ID":"268b41a8-e723-4fa2-a176-cd7abf86a74c","Type":"ContainerDied","Data":"5b3c0ac40ed15715b588efae5019ac219e630b5e36780f7965f24cc04525e94d"}
Sep 10 20:58:06.267483 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.267465    2579 scope.go:117] "RemoveContainer" containerID="85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71"
Sep 10 20:58:06.267801 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:58:06.267781    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71\": container with ID starting with 85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71 not found: ID does not exist" containerID="85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71"
Sep 10 20:58:06.267882 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.267815    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71"} err="failed to get container status \"85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71\": rpc error: code = NotFound desc = could not find container \"85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71\": container with ID starting with 85aa172137756d660ff34258b0aa62fa5eb4f3fa73aa96849278436316217f71 not found: ID does not exist"
Sep 10 20:58:06.267882 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.267839    2579 scope.go:117] "RemoveContainer" containerID="021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71"
Sep 10 20:58:06.296879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.283893    2579 scope.go:117] "RemoveContainer" containerID="021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71"
Sep 10 20:58:06.296879 ip-10-0-143-160 kubenswrapper[2579]: E0910 20:58:06.284205    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71\": container with ID starting with 021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71 not found: ID does not exist" containerID="021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71"
Sep 10 20:58:06.296879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.284240    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71"} err="failed to get container status \"021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71\": rpc error: code = NotFound desc = could not find container \"021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71\": container with ID starting with 021089af144f5c14909265b6221197adbf0649c4f03a5cf7ebf369bda1496d71 not found: ID does not exist"
Sep 10 20:58:06.296879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.295216    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77290d-42fd-410f-9149-fa922334a7b2-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:58:06.296879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.295243    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:58:06.296879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.295257    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef77290d-42fd-410f-9149-fa922334a7b2-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:58:06.296879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.295333    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w5ck\" (UniqueName: \"kubernetes.io/projected/ef77290d-42fd-410f-9149-fa922334a7b2-kube-api-access-4w5ck\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:58:06.310794 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.310719    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"]
Sep 10 20:58:06.317324 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.317292    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-467fc3-5bf494557d-fxg7n"]
Sep 10 20:58:06.344460 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.343853    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:06.396322 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.396295    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwt74\" (UniqueName: \"kubernetes.io/projected/268b41a8-e723-4fa2-a176-cd7abf86a74c-kube-api-access-dwt74\") pod \"268b41a8-e723-4fa2-a176-cd7abf86a74c\" (UID: \"268b41a8-e723-4fa2-a176-cd7abf86a74c\") "
Sep 10 20:58:06.396503 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.396480    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/268b41a8-e723-4fa2-a176-cd7abf86a74c-plugins-config-volume\") pod \"268b41a8-e723-4fa2-a176-cd7abf86a74c\" (UID: \"268b41a8-e723-4fa2-a176-cd7abf86a74c\") "
Sep 10 20:58:06.396840 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.396815    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/268b41a8-e723-4fa2-a176-cd7abf86a74c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "268b41a8-e723-4fa2-a176-cd7abf86a74c" (UID: "268b41a8-e723-4fa2-a176-cd7abf86a74c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 20:58:06.398347 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.398325    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/268b41a8-e723-4fa2-a176-cd7abf86a74c-kube-api-access-dwt74" (OuterVolumeSpecName: "kube-api-access-dwt74") pod "268b41a8-e723-4fa2-a176-cd7abf86a74c" (UID: "268b41a8-e723-4fa2-a176-cd7abf86a74c"). InnerVolumeSpecName "kube-api-access-dwt74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 20:58:06.430652 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.427476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:06.498162 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.498126    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/268b41a8-e723-4fa2-a176-cd7abf86a74c-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:58:06.498162 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.498154    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwt74\" (UniqueName: \"kubernetes.io/projected/268b41a8-e723-4fa2-a176-cd7abf86a74c-kube-api-access-dwt74\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 20:58:06.592395 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.592363    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"]
Sep 10 20:58:06.600904 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.600877    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt"]
Sep 10 20:58:06.763957 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:06.763921    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:07.487985 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:07.487953    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="268b41a8-e723-4fa2-a176-cd7abf86a74c" path="/var/lib/kubelet/pods/268b41a8-e723-4fa2-a176-cd7abf86a74c/volumes"
Sep 10 20:58:07.488351 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:07.488340    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef77290d-42fd-410f-9149-fa922334a7b2" path="/var/lib/kubelet/pods/ef77290d-42fd-410f-9149-fa922334a7b2/volumes"
Sep 10 20:58:13.616136 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:13.616098    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:13.719467 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:13.719435    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:13.959323 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:13.959288    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:14.259843 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.259756    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 20:58:14.259996 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.259848    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 20:58:14.444454 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.444418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:14.760599 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.760522    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"]
Sep 10 20:58:14.760975 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.760961    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef77290d-42fd-410f-9149-fa922334a7b2" containerName="maas-api"
Sep 10 20:58:14.761021 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.760978    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef77290d-42fd-410f-9149-fa922334a7b2" containerName="maas-api"
Sep 10 20:58:14.761021 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.761006    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy"
Sep 10 20:58:14.761021 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.761013    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy"
Sep 10 20:58:14.761132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.761030    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268b41a8-e723-4fa2-a176-cd7abf86a74c" containerName="payload-pre-processing"
Sep 10 20:58:14.761132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.761039    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="268b41a8-e723-4fa2-a176-cd7abf86a74c" containerName="payload-pre-processing"
Sep 10 20:58:14.761132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.761104    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d96bb02c-543b-441a-8b02-de400ce96ef4" containerName="istio-proxy"
Sep 10 20:58:14.761132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.761117    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef77290d-42fd-410f-9149-fa922334a7b2" containerName="maas-api"
Sep 10 20:58:14.761132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.761127    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="268b41a8-e723-4fa2-a176-cd7abf86a74c" containerName="payload-pre-processing"
Sep 10 20:58:14.763246 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.763193    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.766475 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.766457    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-3fc2b8-openshift-default-dockercfg-47h2b\""
Sep 10 20:58:14.780100 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.780078    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"]
Sep 10 20:58:14.798763 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.798729    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:14.877716 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.877673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-podinfo\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.877947 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.877732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-envoy\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.877947 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.877788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-certs\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.877947 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.877824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-socket\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.877947 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.877868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-token\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.877947 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.877924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22k97\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-kube-api-access-22k97\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.878153 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.877953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istiod-ca-cert\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.878153 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.877981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-credential-socket\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.878153 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.878020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-data\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.978749 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.978715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-socket\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.978917 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.978760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-token\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.978917 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.978868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22k97\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-kube-api-access-22k97\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.978917 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.978901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istiod-ca-cert\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979078 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.978926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-credential-socket\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979078 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.978972    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-data\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979078 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.979026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-podinfo\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979078 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.979057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-envoy\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979274 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.979095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-certs\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979274 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.979174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-socket\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979358 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.979318    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-credential-socket\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979403 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.979370    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-data\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979589 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.979563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istiod-ca-cert\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.979715 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.979663    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-certs\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.981364 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.981335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-envoy\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.981697 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.981677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-podinfo\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.990242 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.990222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-token\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:14.991190 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:14.991169    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22k97\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-kube-api-access-22k97\") pod \"e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") " pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:15.073687 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.073608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:15.089959 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.089931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:15.311534 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.311504    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerID="85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f" exitCode=0
Sep 10 20:58:15.311729 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.311558    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" event={"ID":"d0794470-e9b7-4311-9fa9-1aab7964fb7d","Type":"ContainerDied","Data":"85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f"}
Sep 10 20:58:15.311961 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.311947    2579 scope.go:117] "RemoveContainer" containerID="85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f"
Sep 10 20:58:15.312989 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.312958    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:58:15.313055 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.313029    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:58:15.313091 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.313060    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:58:15.373445 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.373404    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"]
Sep 10 20:58:15.375466 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:58:15.375443    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dcfc00c_361d_4a8a_b172_9ab211484ba0.slice/crio-b573e83147897dc254109b8aad919e9526fdd30085f87843d3543443f03d9318 WatchSource:0}: Error finding container b573e83147897dc254109b8aad919e9526fdd30085f87843d3543443f03d9318: Status 404 returned error can't find the container with id b573e83147897dc254109b8aad919e9526fdd30085f87843d3543443f03d9318
Sep 10 20:58:15.378269 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.378233    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:58:15.378353 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.378308    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:58:15.378392 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:15.378354    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:58:16.318590 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:16.318546    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" event={"ID":"d0794470-e9b7-4311-9fa9-1aab7964fb7d","Type":"ContainerStarted","Data":"50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8"}
Sep 10 20:58:16.321799 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:16.321765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" event={"ID":"2dcfc00c-361d-4a8a-b172-9ab211484ba0","Type":"ContainerStarted","Data":"16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3"}
Sep 10 20:58:16.321941 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:16.321822    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" event={"ID":"2dcfc00c-361d-4a8a-b172-9ab211484ba0","Type":"ContainerStarted","Data":"b573e83147897dc254109b8aad919e9526fdd30085f87843d3543443f03d9318"}
Sep 10 20:58:16.391904 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:16.391849    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" podStartSLOduration=2.39183271 podStartE2EDuration="2.39183271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:16.391721623 +0000 UTC m=+1321.428623137" watchObservedRunningTime="2026-09-10 20:58:16.39183271 +0000 UTC m=+1321.428734222"
Sep 10 20:58:17.074359 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:17.074324    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:17.079154 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:17.079129    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:17.093467 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:17.093446    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:58:17.093618 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:17.093600    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 20:58:17.093684 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:17.093671    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 20:58:17.348444 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:17.348337    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:17.349971 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:17.349943    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:18.094048 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:18.094012    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 20:58:18.094222 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:18.094089    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 20:58:18.452532 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:18.452497    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:18.539301 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:18.539261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:19.093512 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:19.093473    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 20:58:19.093752 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:19.093557    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 20:58:19.845742 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:19.845706    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:19.949333 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:19.949296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:20.094177 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.094140    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 20:58:20.094378 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.094211    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 20:58:20.200225 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.200191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:20.615549 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.615457    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:20.696223 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.696184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:20.810586 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.810549    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"]
Sep 10 20:58:20.815638 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.815610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:20.819099 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.819071    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-3fc2b8\""
Sep 10 20:58:20.819215 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.819119    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-3fc2b8-dockercfg-hfzcr\""
Sep 10 20:58:20.825594 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.825570    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"]
Sep 10 20:58:20.867229 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.867147    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"]
Sep 10 20:58:20.870835 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.870810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:20.883294 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.883269    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"]
Sep 10 20:58:20.942803 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.942765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8xwv\" (UniqueName: \"kubernetes.io/projected/f8d61787-97aa-4696-a2ee-2de85ddc79c8-kube-api-access-p8xwv\") pod \"payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg\" (UID: \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:20.943160 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:20.943139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d61787-97aa-4696-a2ee-2de85ddc79c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg\" (UID: \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:21.044346 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.044298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5a5919-7631-48cf-917c-be6c9d0c772f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk\" (UID: \"4f5a5919-7631-48cf-917c-be6c9d0c772f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:21.044516 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.044366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kr7q\" (UniqueName: \"kubernetes.io/projected/4f5a5919-7631-48cf-917c-be6c9d0c772f-kube-api-access-6kr7q\") pod \"payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk\" (UID: \"4f5a5919-7631-48cf-917c-be6c9d0c772f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:21.044516 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.044415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d61787-97aa-4696-a2ee-2de85ddc79c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg\" (UID: \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:21.044516 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.044472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8xwv\" (UniqueName: \"kubernetes.io/projected/f8d61787-97aa-4696-a2ee-2de85ddc79c8-kube-api-access-p8xwv\") pod \"payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg\" (UID: \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:21.045564 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.045536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d61787-97aa-4696-a2ee-2de85ddc79c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg\" (UID: \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:21.055288 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.055257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8xwv\" (UniqueName: \"kubernetes.io/projected/f8d61787-97aa-4696-a2ee-2de85ddc79c8-kube-api-access-p8xwv\") pod \"payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg\" (UID: \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:21.094009 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.093980    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 20:58:21.094118 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.094024    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 20:58:21.133014 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.132940    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:21.145528 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.145488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5a5919-7631-48cf-917c-be6c9d0c772f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk\" (UID: \"4f5a5919-7631-48cf-917c-be6c9d0c772f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:21.145761 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.145737    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kr7q\" (UniqueName: \"kubernetes.io/projected/4f5a5919-7631-48cf-917c-be6c9d0c772f-kube-api-access-6kr7q\") pod \"payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk\" (UID: \"4f5a5919-7631-48cf-917c-be6c9d0c772f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:21.146561 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.146536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5a5919-7631-48cf-917c-be6c9d0c772f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk\" (UID: \"4f5a5919-7631-48cf-917c-be6c9d0c772f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:21.156620 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.156591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kr7q\" (UniqueName: \"kubernetes.io/projected/4f5a5919-7631-48cf-917c-be6c9d0c772f-kube-api-access-6kr7q\") pod \"payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk\" (UID: \"4f5a5919-7631-48cf-917c-be6c9d0c772f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:21.184551 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.184061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:21.414007 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.413978    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"]
Sep 10 20:58:21.415767 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:58:21.415739    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d61787_97aa_4696_a2ee_2de85ddc79c8.slice/crio-48b53a1215f7f669a503ba746bc81bc650947306f8a5229d4482dd836d568efc WatchSource:0}: Error finding container 48b53a1215f7f669a503ba746bc81bc650947306f8a5229d4482dd836d568efc: Status 404 returned error can't find the container with id 48b53a1215f7f669a503ba746bc81bc650947306f8a5229d4482dd836d568efc
Sep 10 20:58:21.470527 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.470501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"]
Sep 10 20:58:21.473197 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:58:21.473168    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5a5919_7631_48cf_917c_be6c9d0c772f.slice/crio-c29a2c6c4eb99be6ce065e6170678766cbfe14cc2a223e349df853310d6b9cfc WatchSource:0}: Error finding container c29a2c6c4eb99be6ce065e6170678766cbfe14cc2a223e349df853310d6b9cfc: Status 404 returned error can't find the container with id c29a2c6c4eb99be6ce065e6170678766cbfe14cc2a223e349df853310d6b9cfc
Sep 10 20:58:21.785995 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:21.785910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:22.098034 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.097951    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:58:22.098470 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.098367    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:58:22.099066 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.099045    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 20:58:22.373242 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.373143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg" event={"ID":"f8d61787-97aa-4696-a2ee-2de85ddc79c8","Type":"ContainerStarted","Data":"0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907"}
Sep 10 20:58:22.373242 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.373210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg" event={"ID":"f8d61787-97aa-4696-a2ee-2de85ddc79c8","Type":"ContainerStarted","Data":"48b53a1215f7f669a503ba746bc81bc650947306f8a5229d4482dd836d568efc"}
Sep 10 20:58:22.373242 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.373241    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:22.374873 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.374847    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk" event={"ID":"4f5a5919-7631-48cf-917c-be6c9d0c772f","Type":"ContainerStarted","Data":"1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db"}
Sep 10 20:58:22.375005 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.374887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk" event={"ID":"4f5a5919-7631-48cf-917c-be6c9d0c772f","Type":"ContainerStarted","Data":"c29a2c6c4eb99be6ce065e6170678766cbfe14cc2a223e349df853310d6b9cfc"}
Sep 10 20:58:22.375005 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.374996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:22.395238 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.395183    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg" podStartSLOduration=2.39516501 podStartE2EDuration="2.39516501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:22.394476866 +0000 UTC m=+1327.431378384" watchObservedRunningTime="2026-09-10 20:58:22.39516501 +0000 UTC m=+1327.432066524"
Sep 10 20:58:22.427776 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.427736    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk" podStartSLOduration=2.427717086 podStartE2EDuration="2.427717086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:22.425773328 +0000 UTC m=+1327.462674846" watchObservedRunningTime="2026-09-10 20:58:22.427717086 +0000 UTC m=+1327.464618598"
Sep 10 20:58:22.859540 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:22.859500    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:23.827411 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:23.827379    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:24.105993 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:24.105902    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:24.463974 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:24.463944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:24.945743 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:24.945707    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:25.042439 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:25.042405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:26.886954 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:26.886914    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:28.081579 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:28.081541    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:28.164046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:28.164016    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:29.536602 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:29.536568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:29.635356 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:29.635319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:30.373749 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.373718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:30.524176 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.524080    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:30.696434 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.696401    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"]
Sep 10 20:58:30.701276 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.701252    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:30.708963 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.708909    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-3bbb40\""
Sep 10 20:58:30.710088 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.710068    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-3bbb40-dockercfg-dztbh\""
Sep 10 20:58:30.720703 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.720674    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"]
Sep 10 20:58:30.745132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.744978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bc491ee-9692-4acb-be14-68d1535cffd2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6\" (UID: \"6bc491ee-9692-4acb-be14-68d1535cffd2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:30.745132 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.745030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj8l6\" (UniqueName: \"kubernetes.io/projected/6bc491ee-9692-4acb-be14-68d1535cffd2-kube-api-access-xj8l6\") pod \"payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6\" (UID: \"6bc491ee-9692-4acb-be14-68d1535cffd2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:30.846723 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.846610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bc491ee-9692-4acb-be14-68d1535cffd2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6\" (UID: \"6bc491ee-9692-4acb-be14-68d1535cffd2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:30.846723 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.846677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj8l6\" (UniqueName: \"kubernetes.io/projected/6bc491ee-9692-4acb-be14-68d1535cffd2-kube-api-access-xj8l6\") pod \"payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6\" (UID: \"6bc491ee-9692-4acb-be14-68d1535cffd2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:30.847392 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.847368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bc491ee-9692-4acb-be14-68d1535cffd2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6\" (UID: \"6bc491ee-9692-4acb-be14-68d1535cffd2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:30.861534 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:30.861501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj8l6\" (UniqueName: \"kubernetes.io/projected/6bc491ee-9692-4acb-be14-68d1535cffd2-kube-api-access-xj8l6\") pod \"payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6\" (UID: \"6bc491ee-9692-4acb-be14-68d1535cffd2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:31.013794 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:31.013752    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:31.300096 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:31.300060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"]
Sep 10 20:58:31.301327 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:58:31.301301    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc491ee_9692_4acb_be14_68d1535cffd2.slice/crio-ffd9723e823d095b167d17a1333a8c2c5b398295c106cf046f845e7ad8017062 WatchSource:0}: Error finding container ffd9723e823d095b167d17a1333a8c2c5b398295c106cf046f845e7ad8017062: Status 404 returned error can't find the container with id ffd9723e823d095b167d17a1333a8c2c5b398295c106cf046f845e7ad8017062
Sep 10 20:58:31.427679 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:31.427622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6" event={"ID":"6bc491ee-9692-4acb-be14-68d1535cffd2","Type":"ContainerStarted","Data":"3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277"}
Sep 10 20:58:31.427851 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:31.427708    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:31.427851 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:31.427732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6" event={"ID":"6bc491ee-9692-4acb-be14-68d1535cffd2","Type":"ContainerStarted","Data":"ffd9723e823d095b167d17a1333a8c2c5b398295c106cf046f845e7ad8017062"}
Sep 10 20:58:31.457295 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:31.457242    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6" podStartSLOduration=1.457223752 podStartE2EDuration="1.457223752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:31.45585869 +0000 UTC m=+1336.492760200" watchObservedRunningTime="2026-09-10 20:58:31.457223752 +0000 UTC m=+1336.494125256"
Sep 10 20:58:33.244838 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.244000    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:37918->10.134.0.55:15021: read: connection reset by peer" start-of-body=
Sep 10 20:58:33.244838 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.244126    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:37918->10.134.0.55:15021: read: connection reset by peer"
Sep 10 20:58:33.382540 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.382510    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 20:58:33.382747 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.382580    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 20:58:33.441592 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.441513    2579 generic.go:356] "Generic (PLEG): container finished" podID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerID="16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3" exitCode=0
Sep 10 20:58:33.441592 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.441564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" event={"ID":"2dcfc00c-361d-4a8a-b172-9ab211484ba0","Type":"ContainerDied","Data":"16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3"}
Sep 10 20:58:33.442111 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.442094    2579 scope.go:117] "RemoveContainer" containerID="16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3"
Sep 10 20:58:33.443409 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.443379    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:58:33.443524 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.443455    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:58:33.443524 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:33.443498    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:58:34.449856 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:34.449818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" event={"ID":"2dcfc00c-361d-4a8a-b172-9ab211484ba0","Type":"ContainerStarted","Data":"e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba"}
Sep 10 20:58:35.074128 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:35.074090    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:35.074327 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:35.074304    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:58:35.074404 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:35.074365    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 20:58:36.074058 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:36.074023    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:58:36.074444 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:36.074073    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 20:58:37.074613 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:37.074573    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:58:37.075171 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:37.074660    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 20:58:38.074684 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:38.074586    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:58:38.074684 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:38.074657    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 20:58:39.074792 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:39.074752    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 20:58:39.075182 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:39.074824    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 20:58:40.077809 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:40.077778    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:40.078198 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:40.078036    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:40.078714 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:40.078697    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 20:58:41.345496 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:41.345454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:42.436256 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:42.436229    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 20:58:43.325804 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:43.325768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:43.668874 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:43.668834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:43.994032 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:43.993939    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:44.526656 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:44.526609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:47.016588 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:47.016557    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:47.114781 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:47.114737    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.186585 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:48.186551    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.287879 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:48.287846    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.742823 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:48.742796    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.842556 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:48.842527    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.934765 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:48.934734    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"]
Sep 10 20:58:48.938423 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:48.938406    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:58:48.941715 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:48.941697    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-f4fe4f-dockercfg-sqpnr\""
Sep 10 20:58:48.942086 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:48.942072    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-f4fe4f\""
Sep 10 20:58:48.950418 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:48.950395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"]
Sep 10 20:58:49.030280 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:49.030200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/278626a8-a86c-4ef8-bdb9-73e20ef08a23-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc\" (UID: \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:58:49.030280 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:49.030256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx7cg\" (UniqueName: \"kubernetes.io/projected/278626a8-a86c-4ef8-bdb9-73e20ef08a23-kube-api-access-gx7cg\") pod \"payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc\" (UID: \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:58:49.090890 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:49.090855    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:49.131200 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:49.131161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/278626a8-a86c-4ef8-bdb9-73e20ef08a23-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc\" (UID: \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:58:49.131381 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:49.131332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx7cg\" (UniqueName: \"kubernetes.io/projected/278626a8-a86c-4ef8-bdb9-73e20ef08a23-kube-api-access-gx7cg\") pod \"payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc\" (UID: \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:58:49.131928 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:49.131905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/278626a8-a86c-4ef8-bdb9-73e20ef08a23-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc\" (UID: \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:58:49.142318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:49.142288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx7cg\" (UniqueName: \"kubernetes.io/projected/278626a8-a86c-4ef8-bdb9-73e20ef08a23-kube-api-access-gx7cg\") pod \"payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc\" (UID: \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:58:49.248564 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:49.248532    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:58:49.524108 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:49.524075    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"]
Sep 10 20:58:49.525678 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:58:49.525649    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278626a8_a86c_4ef8_bdb9_73e20ef08a23.slice/crio-3a6623316330f0452f830af030a3a35bce2f89534686ad93800e2e97db179fa0 WatchSource:0}: Error finding container 3a6623316330f0452f830af030a3a35bce2f89534686ad93800e2e97db179fa0: Status 404 returned error can't find the container with id 3a6623316330f0452f830af030a3a35bce2f89534686ad93800e2e97db179fa0
Sep 10 20:58:50.534829 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:50.534795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc" event={"ID":"278626a8-a86c-4ef8-bdb9-73e20ef08a23","Type":"ContainerStarted","Data":"3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde"}
Sep 10 20:58:50.535264 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:50.534870    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc" event={"ID":"278626a8-a86c-4ef8-bdb9-73e20ef08a23","Type":"ContainerStarted","Data":"3a6623316330f0452f830af030a3a35bce2f89534686ad93800e2e97db179fa0"}
Sep 10 20:58:50.535264 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:50.534944    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:58:50.557638 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:50.557589    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc" podStartSLOduration=2.557575958 podStartE2EDuration="2.557575958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:50.555271795 +0000 UTC m=+1355.592173309" watchObservedRunningTime="2026-09-10 20:58:50.557575958 +0000 UTC m=+1355.594477471"
Sep 10 20:58:51.055362 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:51.055327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:52.904822 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:58:52.904791    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:01.544312 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:01.544281    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 20:59:02.222645 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.222599    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:02.568063 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.567985    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"]
Sep 10 20:59:02.572921 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.572903    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.575992 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.575974    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3d4d0c56-openshift-default-dockercfg-wjbv5\""
Sep 10 20:59:02.594496 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.594438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:02.597154 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.597130    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"]
Sep 10 20:59:02.655651 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.655603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istiod-ca-cert\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.655802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.655700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-credential-socket\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.655802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.655747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-socket\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.655802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.655776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-podinfo\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.655802 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.655800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9cj\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-kube-api-access-7j9cj\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.656004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.655845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-envoy\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.656004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.655873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-data\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.656004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.655892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-certs\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.656004 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.655916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-token\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.696006 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.695974    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:02.756573 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.756535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-podinfo\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.756573 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.756576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9cj\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-kube-api-access-7j9cj\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.756841 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.756594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-envoy\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.756841 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.756706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-data\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.756841 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.756759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-certs\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.756841 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.756787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-token\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.756841 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.756825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istiod-ca-cert\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.757120 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.756907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-credential-socket\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.757120 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.756990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-socket\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.757221 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.757169    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-certs\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.757344 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.757327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-data\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.757417 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.757331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-credential-socket\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.757482 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.757438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-socket\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.757790 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.757766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istiod-ca-cert\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.759095 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.759065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-envoy\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.759209 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.759147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-podinfo\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.772261 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.772234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9cj\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-kube-api-access-7j9cj\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.772711 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.772687    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-token\") pod \"e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") " pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:02.883599 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:02.883513    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:03.173082 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:03.173048    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"]
Sep 10 20:59:03.178595 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:59:03.176495    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d9772f_2dc9_4529_9d8e_d56841bc06f3.slice/crio-0242c915ea1bad815978b2edb91ba35227c43c4cceadd9d26fde275d6a8a465e WatchSource:0}: Error finding container 0242c915ea1bad815978b2edb91ba35227c43c4cceadd9d26fde275d6a8a465e: Status 404 returned error can't find the container with id 0242c915ea1bad815978b2edb91ba35227c43c4cceadd9d26fde275d6a8a465e
Sep 10 20:59:03.180539 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:03.180506    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:59:03.180619 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:03.180576    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:59:03.180619 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:03.180604    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:59:03.603172 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:03.603075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" event={"ID":"c7d9772f-2dc9-4529-9d8e-d56841bc06f3","Type":"ContainerStarted","Data":"9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4"}
Sep 10 20:59:03.603172 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:03.603129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" event={"ID":"c7d9772f-2dc9-4529-9d8e-d56841bc06f3","Type":"ContainerStarted","Data":"0242c915ea1bad815978b2edb91ba35227c43c4cceadd9d26fde275d6a8a465e"}
Sep 10 20:59:03.884268 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:03.884181    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:04.889587 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:04.889558    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:04.926069 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:04.926014    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" podStartSLOduration=2.925996831 podStartE2EDuration="2.925996831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:03.643309488 +0000 UTC m=+1368.680211001" watchObservedRunningTime="2026-09-10 20:59:04.925996831 +0000 UTC m=+1369.962898343"
Sep 10 20:59:05.612661 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:05.612635    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:05.613689 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:05.613670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:05.689125 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:05.689092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:05.821607 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:05.821573    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:07.074734 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:07.074685    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:07.177215 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:07.177179    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:07.428437 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:07.428394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:08.065887 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.065856    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:08.193308 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.193267    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:08.370329 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.370257    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"]
Sep 10 20:59:08.374877 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.374859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:08.380876 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.380854    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3d4d0c56\""
Sep 10 20:59:08.381720 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.381697    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3d4d0c56-dockercfg-kzrjr\""
Sep 10 20:59:08.391572 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.391551    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"]
Sep 10 20:59:08.410888 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.410852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smpp\" (UniqueName: \"kubernetes.io/projected/a157d10b-9c76-4fbf-8426-1e0e17719a18-kube-api-access-4smpp\") pod \"payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76\" (UID: \"a157d10b-9c76-4fbf-8426-1e0e17719a18\") " pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:08.411000 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.410946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a157d10b-9c76-4fbf-8426-1e0e17719a18-plugins-config-volume\") pod \"payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76\" (UID: \"a157d10b-9c76-4fbf-8426-1e0e17719a18\") " pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:08.512258 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.512225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smpp\" (UniqueName: \"kubernetes.io/projected/a157d10b-9c76-4fbf-8426-1e0e17719a18-kube-api-access-4smpp\") pod \"payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76\" (UID: \"a157d10b-9c76-4fbf-8426-1e0e17719a18\") " pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:08.512457 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.512303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a157d10b-9c76-4fbf-8426-1e0e17719a18-plugins-config-volume\") pod \"payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76\" (UID: \"a157d10b-9c76-4fbf-8426-1e0e17719a18\") " pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:08.513036 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.513014    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a157d10b-9c76-4fbf-8426-1e0e17719a18-plugins-config-volume\") pod \"payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76\" (UID: \"a157d10b-9c76-4fbf-8426-1e0e17719a18\") " pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:08.524156 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.524125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smpp\" (UniqueName: \"kubernetes.io/projected/a157d10b-9c76-4fbf-8426-1e0e17719a18-kube-api-access-4smpp\") pod \"payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76\" (UID: \"a157d10b-9c76-4fbf-8426-1e0e17719a18\") " pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:08.685511 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:08.685476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:09.009291 ip-10-0-143-160 kubenswrapper[2579]: W0910 20:59:09.009256    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda157d10b_9c76_4fbf_8426_1e0e17719a18.slice/crio-98d7f9aa7ee42def721d6a30c813f632c865137630c66eb09f9985ff8f29def5 WatchSource:0}: Error finding container 98d7f9aa7ee42def721d6a30c813f632c865137630c66eb09f9985ff8f29def5: Status 404 returned error can't find the container with id 98d7f9aa7ee42def721d6a30c813f632c865137630c66eb09f9985ff8f29def5
Sep 10 20:59:09.012268 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:09.012147    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"]
Sep 10 20:59:09.633221 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:09.633180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76" event={"ID":"a157d10b-9c76-4fbf-8426-1e0e17719a18","Type":"ContainerStarted","Data":"1fa834ee81edbd26f031b2d81f2ce190bbbc8f55838ce3760ff4c62f2eda37c2"}
Sep 10 20:59:09.633686 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:09.633252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76" event={"ID":"a157d10b-9c76-4fbf-8426-1e0e17719a18","Type":"ContainerStarted","Data":"98d7f9aa7ee42def721d6a30c813f632c865137630c66eb09f9985ff8f29def5"}
Sep 10 20:59:09.633686 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:09.633284    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:09.665273 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:09.665222    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76" podStartSLOduration=1.6652083420000001 podStartE2EDuration="1.665208342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:09.661943163 +0000 UTC m=+1374.698844675" watchObservedRunningTime="2026-09-10 20:59:09.665208342 +0000 UTC m=+1374.702109855"
Sep 10 20:59:09.936812 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:09.936771    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:11.128330 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:11.128298    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:11.976333 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:11.976298    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.075467 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:12.075433    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:18.750880 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:18.750840    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:20.642354 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:20.642315    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 20:59:21.159645 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:21.159593    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:21.654810 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:21.654772    2579 patch_prober.go:28] interesting pod/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 20:59:21.655150 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:21.654864    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 20:59:23.708388 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:23.708353    2579 generic.go:356] "Generic (PLEG): container finished" podID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerID="9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4" exitCode=0
Sep 10 20:59:23.708853 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:23.708425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" event={"ID":"c7d9772f-2dc9-4529-9d8e-d56841bc06f3","Type":"ContainerDied","Data":"9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4"}
Sep 10 20:59:23.708901 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:23.708858    2579 scope.go:117] "RemoveContainer" containerID="9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4"
Sep 10 20:59:23.709978 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:23.709951    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:59:23.710038 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:23.710016    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:59:23.710072 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:23.710048    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 20:59:24.715928 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:24.715890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" event={"ID":"c7d9772f-2dc9-4529-9d8e-d56841bc06f3","Type":"ContainerStarted","Data":"59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f"}
Sep 10 20:59:24.884303 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:24.884271    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:24.884524 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:24.884501    2579 patch_prober.go:28] interesting pod/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 20:59:24.884576 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:24.884553    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 20:59:25.883985 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:25.883949    2579 patch_prober.go:28] interesting pod/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 20:59:25.884357 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:25.884002    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 20:59:26.883971 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:26.883929    2579 patch_prober.go:28] interesting pod/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 20:59:26.884157 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:26.883995    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 20:59:27.884842 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:27.884804    2579 patch_prober.go:28] interesting pod/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 20:59:27.885195 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:27.884871    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 20:59:28.884087 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:28.884050    2579 patch_prober.go:28] interesting pod/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 20:59:28.884263 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:28.884128    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 20:59:28.988046 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:28.988005    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:29.884355 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:29.884321    2579 patch_prober.go:28] interesting pod/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 20:59:29.884528 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:29.884377    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 20:59:30.551708 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:30.551657    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:30.887842 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:30.887761    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:30.888151 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:30.888131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:30.888800 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:30.888781    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 20:59:37.028258 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:37.028219    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:37.130318 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:37.130283    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:56.037578 ip-10-0-143-160 kubenswrapper[2579]: I0910 20:59:56.037542    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:00.182001 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.181961    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv"]
Sep 10 21:00:00.186603 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.186579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv"
Sep 10 21:00:00.188675 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.188644    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq"]
Sep 10 21:00:00.191619 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.191599    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plv2h\""
Sep 10 21:00:00.192722 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.192700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq"
Sep 10 21:00:00.197695 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.197671    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv"
Sep 10 21:00:00.205944 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.205925    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq"
Sep 10 21:00:00.210335 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.209094    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv"]
Sep 10 21:00:00.210799 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.210774    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq"]
Sep 10 21:00:00.479079 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.479048    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv"]
Sep 10 21:00:00.480682 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:00:00.480648    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cafba8_aaba_4979_af47_981f6b656b24.slice/crio-caf9c32020642ce1218ebc3a1538729de6f2e0f3ca915a5078642734661620f3 WatchSource:0}: Error finding container caf9c32020642ce1218ebc3a1538729de6f2e0f3ca915a5078642734661620f3: Status 404 returned error can't find the container with id caf9c32020642ce1218ebc3a1538729de6f2e0f3ca915a5078642734661620f3
Sep 10 21:00:00.482738 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.482717    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:00:00.492495 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.492473    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq"]
Sep 10 21:00:00.494054 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:00:00.494031    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a1686c_bc47_455f_94fe_b0850964b074.slice/crio-3d081fd070d08d46693817b29ae7946ef7d949d6c127f1a51a2a88c509de9d8a WatchSource:0}: Error finding container 3d081fd070d08d46693817b29ae7946ef7d949d6c127f1a51a2a88c509de9d8a: Status 404 returned error can't find the container with id 3d081fd070d08d46693817b29ae7946ef7d949d6c127f1a51a2a88c509de9d8a
Sep 10 21:00:00.910779 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.910748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq" event={"ID":"a6a1686c-bc47-455f-94fe-b0850964b074","Type":"ContainerStarted","Data":"3d081fd070d08d46693817b29ae7946ef7d949d6c127f1a51a2a88c509de9d8a"}
Sep 10 21:00:00.912062 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:00.912035    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv" event={"ID":"95cafba8-aaba-4979-af47-981f6b656b24","Type":"ContainerStarted","Data":"caf9c32020642ce1218ebc3a1538729de6f2e0f3ca915a5078642734661620f3"}
Sep 10 21:00:03.929608 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:03.929566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq" event={"ID":"a6a1686c-bc47-455f-94fe-b0850964b074","Type":"ContainerStarted","Data":"25843b48caa3df83cd3287deba8be8261eef80a82883f0ae3bd77c585e41a97a"}
Sep 10 21:00:03.931188 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:03.931164    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv" event={"ID":"95cafba8-aaba-4979-af47-981f6b656b24","Type":"ContainerStarted","Data":"75ee58efac3e63208ac70a2378bbcb28a83981a7cbf407c44d1bf1b7520fd89c"}
Sep 10 21:00:03.949781 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:03.949736    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq" podStartSLOduration=1.055468242 podStartE2EDuration="3.94972121s" totalImagesPullingTime="2.894252968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:00:03.947459795 +0000 UTC m=+1428.984361308" watchObservedRunningTime="2026-09-10 21:00:03.94972121 +0000 UTC m=+1428.986622722"
Sep 10 21:00:03.966971 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:03.966921    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv" podStartSLOduration=1.063266426 podStartE2EDuration="3.966902731s" totalImagesPullingTime="2.903636305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:00:03.96637952 +0000 UTC m=+1429.003281033" watchObservedRunningTime="2026-09-10 21:00:03.966902731 +0000 UTC m=+1429.003804245"
Sep 10 21:00:04.938604 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:04.938572    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6a1686c-bc47-455f-94fe-b0850964b074" containerID="25843b48caa3df83cd3287deba8be8261eef80a82883f0ae3bd77c585e41a97a" exitCode=0
Sep 10 21:00:04.939057 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:04.938658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq" event={"ID":"a6a1686c-bc47-455f-94fe-b0850964b074","Type":"ContainerDied","Data":"25843b48caa3df83cd3287deba8be8261eef80a82883f0ae3bd77c585e41a97a"}
Sep 10 21:00:04.940201 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:04.940181    2579 generic.go:356] "Generic (PLEG): container finished" podID="95cafba8-aaba-4979-af47-981f6b656b24" containerID="75ee58efac3e63208ac70a2378bbcb28a83981a7cbf407c44d1bf1b7520fd89c" exitCode=0
Sep 10 21:00:04.940284 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:04.940259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv" event={"ID":"95cafba8-aaba-4979-af47-981f6b656b24","Type":"ContainerDied","Data":"75ee58efac3e63208ac70a2378bbcb28a83981a7cbf407c44d1bf1b7520fd89c"}
Sep 10 21:00:06.081649 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:06.081598    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq"
Sep 10 21:00:06.120124 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:06.120090    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv"
Sep 10 21:00:06.951524 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:06.951491    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq"
Sep 10 21:00:06.951691 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:06.951484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq" event={"ID":"a6a1686c-bc47-455f-94fe-b0850964b074","Type":"ContainerDied","Data":"3d081fd070d08d46693817b29ae7946ef7d949d6c127f1a51a2a88c509de9d8a"}
Sep 10 21:00:06.951691 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:06.951644    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d081fd070d08d46693817b29ae7946ef7d949d6c127f1a51a2a88c509de9d8a"
Sep 10 21:00:06.952886 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:06.952862    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv"
Sep 10 21:00:06.952974 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:06.952882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv" event={"ID":"95cafba8-aaba-4979-af47-981f6b656b24","Type":"ContainerDied","Data":"caf9c32020642ce1218ebc3a1538729de6f2e0f3ca915a5078642734661620f3"}
Sep 10 21:00:06.952974 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:06.952918    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="caf9c32020642ce1218ebc3a1538729de6f2e0f3ca915a5078642734661620f3"
Sep 10 21:00:13.645906 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:13.645874    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:38.789412 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:38.789375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:47.774727 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:00:47.774696    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:02.012289 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.012210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:02.013165 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.013123    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq"]
Sep 10 21:01:02.015021 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.014995    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3d4d0c56-29817900-85bbq"]
Sep 10 21:01:02.048374 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.048340    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"]
Sep 10 21:01:02.048692 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.048662    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76" podUID="a157d10b-9c76-4fbf-8426-1e0e17719a18" containerName="payload-processing" containerID="cri-o://1fa834ee81edbd26f031b2d81f2ce190bbbc8f55838ce3760ff4c62f2eda37c2" gracePeriod=30
Sep 10 21:01:02.098884 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.098847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:02.167121 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.167086    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:02.228468 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.228441    2579 generic.go:356] "Generic (PLEG): container finished" podID="a157d10b-9c76-4fbf-8426-1e0e17719a18" containerID="1fa834ee81edbd26f031b2d81f2ce190bbbc8f55838ce3760ff4c62f2eda37c2" exitCode=0
Sep 10 21:01:02.228609 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.228506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76" event={"ID":"a157d10b-9c76-4fbf-8426-1e0e17719a18","Type":"ContainerDied","Data":"1fa834ee81edbd26f031b2d81f2ce190bbbc8f55838ce3760ff4c62f2eda37c2"}
Sep 10 21:01:02.269971 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.269890    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:02.330260 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.330232    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 21:01:02.351415 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.351375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:02.424842 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.424812    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a157d10b-9c76-4fbf-8426-1e0e17719a18-plugins-config-volume\") pod \"a157d10b-9c76-4fbf-8426-1e0e17719a18\" (UID: \"a157d10b-9c76-4fbf-8426-1e0e17719a18\") "
Sep 10 21:01:02.425011 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.424861    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4smpp\" (UniqueName: \"kubernetes.io/projected/a157d10b-9c76-4fbf-8426-1e0e17719a18-kube-api-access-4smpp\") pod \"a157d10b-9c76-4fbf-8426-1e0e17719a18\" (UID: \"a157d10b-9c76-4fbf-8426-1e0e17719a18\") "
Sep 10 21:01:02.425267 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.425239    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a157d10b-9c76-4fbf-8426-1e0e17719a18-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a157d10b-9c76-4fbf-8426-1e0e17719a18" (UID: "a157d10b-9c76-4fbf-8426-1e0e17719a18"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:01:02.426967 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.426946    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a157d10b-9c76-4fbf-8426-1e0e17719a18-kube-api-access-4smpp" (OuterVolumeSpecName: "kube-api-access-4smpp") pod "a157d10b-9c76-4fbf-8426-1e0e17719a18" (UID: "a157d10b-9c76-4fbf-8426-1e0e17719a18"). InnerVolumeSpecName "kube-api-access-4smpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:01:02.526134 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.526055    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4smpp\" (UniqueName: \"kubernetes.io/projected/a157d10b-9c76-4fbf-8426-1e0e17719a18-kube-api-access-4smpp\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:02.526134 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:02.526084    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a157d10b-9c76-4fbf-8426-1e0e17719a18-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:03.234926 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:03.234897    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"
Sep 10 21:01:03.235340 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:03.234936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76" event={"ID":"a157d10b-9c76-4fbf-8426-1e0e17719a18","Type":"ContainerDied","Data":"98d7f9aa7ee42def721d6a30c813f632c865137630c66eb09f9985ff8f29def5"}
Sep 10 21:01:03.235340 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:03.235003    2579 scope.go:117] "RemoveContainer" containerID="1fa834ee81edbd26f031b2d81f2ce190bbbc8f55838ce3760ff4c62f2eda37c2"
Sep 10 21:01:03.261909 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:03.261875    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"]
Sep 10 21:01:03.269592 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:03.269491    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76"]
Sep 10 21:01:03.487598 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:03.487517    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a157d10b-9c76-4fbf-8426-1e0e17719a18" path="/var/lib/kubelet/pods/a157d10b-9c76-4fbf-8426-1e0e17719a18/volumes"
Sep 10 21:01:03.487899 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:03.487883    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a1686c-bc47-455f-94fe-b0850964b074" path="/var/lib/kubelet/pods/a6a1686c-bc47-455f-94fe-b0850964b074/volumes"
Sep 10 21:01:05.524344 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:05.524310    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:10.606534 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:10.606500    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:47.801458 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:47.801362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:48.910477 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:48.910439    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:54.042587 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:54.042540    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:54.133917 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:54.133872    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:54.272379 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:54.272346    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"]
Sep 10 21:01:54.287207 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:54.287172    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:54.486247 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:54.486216    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy" containerID="cri-o://59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f" gracePeriod=30
Sep 10 21:01:55.550008 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:55.549977    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:55.648222 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:55.648189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:55.753546 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:55.753507    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:56.398549 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:56.398515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:56.494886 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:56.494849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:56.596104 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:56.596066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:57.914063 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:57.914030    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:59.735436 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.735406    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 21:01:59.880448 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880358    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istiod-ca-cert\") pod \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") "
Sep 10 21:01:59.880448 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880397    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-token\") pod \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") "
Sep 10 21:01:59.880448 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880432    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-data\") pod \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") "
Sep 10 21:01:59.880724 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880484    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-certs\") pod \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") "
Sep 10 21:01:59.880724 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880553    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-credential-socket\") pod \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") "
Sep 10 21:01:59.880724 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880594    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-socket\") pod \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") "
Sep 10 21:01:59.880724 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880623    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j9cj\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-kube-api-access-7j9cj\") pod \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") "
Sep 10 21:01:59.880724 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880696    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-envoy\") pod \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") "
Sep 10 21:01:59.880995 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880748    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-podinfo\") pod \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\" (UID: \"c7d9772f-2dc9-4529-9d8e-d56841bc06f3\") "
Sep 10 21:01:59.880995 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880807    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7d9772f-2dc9-4529-9d8e-d56841bc06f3" (UID: "c7d9772f-2dc9-4529-9d8e-d56841bc06f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:01:59.880995 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880911    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7d9772f-2dc9-4529-9d8e-d56841bc06f3" (UID: "c7d9772f-2dc9-4529-9d8e-d56841bc06f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:01:59.880995 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880927    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7d9772f-2dc9-4529-9d8e-d56841bc06f3" (UID: "c7d9772f-2dc9-4529-9d8e-d56841bc06f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:01:59.880995 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.880945    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7d9772f-2dc9-4529-9d8e-d56841bc06f3" (UID: "c7d9772f-2dc9-4529-9d8e-d56841bc06f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:01:59.881212 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.881077    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7d9772f-2dc9-4529-9d8e-d56841bc06f3" (UID: "c7d9772f-2dc9-4529-9d8e-d56841bc06f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:01:59.881212 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.881162    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:59.881212 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.881177    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:59.881212 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.881187    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:59.881212 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.881195    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:59.881212 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.881204    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:59.883004 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.882978    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7d9772f-2dc9-4529-9d8e-d56841bc06f3" (UID: "c7d9772f-2dc9-4529-9d8e-d56841bc06f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:01:59.883128 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.883037    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7d9772f-2dc9-4529-9d8e-d56841bc06f3" (UID: "c7d9772f-2dc9-4529-9d8e-d56841bc06f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:01:59.883187 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.883140    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7d9772f-2dc9-4529-9d8e-d56841bc06f3" (UID: "c7d9772f-2dc9-4529-9d8e-d56841bc06f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:01:59.883187 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.883148    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-kube-api-access-7j9cj" (OuterVolumeSpecName: "kube-api-access-7j9cj") pod "c7d9772f-2dc9-4529-9d8e-d56841bc06f3" (UID: "c7d9772f-2dc9-4529-9d8e-d56841bc06f3"). InnerVolumeSpecName "kube-api-access-7j9cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:01:59.982713 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.982677    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j9cj\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-kube-api-access-7j9cj\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:59.982713 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.982707    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:59.982713 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.982721    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:01:59.982939 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:01:59.982732    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d9772f-2dc9-4529-9d8e-d56841bc06f3-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:02:00.515729 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.515694    2579 generic.go:356] "Generic (PLEG): container finished" podID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerID="59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f" exitCode=0
Sep 10 21:02:00.515894 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.515740    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"
Sep 10 21:02:00.515894 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.515750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" event={"ID":"c7d9772f-2dc9-4529-9d8e-d56841bc06f3","Type":"ContainerDied","Data":"59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f"}
Sep 10 21:02:00.515894 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.515795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n" event={"ID":"c7d9772f-2dc9-4529-9d8e-d56841bc06f3","Type":"ContainerDied","Data":"0242c915ea1bad815978b2edb91ba35227c43c4cceadd9d26fde275d6a8a465e"}
Sep 10 21:02:00.515894 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.515817    2579 scope.go:117] "RemoveContainer" containerID="59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f"
Sep 10 21:02:00.525321 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.525294    2579 scope.go:117] "RemoveContainer" containerID="9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4"
Sep 10 21:02:00.533284 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.533266    2579 scope.go:117] "RemoveContainer" containerID="59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f"
Sep 10 21:02:00.533555 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:02:00.533539    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f\": container with ID starting with 59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f not found: ID does not exist" containerID="59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f"
Sep 10 21:02:00.533598 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.533563    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f"} err="failed to get container status \"59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f\": rpc error: code = NotFound desc = could not find container \"59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f\": container with ID starting with 59262995cddb5b4e83ec873fc692928cc62c2011607949ff2a25a8a3cf09998f not found: ID does not exist"
Sep 10 21:02:00.533598 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.533582    2579 scope.go:117] "RemoveContainer" containerID="9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4"
Sep 10 21:02:00.533842 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:02:00.533824    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4\": container with ID starting with 9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4 not found: ID does not exist" containerID="9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4"
Sep 10 21:02:00.533882 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.533848    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4"} err="failed to get container status \"9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4\": rpc error: code = NotFound desc = could not find container \"9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4\": container with ID starting with 9fd5b49ca3bc40a09eebf25455db2f44ad1b248dd1913baca928e0d5030d9dc4 not found: ID does not exist"
Sep 10 21:02:00.548669 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.548621    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"]
Sep 10 21:02:00.553566 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:00.553544    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n"]
Sep 10 21:02:01.487641 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:01.487607    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" path="/var/lib/kubelet/pods/c7d9772f-2dc9-4529-9d8e-d56841bc06f3/volumes"
Sep 10 21:02:04.239487 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:04.239446    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:04.302528 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:04.302498    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:05.009649 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:05.009602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:11.453354 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:11.453319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:11.552067 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:11.552036    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:11.656459 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:11.656424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:15.626224 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:15.626195    2579 scope.go:117] "RemoveContainer" containerID="bfbb2ff558f845c57ed72f94084561411a04d3a2a05da3a998355f012aca9c80"
Sep 10 21:02:22.212899 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:22.212862    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:22.443819 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:22.443774    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:26.524600 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:26.524569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:43.468272 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:43.468233    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:43.536153 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:43.536120    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:44.536058 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:44.536023    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:46.026707 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:46.026671    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:50.521086 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:50.521048    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:50.614130 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:50.614095    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:50.922337 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:50.922294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:51.270735 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.270654    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"]
Sep 10 21:02:51.271189 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.271164    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a157d10b-9c76-4fbf-8426-1e0e17719a18" containerName="payload-processing"
Sep 10 21:02:51.271355 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.271343    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a157d10b-9c76-4fbf-8426-1e0e17719a18" containerName="payload-processing"
Sep 10 21:02:51.271453 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.271442    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy"
Sep 10 21:02:51.271527 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.271518    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy"
Sep 10 21:02:51.271666 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.271654    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95cafba8-aaba-4979-af47-981f6b656b24" containerName="cleanup"
Sep 10 21:02:51.271765 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.271756    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="95cafba8-aaba-4979-af47-981f6b656b24" containerName="cleanup"
Sep 10 21:02:51.271841 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.271831    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy"
Sep 10 21:02:51.271914 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.271905    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy"
Sep 10 21:02:51.271990 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.271981    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a1686c-bc47-455f-94fe-b0850964b074" containerName="cleanup"
Sep 10 21:02:51.272058 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.272050    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a1686c-bc47-455f-94fe-b0850964b074" containerName="cleanup"
Sep 10 21:02:51.272233 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.272222    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy"
Sep 10 21:02:51.272321 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.272312    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a1686c-bc47-455f-94fe-b0850964b074" containerName="cleanup"
Sep 10 21:02:51.272392 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.272383    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="95cafba8-aaba-4979-af47-981f6b656b24" containerName="cleanup"
Sep 10 21:02:51.272455 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.272447    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a157d10b-9c76-4fbf-8426-1e0e17719a18" containerName="payload-processing"
Sep 10 21:02:51.284418 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.284384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.289739 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.289713    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d66961-openshift-default-dockercfg-rvpw6\""
Sep 10 21:02:51.290348 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.290321    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"]
Sep 10 21:02:51.297070 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.297040    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:51.453659 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.453609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-podinfo\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.453829 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.453674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-credential-socket\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.453829 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.453694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmwh7\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-kube-api-access-zmwh7\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.453829 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.453725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-data\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.453829 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.453747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-envoy\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.453829 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.453769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istiod-ca-cert\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.453829 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.453805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-token\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.453829 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.453829    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-certs\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.454054 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.453901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-socket\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555137 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-token\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555137 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-certs\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-socket\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-podinfo\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-credential-socket\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmwh7\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-kube-api-access-zmwh7\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-data\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-envoy\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istiod-ca-cert\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555577    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-certs\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.555618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555645    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-credential-socket\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.556049 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-socket\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.556049 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.555775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-data\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.556150 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.556132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istiod-ca-cert\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.557653 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.557605    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-envoy\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.557808 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.557792    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-podinfo\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.568416 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.568397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmwh7\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-kube-api-access-zmwh7\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.568504 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.568451    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-token\") pod \"e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") " pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.598432 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.598412    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:51.884100 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.884076    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"]
Sep 10 21:02:51.885121 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:02:51.885097    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8cab4b_d9a2_453c_a9d4_9fc7f7ce25ef.slice/crio-f429dd7a54e51a4fb4234705b8b3f38a758e354a04207c13fe46c81a110d898b WatchSource:0}: Error finding container f429dd7a54e51a4fb4234705b8b3f38a758e354a04207c13fe46c81a110d898b: Status 404 returned error can't find the container with id f429dd7a54e51a4fb4234705b8b3f38a758e354a04207c13fe46c81a110d898b
Sep 10 21:02:51.887410 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.887372    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:02:51.887475 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.887436    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:02:51.887475 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.887465    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:02:51.891286 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:51.891250    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:52.774080 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:52.774040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" event={"ID":"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef","Type":"ContainerStarted","Data":"18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f"}
Sep 10 21:02:52.774498 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:52.774099    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" event={"ID":"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef","Type":"ContainerStarted","Data":"f429dd7a54e51a4fb4234705b8b3f38a758e354a04207c13fe46c81a110d898b"}
Sep 10 21:02:52.804380 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:52.804335    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" podStartSLOduration=1.804321613 podStartE2EDuration="1.804321613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:52.800727141 +0000 UTC m=+1597.837628657" watchObservedRunningTime="2026-09-10 21:02:52.804321613 +0000 UTC m=+1597.841223126"
Sep 10 21:02:53.598943 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:53.598905    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:53.603779 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:53.603754    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:53.778425 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:53.778384    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:53.779363 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:53.779343    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:02:55.018384 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:55.018347    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:55.152510 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:55.152476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:56.303377 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:56.303342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:56.401885 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:56.401848    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:56.695934 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:56.695906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:56.919115 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:56.919084    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:57.023001 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.022919    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:57.137181 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.137145    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"]
Sep 10 21:02:57.137642 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.137614    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d9772f-2dc9-4529-9d8e-d56841bc06f3" containerName="istio-proxy"
Sep 10 21:02:57.140863 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.140847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:02:57.146136 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.146114    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-d66961\""
Sep 10 21:02:57.146956 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.146940    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-d66961-dockercfg-jw6m2\""
Sep 10 21:02:57.159299 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.159275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"]
Sep 10 21:02:57.206975 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.206945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z5zn\" (UniqueName: \"kubernetes.io/projected/0ed818ee-ffa2-40dd-b421-7898573553cc-kube-api-access-9z5zn\") pod \"payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl\" (UID: \"0ed818ee-ffa2-40dd-b421-7898573553cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:02:57.207123 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.207048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ed818ee-ffa2-40dd-b421-7898573553cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl\" (UID: \"0ed818ee-ffa2-40dd-b421-7898573553cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:02:57.308004 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.307915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ed818ee-ffa2-40dd-b421-7898573553cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl\" (UID: \"0ed818ee-ffa2-40dd-b421-7898573553cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:02:57.308358 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.308060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5zn\" (UniqueName: \"kubernetes.io/projected/0ed818ee-ffa2-40dd-b421-7898573553cc-kube-api-access-9z5zn\") pod \"payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl\" (UID: \"0ed818ee-ffa2-40dd-b421-7898573553cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:02:57.308592 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.308573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ed818ee-ffa2-40dd-b421-7898573553cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl\" (UID: \"0ed818ee-ffa2-40dd-b421-7898573553cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:02:57.319565 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.319536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z5zn\" (UniqueName: \"kubernetes.io/projected/0ed818ee-ffa2-40dd-b421-7898573553cc-kube-api-access-9z5zn\") pod \"payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl\" (UID: \"0ed818ee-ffa2-40dd-b421-7898573553cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:02:57.451398 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.451363    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:02:57.734731 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.734703    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"]
Sep 10 21:02:57.736818 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:02:57.736793    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed818ee_ffa2_40dd_b421_7898573553cc.slice/crio-a17dd4cc22e4aef1b79439f53de5e51d905bbdf6ebdcb79c7603e1c46816a92b WatchSource:0}: Error finding container a17dd4cc22e4aef1b79439f53de5e51d905bbdf6ebdcb79c7603e1c46816a92b: Status 404 returned error can't find the container with id a17dd4cc22e4aef1b79439f53de5e51d905bbdf6ebdcb79c7603e1c46816a92b
Sep 10 21:02:57.798871 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.798843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl" event={"ID":"0ed818ee-ffa2-40dd-b421-7898573553cc","Type":"ContainerStarted","Data":"a17dd4cc22e4aef1b79439f53de5e51d905bbdf6ebdcb79c7603e1c46816a92b"}
Sep 10 21:02:57.905037 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:57.905000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:58.805087 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:58.805052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl" event={"ID":"0ed818ee-ffa2-40dd-b421-7898573553cc","Type":"ContainerStarted","Data":"31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62"}
Sep 10 21:02:58.805464 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:58.805176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:02:58.825088 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:02:58.825038    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl" podStartSLOduration=1.825019507 podStartE2EDuration="1.825019507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:58.824237275 +0000 UTC m=+1603.861138792" watchObservedRunningTime="2026-09-10 21:02:58.825019507 +0000 UTC m=+1603.861921021"
Sep 10 21:03:09.812847 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:09.812772    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:03:13.886018 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:13.885981    2579 generic.go:356] "Generic (PLEG): container finished" podID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerID="18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f" exitCode=0
Sep 10 21:03:13.886425 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:13.886049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" event={"ID":"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef","Type":"ContainerDied","Data":"18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f"}
Sep 10 21:03:13.886489 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:13.886474    2579 scope.go:117] "RemoveContainer" containerID="18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f"
Sep 10 21:03:13.887691 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:13.887661    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:03:13.887789 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:13.887727    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:03:13.887789 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:13.887757    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:03:14.892778 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:14.892746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" event={"ID":"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef","Type":"ContainerStarted","Data":"9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a"}
Sep 10 21:03:15.599111 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:15.599078    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:03:15.599318 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:15.599297    2579 patch_prober.go:28] interesting pod/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 10 21:03:15.599372 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:15.599344    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 10 21:03:16.599726 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:16.599692    2579 patch_prober.go:28] interesting pod/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 10 21:03:16.600118 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:16.599746    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 10 21:03:17.598997 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:17.598957    2579 patch_prober.go:28] interesting pod/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 10 21:03:17.599175 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:17.599020    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 10 21:03:18.598850 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:18.598814    2579 patch_prober.go:28] interesting pod/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 10 21:03:18.599222 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:18.598870    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 10 21:03:19.599212 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:19.599173    2579 patch_prober.go:28] interesting pod/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 10 21:03:19.599591 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:19.599229    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 10 21:03:19.903737 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:19.903699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:20.396261 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.396181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:20.603511 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.603479    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:03:20.603919 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.603803    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:03:20.604467 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.604447    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:03:20.752645 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.752601    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"]
Sep 10 21:03:20.756165 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.756146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.761524 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.761497    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-849fe6-openshift-default-dockercfg-7cbw7\""
Sep 10 21:03:20.773827 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.773798    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"]
Sep 10 21:03:20.784426 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.784402    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:20.838285 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.838219    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k497w\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-kube-api-access-k497w\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.838285 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.838276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-certs\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.838521 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.838321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-credential-socket\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.838521 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.838384    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-socket\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.838521 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.838412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-istio-token\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.838521 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.838506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-envoy\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.838768 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.838563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13a0a46-413b-4196-b258-b84187a90918-istiod-ca-cert\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.839153 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.839130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-data\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.839291 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.839166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13a0a46-413b-4196-b258-b84187a90918-istio-podinfo\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.939860 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.939824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-data\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940064 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.939870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13a0a46-413b-4196-b258-b84187a90918-istio-podinfo\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940064 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.939951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k497w\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-kube-api-access-k497w\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940064 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.939984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-certs\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940064 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-credential-socket\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940330 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-data\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940330 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-socket\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940330 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-istio-token\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940330 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-certs\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940558 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-envoy\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940558 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940355    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13a0a46-413b-4196-b258-b84187a90918-istiod-ca-cert\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940558 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940358    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-credential-socket\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940749 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-socket\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.940933 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.940916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13a0a46-413b-4196-b258-b84187a90918-istiod-ca-cert\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.942412 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.942382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13a0a46-413b-4196-b258-b84187a90918-istio-podinfo\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.942836 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.942819    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-envoy\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.952164 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.952139    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-istio-token\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:20.952735 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:20.952714    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k497w\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-kube-api-access-k497w\") pod \"e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") " pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:21.066741 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:21.066675    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:21.233334 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:21.233301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:21.348892 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:21.348863    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"]
Sep 10 21:03:21.350054 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:03:21.350029    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13a0a46_413b_4196_b258_b84187a90918.slice/crio-7f4c52745c2d296b4dc462aa499289361969f50697bf84e33b67bb0e5018086c WatchSource:0}: Error finding container 7f4c52745c2d296b4dc462aa499289361969f50697bf84e33b67bb0e5018086c: Status 404 returned error can't find the container with id 7f4c52745c2d296b4dc462aa499289361969f50697bf84e33b67bb0e5018086c
Sep 10 21:03:21.352312 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:21.352280    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:03:21.352429 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:21.352355    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:03:21.352429 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:21.352401    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:03:21.932421 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:21.932384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" event={"ID":"f13a0a46-413b-4196-b258-b84187a90918","Type":"ContainerStarted","Data":"bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365"}
Sep 10 21:03:21.933003 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:21.932440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" event={"ID":"f13a0a46-413b-4196-b258-b84187a90918","Type":"ContainerStarted","Data":"7f4c52745c2d296b4dc462aa499289361969f50697bf84e33b67bb0e5018086c"}
Sep 10 21:03:21.980785 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:21.980732    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" podStartSLOduration=1.980714436 podStartE2EDuration="1.980714436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:21.97746106 +0000 UTC m=+1627.014362575" watchObservedRunningTime="2026-09-10 21:03:21.980714436 +0000 UTC m=+1627.017615948"
Sep 10 21:03:22.067151 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:22.067114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:22.072880 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:22.072856    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:22.821601 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:22.821569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:22.938288 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:22.938253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:22.939245 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:22.939228    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:24.053862 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:24.053830    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:24.140471 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:24.140431    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.261891 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:25.261855    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.352936 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:25.352905    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.535987 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:25.535888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.800778 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:25.800686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.894881 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:25.894847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:25.990847 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:25.990814    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"]
Sep 10 21:03:25.995843 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:25.995823    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:25.998700 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:25.998678    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-849fe6-dockercfg-x8jxg\""
Sep 10 21:03:25.998700 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:25.998688    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-849fe6\""
Sep 10 21:03:26.006727 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.006704    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"]
Sep 10 21:03:26.092684 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.092579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41f119bd-60cc-47fd-9102-22d359b15ce2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4\" (UID: \"41f119bd-60cc-47fd-9102-22d359b15ce2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:26.092825 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.092805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntxgz\" (UniqueName: \"kubernetes.io/projected/41f119bd-60cc-47fd-9102-22d359b15ce2-kube-api-access-ntxgz\") pod \"payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4\" (UID: \"41f119bd-60cc-47fd-9102-22d359b15ce2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:26.194275 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.194234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntxgz\" (UniqueName: \"kubernetes.io/projected/41f119bd-60cc-47fd-9102-22d359b15ce2-kube-api-access-ntxgz\") pod \"payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4\" (UID: \"41f119bd-60cc-47fd-9102-22d359b15ce2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:26.194275 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.194282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41f119bd-60cc-47fd-9102-22d359b15ce2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4\" (UID: \"41f119bd-60cc-47fd-9102-22d359b15ce2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:26.195054 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.195032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41f119bd-60cc-47fd-9102-22d359b15ce2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4\" (UID: \"41f119bd-60cc-47fd-9102-22d359b15ce2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:26.207083 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.207063    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntxgz\" (UniqueName: \"kubernetes.io/projected/41f119bd-60cc-47fd-9102-22d359b15ce2-kube-api-access-ntxgz\") pod \"payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4\" (UID: \"41f119bd-60cc-47fd-9102-22d359b15ce2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:26.308722 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.308685    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:26.589679 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.589654    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"]
Sep 10 21:03:26.590520 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:03:26.590495    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f119bd_60cc_47fd_9102_22d359b15ce2.slice/crio-ce89aae8801ccfd5209646b777134ed5736949013f49ee4ea24fd0556463ae54 WatchSource:0}: Error finding container ce89aae8801ccfd5209646b777134ed5736949013f49ee4ea24fd0556463ae54: Status 404 returned error can't find the container with id ce89aae8801ccfd5209646b777134ed5736949013f49ee4ea24fd0556463ae54
Sep 10 21:03:26.962535 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.962495    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4" event={"ID":"41f119bd-60cc-47fd-9102-22d359b15ce2","Type":"ContainerStarted","Data":"fe46a9669d0ffc19518556cfaa4c700fa7ef74294b61ac4ece105532a058d082"}
Sep 10 21:03:26.962755 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.962663    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:26.962755 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.962713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4" event={"ID":"41f119bd-60cc-47fd-9102-22d359b15ce2","Type":"ContainerStarted","Data":"ce89aae8801ccfd5209646b777134ed5736949013f49ee4ea24fd0556463ae54"}
Sep 10 21:03:26.982561 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:26.982512    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4" podStartSLOduration=1.9824978340000001 podStartE2EDuration="1.982497834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:26.980598832 +0000 UTC m=+1632.017500347" watchObservedRunningTime="2026-09-10 21:03:26.982497834 +0000 UTC m=+1632.019399391"
Sep 10 21:03:35.633047 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:35.633009    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:37.970610 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:37.970582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:03:39.382428 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:39.382378    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:39.483596 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:39.483548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:42.217190 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:42.217153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:45.065646 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:45.065605    2579 generic.go:356] "Generic (PLEG): container finished" podID="f13a0a46-413b-4196-b258-b84187a90918" containerID="bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365" exitCode=0
Sep 10 21:03:45.066051 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:45.065680    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" event={"ID":"f13a0a46-413b-4196-b258-b84187a90918","Type":"ContainerDied","Data":"bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365"}
Sep 10 21:03:45.066094 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:45.066068    2579 scope.go:117] "RemoveContainer" containerID="bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365"
Sep 10 21:03:45.067180 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:45.067153    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:03:45.067249 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:45.067219    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:03:45.067289 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:45.067248    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:03:46.073453 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:46.073410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" event={"ID":"f13a0a46-413b-4196-b258-b84187a90918","Type":"ContainerStarted","Data":"0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b"}
Sep 10 21:03:46.565220 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:46.565176    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:47.067660 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:47.067612    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:47.067846 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:47.067823    2579 patch_prober.go:28] interesting pod/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:03:47.067893 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:47.067871    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 21:03:48.067848 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:48.067811    2579 patch_prober.go:28] interesting pod/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:03:48.068225 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:48.067865    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 21:03:48.912463 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:48.912432    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:49.067684 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:49.067623    2579 patch_prober.go:28] interesting pod/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:03:49.067873 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:49.067719    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 21:03:50.067103 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:50.067060    2579 patch_prober.go:28] interesting pod/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:03:50.067306 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:50.067134    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 21:03:51.067577 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:51.067533    2579 patch_prober.go:28] interesting pod/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 21:03:51.067994 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:51.067598    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 21:03:51.911657 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:51.911583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:52.071968 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:52.071936    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:52.072339 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:52.072296    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:52.072996 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:52.072976    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:03:52.627373 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:52.627337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:53.336992 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:03:53.336957    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:07.532829 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.532783    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:07.594165 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.594123    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"]
Sep 10 21:04:07.594449 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.594410    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl" podUID="0ed818ee-ffa2-40dd-b421-7898573553cc" containerName="payload-pre-processing" containerID="cri-o://31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62" gracePeriod=30
Sep 10 21:04:07.623424 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.623376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:07.712518 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.712370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:07.812853 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.812753    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:07.846978 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.846951    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:04:07.931789 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.931706    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z5zn\" (UniqueName: \"kubernetes.io/projected/0ed818ee-ffa2-40dd-b421-7898573553cc-kube-api-access-9z5zn\") pod \"0ed818ee-ffa2-40dd-b421-7898573553cc\" (UID: \"0ed818ee-ffa2-40dd-b421-7898573553cc\") "
Sep 10 21:04:07.931789 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.931770    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ed818ee-ffa2-40dd-b421-7898573553cc-plugins-config-volume\") pod \"0ed818ee-ffa2-40dd-b421-7898573553cc\" (UID: \"0ed818ee-ffa2-40dd-b421-7898573553cc\") "
Sep 10 21:04:07.932193 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.932148    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ed818ee-ffa2-40dd-b421-7898573553cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ed818ee-ffa2-40dd-b421-7898573553cc" (UID: "0ed818ee-ffa2-40dd-b421-7898573553cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:04:07.934585 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:07.934541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed818ee-ffa2-40dd-b421-7898573553cc-kube-api-access-9z5zn" (OuterVolumeSpecName: "kube-api-access-9z5zn") pod "0ed818ee-ffa2-40dd-b421-7898573553cc" (UID: "0ed818ee-ffa2-40dd-b421-7898573553cc"). InnerVolumeSpecName "kube-api-access-9z5zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:08.032861 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.032830    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z5zn\" (UniqueName: \"kubernetes.io/projected/0ed818ee-ffa2-40dd-b421-7898573553cc-kube-api-access-9z5zn\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:08.032861 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.032856    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ed818ee-ffa2-40dd-b421-7898573553cc-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:08.151275 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.151249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:08.188675 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.188614    2579 generic.go:356] "Generic (PLEG): container finished" podID="0ed818ee-ffa2-40dd-b421-7898573553cc" containerID="31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62" exitCode=0
Sep 10 21:04:08.188675 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.188661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl" event={"ID":"0ed818ee-ffa2-40dd-b421-7898573553cc","Type":"ContainerDied","Data":"31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62"}
Sep 10 21:04:08.188877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.188687    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"
Sep 10 21:04:08.188877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.188718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl" event={"ID":"0ed818ee-ffa2-40dd-b421-7898573553cc","Type":"ContainerDied","Data":"a17dd4cc22e4aef1b79439f53de5e51d905bbdf6ebdcb79c7603e1c46816a92b"}
Sep 10 21:04:08.188877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.188742    2579 scope.go:117] "RemoveContainer" containerID="31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62"
Sep 10 21:04:08.197934 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.197917    2579 scope.go:117] "RemoveContainer" containerID="31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62"
Sep 10 21:04:08.198215 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:04:08.198197    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62\": container with ID starting with 31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62 not found: ID does not exist" containerID="31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62"
Sep 10 21:04:08.198276 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.198223    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62"} err="failed to get container status \"31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62\": rpc error: code = NotFound desc = could not find container \"31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62\": container with ID starting with 31d3a24659e821225adcf95a4bd5e555a9ba6ef6adf1145be079dc50fb6a1f62 not found: ID does not exist"
Sep 10 21:04:08.221593 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.221572    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"]
Sep 10 21:04:08.223466 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:08.223447    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl"]
Sep 10 21:04:09.487782 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:09.487751    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ed818ee-ffa2-40dd-b421-7898573553cc" path="/var/lib/kubelet/pods/0ed818ee-ffa2-40dd-b421-7898573553cc/volumes"
Sep 10 21:04:10.997858 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:10.997821    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:14.450612 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:14.450576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:14.551707 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:14.551678    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:14.750942 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:14.750865    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"]
Sep 10 21:04:14.751108 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:14.751077    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy" containerID="cri-o://9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a" gracePeriod=30
Sep 10 21:04:14.758508 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:14.758485    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:15.250817 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:15.250780    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:19.614504 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:19.614463    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:20.009921 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.009900    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:04:20.148767 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.148742    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-credential-socket\") pod \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") "
Sep 10 21:04:20.148916 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.148779    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmwh7\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-kube-api-access-zmwh7\") pod \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") "
Sep 10 21:04:20.148916 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.148822    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-envoy\") pod \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") "
Sep 10 21:04:20.148916 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.148839    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-data\") pod \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") "
Sep 10 21:04:20.148916 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.148863    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-podinfo\") pod \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") "
Sep 10 21:04:20.148916 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.148908    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istiod-ca-cert\") pod \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") "
Sep 10 21:04:20.149188 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.148990    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-socket\") pod \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") "
Sep 10 21:04:20.149188 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149019    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-certs\") pod \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") "
Sep 10 21:04:20.149188 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149032    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" (UID: "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:20.149188 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149056    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-token\") pod \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\" (UID: \"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef\") "
Sep 10 21:04:20.149379 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149167    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" (UID: "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:20.149379 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149252    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" (UID: "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:20.149473 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149380    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" (UID: "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:20.149473 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149459    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:20.149587 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149478    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:20.149587 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149494    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:20.149587 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.149524    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" (UID: "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:04:20.151173 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.151146    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" (UID: "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:04:20.151295 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.151204    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" (UID: "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:20.151295 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.151220    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-kube-api-access-zmwh7" (OuterVolumeSpecName: "kube-api-access-zmwh7") pod "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" (UID: "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef"). InnerVolumeSpecName "kube-api-access-zmwh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:20.151295 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.151226    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" (UID: "1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:20.250027 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.249997    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:20.250027 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250024    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:20.250027 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250035    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmwh7\" (UniqueName: \"kubernetes.io/projected/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-kube-api-access-zmwh7\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:20.250279 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250051    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:20.250279 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250062    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:20.250279 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250070    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:20.250754 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250729    2579 generic.go:356] "Generic (PLEG): container finished" podID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerID="9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a" exitCode=0
Sep 10 21:04:20.250806 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250785    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"
Sep 10 21:04:20.250845 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" event={"ID":"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef","Type":"ContainerDied","Data":"9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a"}
Sep 10 21:04:20.250883 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250865    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln" event={"ID":"1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef","Type":"ContainerDied","Data":"f429dd7a54e51a4fb4234705b8b3f38a758e354a04207c13fe46c81a110d898b"}
Sep 10 21:04:20.250917 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.250889    2579 scope.go:117] "RemoveContainer" containerID="9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a"
Sep 10 21:04:20.260346 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.260329    2579 scope.go:117] "RemoveContainer" containerID="18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f"
Sep 10 21:04:20.268368 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.268351    2579 scope.go:117] "RemoveContainer" containerID="9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a"
Sep 10 21:04:20.268642 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:04:20.268608    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a\": container with ID starting with 9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a not found: ID does not exist" containerID="9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a"
Sep 10 21:04:20.268737 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.268648    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a"} err="failed to get container status \"9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a\": rpc error: code = NotFound desc = could not find container \"9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a\": container with ID starting with 9c9a8fdd3692bbfa07b37ed8dfc27cee3016018ab9e82b2305deb609f475040a not found: ID does not exist"
Sep 10 21:04:20.268737 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.268666    2579 scope.go:117] "RemoveContainer" containerID="18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f"
Sep 10 21:04:20.268960 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:04:20.268920    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f\": container with ID starting with 18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f not found: ID does not exist" containerID="18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f"
Sep 10 21:04:20.269026 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.268966    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f"} err="failed to get container status \"18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f\": rpc error: code = NotFound desc = could not find container \"18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f\": container with ID starting with 18d80dc8e92dac39874a05fa0c609dd6f14e4dd0674e44ce5f1ba102ecb2848f not found: ID does not exist"
Sep 10 21:04:20.281214 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.281194    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"]
Sep 10 21:04:20.287531 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:20.287511    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln"]
Sep 10 21:04:21.487156 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:21.487124    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" path="/var/lib/kubelet/pods/1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef/volumes"
Sep 10 21:04:22.523801 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:22.523766    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:23.509533 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:23.509498    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:25.322990 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:25.322957    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:30.737024 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:30.736980    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:30.998012 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:30.997916    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:31.058495 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.058463    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"]
Sep 10 21:04:31.058831 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.058797    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4" podUID="41f119bd-60cc-47fd-9102-22d359b15ce2" containerName="payload-pre-processing" containerID="cri-o://fe46a9669d0ffc19518556cfaa4c700fa7ef74294b61ac4ece105532a058d082" gracePeriod=30
Sep 10 21:04:31.092680 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.092649    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:31.193824 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.193792    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:31.293822 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.293773    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:31.312016 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.311993    2579 generic.go:356] "Generic (PLEG): container finished" podID="41f119bd-60cc-47fd-9102-22d359b15ce2" containerID="fe46a9669d0ffc19518556cfaa4c700fa7ef74294b61ac4ece105532a058d082" exitCode=0
Sep 10 21:04:31.312122 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.312025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4" event={"ID":"41f119bd-60cc-47fd-9102-22d359b15ce2","Type":"ContainerDied","Data":"fe46a9669d0ffc19518556cfaa4c700fa7ef74294b61ac4ece105532a058d082"}
Sep 10 21:04:31.312122 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.312059    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4" event={"ID":"41f119bd-60cc-47fd-9102-22d359b15ce2","Type":"ContainerDied","Data":"ce89aae8801ccfd5209646b777134ed5736949013f49ee4ea24fd0556463ae54"}
Sep 10 21:04:31.312122 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.312077    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce89aae8801ccfd5209646b777134ed5736949013f49ee4ea24fd0556463ae54"
Sep 10 21:04:31.312540 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.312526    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:04:31.458760 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.458725    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41f119bd-60cc-47fd-9102-22d359b15ce2-plugins-config-volume\") pod \"41f119bd-60cc-47fd-9102-22d359b15ce2\" (UID: \"41f119bd-60cc-47fd-9102-22d359b15ce2\") "
Sep 10 21:04:31.458902 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.458779    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntxgz\" (UniqueName: \"kubernetes.io/projected/41f119bd-60cc-47fd-9102-22d359b15ce2-kube-api-access-ntxgz\") pod \"41f119bd-60cc-47fd-9102-22d359b15ce2\" (UID: \"41f119bd-60cc-47fd-9102-22d359b15ce2\") "
Sep 10 21:04:31.459154 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.459132    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f119bd-60cc-47fd-9102-22d359b15ce2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41f119bd-60cc-47fd-9102-22d359b15ce2" (UID: "41f119bd-60cc-47fd-9102-22d359b15ce2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:04:31.460853 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.460830    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f119bd-60cc-47fd-9102-22d359b15ce2-kube-api-access-ntxgz" (OuterVolumeSpecName: "kube-api-access-ntxgz") pod "41f119bd-60cc-47fd-9102-22d359b15ce2" (UID: "41f119bd-60cc-47fd-9102-22d359b15ce2"). InnerVolumeSpecName "kube-api-access-ntxgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:31.560451 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.560380    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41f119bd-60cc-47fd-9102-22d359b15ce2-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:31.560451 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.560402    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntxgz\" (UniqueName: \"kubernetes.io/projected/41f119bd-60cc-47fd-9102-22d359b15ce2-kube-api-access-ntxgz\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:31.605656 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:31.605617    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:32.316385 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:32.316354    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"
Sep 10 21:04:32.335875 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:32.335815    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"]
Sep 10 21:04:32.338516 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:32.338491    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4"]
Sep 10 21:04:33.487445 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:33.487412    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f119bd-60cc-47fd-9102-22d359b15ce2" path="/var/lib/kubelet/pods/41f119bd-60cc-47fd-9102-22d359b15ce2/volumes"
Sep 10 21:04:37.666533 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:37.666498    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:37.767328 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:37.767295    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:37.924898 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:37.924799    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"]
Sep 10 21:04:37.925052 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:37.925025    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy" containerID="cri-o://0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b" gracePeriod=30
Sep 10 21:04:37.947062 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:37.947025    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:38.397027 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:38.396940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:43.169549 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.169521    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:04:43.178339 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13a0a46-413b-4196-b258-b84187a90918-istiod-ca-cert\") pod \"f13a0a46-413b-4196-b258-b84187a90918\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") "
Sep 10 21:04:43.178431 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178346    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13a0a46-413b-4196-b258-b84187a90918-istio-podinfo\") pod \"f13a0a46-413b-4196-b258-b84187a90918\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") "
Sep 10 21:04:43.178431 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178366    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-certs\") pod \"f13a0a46-413b-4196-b258-b84187a90918\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") "
Sep 10 21:04:43.178431 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178390    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-istio-token\") pod \"f13a0a46-413b-4196-b258-b84187a90918\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") "
Sep 10 21:04:43.178431 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178430    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-socket\") pod \"f13a0a46-413b-4196-b258-b84187a90918\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") "
Sep 10 21:04:43.178645 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178456    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-credential-socket\") pod \"f13a0a46-413b-4196-b258-b84187a90918\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") "
Sep 10 21:04:43.178645 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178487    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-data\") pod \"f13a0a46-413b-4196-b258-b84187a90918\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") "
Sep 10 21:04:43.178645 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-envoy\") pod \"f13a0a46-413b-4196-b258-b84187a90918\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") "
Sep 10 21:04:43.178645 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178639    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k497w\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-kube-api-access-k497w\") pod \"f13a0a46-413b-4196-b258-b84187a90918\" (UID: \"f13a0a46-413b-4196-b258-b84187a90918\") "
Sep 10 21:04:43.178862 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178672    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f13a0a46-413b-4196-b258-b84187a90918" (UID: "f13a0a46-413b-4196-b258-b84187a90918"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:43.178862 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178723    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f13a0a46-413b-4196-b258-b84187a90918-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f13a0a46-413b-4196-b258-b84187a90918" (UID: "f13a0a46-413b-4196-b258-b84187a90918"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:04:43.178862 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178762    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-data" (OuterVolumeSpecName: "istio-data") pod "f13a0a46-413b-4196-b258-b84187a90918" (UID: "f13a0a46-413b-4196-b258-b84187a90918"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:43.179013 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.178924    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f13a0a46-413b-4196-b258-b84187a90918" (UID: "f13a0a46-413b-4196-b258-b84187a90918"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:43.179084 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.179058    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:43.179141 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.179085    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:43.179141 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.179099    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13a0a46-413b-4196-b258-b84187a90918-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:43.179141 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.179114    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:43.179279 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.179219    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f13a0a46-413b-4196-b258-b84187a90918" (UID: "f13a0a46-413b-4196-b258-b84187a90918"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:43.180888 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.180861    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-kube-api-access-k497w" (OuterVolumeSpecName: "kube-api-access-k497w") pod "f13a0a46-413b-4196-b258-b84187a90918" (UID: "f13a0a46-413b-4196-b258-b84187a90918"). InnerVolumeSpecName "kube-api-access-k497w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:43.180993 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.180893    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f13a0a46-413b-4196-b258-b84187a90918" (UID: "f13a0a46-413b-4196-b258-b84187a90918"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:43.181043 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.181016    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f13a0a46-413b-4196-b258-b84187a90918-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f13a0a46-413b-4196-b258-b84187a90918" (UID: "f13a0a46-413b-4196-b258-b84187a90918"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:04:43.181184 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.181164    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-istio-token" (OuterVolumeSpecName: "istio-token") pod "f13a0a46-413b-4196-b258-b84187a90918" (UID: "f13a0a46-413b-4196-b258-b84187a90918"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:43.279702 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.279603    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13a0a46-413b-4196-b258-b84187a90918-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:43.279702 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.279651    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:43.279702 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.279663    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:43.279702 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.279673    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13a0a46-413b-4196-b258-b84187a90918-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:43.279702 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.279682    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k497w\" (UniqueName: \"kubernetes.io/projected/f13a0a46-413b-4196-b258-b84187a90918-kube-api-access-k497w\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:04:43.374213 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.374173    2579 generic.go:356] "Generic (PLEG): container finished" podID="f13a0a46-413b-4196-b258-b84187a90918" containerID="0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b" exitCode=0
Sep 10 21:04:43.374373 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.374227    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"
Sep 10 21:04:43.374373 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.374249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" event={"ID":"f13a0a46-413b-4196-b258-b84187a90918","Type":"ContainerDied","Data":"0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b"}
Sep 10 21:04:43.374373 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.374304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v" event={"ID":"f13a0a46-413b-4196-b258-b84187a90918","Type":"ContainerDied","Data":"7f4c52745c2d296b4dc462aa499289361969f50697bf84e33b67bb0e5018086c"}
Sep 10 21:04:43.374373 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.374326    2579 scope.go:117] "RemoveContainer" containerID="0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b"
Sep 10 21:04:43.384042 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.384023    2579 scope.go:117] "RemoveContainer" containerID="bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365"
Sep 10 21:04:43.391590 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.391572    2579 scope.go:117] "RemoveContainer" containerID="0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b"
Sep 10 21:04:43.391899 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:04:43.391877    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b\": container with ID starting with 0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b not found: ID does not exist" containerID="0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b"
Sep 10 21:04:43.391982 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.391911    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b"} err="failed to get container status \"0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b\": rpc error: code = NotFound desc = could not find container \"0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b\": container with ID starting with 0d5eca8b0fe788104da7f715a046908feb8ffd938828bd8ddea5e3afb390fa3b not found: ID does not exist"
Sep 10 21:04:43.391982 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.391934    2579 scope.go:117] "RemoveContainer" containerID="bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365"
Sep 10 21:04:43.392189 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:04:43.392171    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365\": container with ID starting with bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365 not found: ID does not exist" containerID="bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365"
Sep 10 21:04:43.392225 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.392195    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365"} err="failed to get container status \"bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365\": rpc error: code = NotFound desc = could not find container \"bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365\": container with ID starting with bddcc8c62646b9ee8756db5b8a7ebb479b2e28032aa710b45596314a31729365 not found: ID does not exist"
Sep 10 21:04:43.396785 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.396764    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"]
Sep 10 21:04:43.400313 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.400293    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v"]
Sep 10 21:04:43.487041 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:43.487014    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f13a0a46-413b-4196-b258-b84187a90918" path="/var/lib/kubelet/pods/f13a0a46-413b-4196-b258-b84187a90918/volumes"
Sep 10 21:04:48.860329 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:48.860293    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:48.933473 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:48.933434    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:48.988496 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:48.988444    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:49.104944 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:49.104908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:49.201675 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:49.201622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:49.515557 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:49.515469    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:52.335112 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:52.335079    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:54.597324 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:54.597288    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:55.589160 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:55.589122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:55.688163 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:55.688130    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:55.851136 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:55.851037    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"]
Sep 10 21:04:55.851323 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:55.851299    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy" containerID="cri-o://50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8" gracePeriod=30
Sep 10 21:04:55.869175 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:55.869147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:56.394650 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:04:56.394595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:01.101863 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.101835    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 21:05:01.141475 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141391    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-credential-socket\") pod \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") "
Sep 10 21:05:01.141475 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141452    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncblp\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-kube-api-access-ncblp\") pod \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") "
Sep 10 21:05:01.141715 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141487    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-data\") pod \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") "
Sep 10 21:05:01.141715 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141538    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istiod-ca-cert\") pod \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") "
Sep 10 21:05:01.141715 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141575    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-envoy\") pod \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") "
Sep 10 21:05:01.141715 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141644    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-podinfo\") pod \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") "
Sep 10 21:05:01.141715 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141658    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0794470-e9b7-4311-9fa9-1aab7964fb7d" (UID: "d0794470-e9b7-4311-9fa9-1aab7964fb7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:05:01.141715 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141693    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-socket\") pod \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") "
Sep 10 21:05:01.142028 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141756    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-certs\") pod \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") "
Sep 10 21:05:01.142028 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141810    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0794470-e9b7-4311-9fa9-1aab7964fb7d" (UID: "d0794470-e9b7-4311-9fa9-1aab7964fb7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:05:01.142028 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141817    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-token\") pod \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\" (UID: \"d0794470-e9b7-4311-9fa9-1aab7964fb7d\") "
Sep 10 21:05:01.142028 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.141993    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0794470-e9b7-4311-9fa9-1aab7964fb7d" (UID: "d0794470-e9b7-4311-9fa9-1aab7964fb7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:05:01.142028 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.142005    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0794470-e9b7-4311-9fa9-1aab7964fb7d" (UID: "d0794470-e9b7-4311-9fa9-1aab7964fb7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:05:01.142301 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.142052    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0794470-e9b7-4311-9fa9-1aab7964fb7d" (UID: "d0794470-e9b7-4311-9fa9-1aab7964fb7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:05:01.142301 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.142240    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:01.142301 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.142260    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:01.142301 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.142275    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:01.142301 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.142286    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:01.142301 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.142300    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:01.143814 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.143786    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-kube-api-access-ncblp" (OuterVolumeSpecName: "kube-api-access-ncblp") pod "d0794470-e9b7-4311-9fa9-1aab7964fb7d" (UID: "d0794470-e9b7-4311-9fa9-1aab7964fb7d"). InnerVolumeSpecName "kube-api-access-ncblp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:01.143937 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.143897    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0794470-e9b7-4311-9fa9-1aab7964fb7d" (UID: "d0794470-e9b7-4311-9fa9-1aab7964fb7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:01.144345 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.144322    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0794470-e9b7-4311-9fa9-1aab7964fb7d" (UID: "d0794470-e9b7-4311-9fa9-1aab7964fb7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:05:01.144440 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.144351    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0794470-e9b7-4311-9fa9-1aab7964fb7d" (UID: "d0794470-e9b7-4311-9fa9-1aab7964fb7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:05:01.243231 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.243190    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:01.243231 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.243222    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:01.243231 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.243230    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:01.243231 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.243239    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncblp\" (UniqueName: \"kubernetes.io/projected/d0794470-e9b7-4311-9fa9-1aab7964fb7d-kube-api-access-ncblp\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:01.466164 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.466128    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerID="50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8" exitCode=0
Sep 10 21:05:01.466352 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.466182    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"
Sep 10 21:05:01.466352 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.466216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" event={"ID":"d0794470-e9b7-4311-9fa9-1aab7964fb7d","Type":"ContainerDied","Data":"50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8"}
Sep 10 21:05:01.466352 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.466307    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d" event={"ID":"d0794470-e9b7-4311-9fa9-1aab7964fb7d","Type":"ContainerDied","Data":"2eb19bc607ee374f5452f6b37422a826f88b3f60daec50276fcdc2348cd0df4a"}
Sep 10 21:05:01.466352 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.466332    2579 scope.go:117] "RemoveContainer" containerID="50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8"
Sep 10 21:05:01.476115 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.476097    2579 scope.go:117] "RemoveContainer" containerID="85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f"
Sep 10 21:05:01.484316 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.484297    2579 scope.go:117] "RemoveContainer" containerID="50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8"
Sep 10 21:05:01.484562 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:05:01.484544    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8\": container with ID starting with 50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8 not found: ID does not exist" containerID="50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8"
Sep 10 21:05:01.484664 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.484570    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8"} err="failed to get container status \"50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8\": rpc error: code = NotFound desc = could not find container \"50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8\": container with ID starting with 50da9d18e7ebb4e2e5864178e76f28c1e28b40fe9b5b2f10f623356fbe8275c8 not found: ID does not exist"
Sep 10 21:05:01.484664 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.484587    2579 scope.go:117] "RemoveContainer" containerID="85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f"
Sep 10 21:05:01.484854 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:05:01.484838    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f\": container with ID starting with 85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f not found: ID does not exist" containerID="85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f"
Sep 10 21:05:01.484910 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.484858    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f"} err="failed to get container status \"85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f\": rpc error: code = NotFound desc = could not find container \"85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f\": container with ID starting with 85fc3284e4b0a9cfec5e63c4569a0c5cb0e1e52b02dee6c4234affc8e03ddb9f not found: ID does not exist"
Sep 10 21:05:01.490603 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.490578    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"]
Sep 10 21:05:01.494455 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:01.494436    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d"]
Sep 10 21:05:03.487151 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:03.487116    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" path="/var/lib/kubelet/pods/d0794470-e9b7-4311-9fa9-1aab7964fb7d/volumes"
Sep 10 21:05:06.857479 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:06.857418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:06.881816 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:06.881782    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"]
Sep 10 21:05:06.882540 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:06.882506    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6" podUID="6bc491ee-9692-4acb-be14-68d1535cffd2" containerName="payload-processing" containerID="cri-o://3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277" gracePeriod=30
Sep 10 21:05:06.954646 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:06.954594    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:07.055526 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.055425    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:07.114524 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.114434    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:07.151538 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.151512    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 21:05:07.201021 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.200992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj8l6\" (UniqueName: \"kubernetes.io/projected/6bc491ee-9692-4acb-be14-68d1535cffd2-kube-api-access-xj8l6\") pod \"6bc491ee-9692-4acb-be14-68d1535cffd2\" (UID: \"6bc491ee-9692-4acb-be14-68d1535cffd2\") "
Sep 10 21:05:07.201203 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.201121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bc491ee-9692-4acb-be14-68d1535cffd2-plugins-config-volume\") pod \"6bc491ee-9692-4acb-be14-68d1535cffd2\" (UID: \"6bc491ee-9692-4acb-be14-68d1535cffd2\") "
Sep 10 21:05:07.201518 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.201492    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bc491ee-9692-4acb-be14-68d1535cffd2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6bc491ee-9692-4acb-be14-68d1535cffd2" (UID: "6bc491ee-9692-4acb-be14-68d1535cffd2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:05:07.203104 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.203078    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc491ee-9692-4acb-be14-68d1535cffd2-kube-api-access-xj8l6" (OuterVolumeSpecName: "kube-api-access-xj8l6") pod "6bc491ee-9692-4acb-be14-68d1535cffd2" (UID: "6bc491ee-9692-4acb-be14-68d1535cffd2"). InnerVolumeSpecName "kube-api-access-xj8l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:07.302473 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.302437    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bc491ee-9692-4acb-be14-68d1535cffd2-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:07.302473 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.302466    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj8l6\" (UniqueName: \"kubernetes.io/projected/6bc491ee-9692-4acb-be14-68d1535cffd2-kube-api-access-xj8l6\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:05:07.484269 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.484232    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:07.496763 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.496736    2579 generic.go:356] "Generic (PLEG): container finished" podID="6bc491ee-9692-4acb-be14-68d1535cffd2" containerID="3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277" exitCode=0
Sep 10 21:05:07.496857 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.496776    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"
Sep 10 21:05:07.496857 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.496813    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6" event={"ID":"6bc491ee-9692-4acb-be14-68d1535cffd2","Type":"ContainerDied","Data":"3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277"}
Sep 10 21:05:07.496936 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.496863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6" event={"ID":"6bc491ee-9692-4acb-be14-68d1535cffd2","Type":"ContainerDied","Data":"ffd9723e823d095b167d17a1333a8c2c5b398295c106cf046f845e7ad8017062"}
Sep 10 21:05:07.496936 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.496884    2579 scope.go:117] "RemoveContainer" containerID="3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277"
Sep 10 21:05:07.505777 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.505762    2579 scope.go:117] "RemoveContainer" containerID="3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277"
Sep 10 21:05:07.506023 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:05:07.506005    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277\": container with ID starting with 3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277 not found: ID does not exist" containerID="3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277"
Sep 10 21:05:07.506089 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.506029    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277"} err="failed to get container status \"3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277\": rpc error: code = NotFound desc = could not find container \"3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277\": container with ID starting with 3bdab01c09880641ea8e2e390263ea82dfa45cd4e9771fac40a5ef980d426277 not found: ID does not exist"
Sep 10 21:05:07.536036 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.536012    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"]
Sep 10 21:05:07.541900 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:07.541873    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6"]
Sep 10 21:05:09.487271 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:09.487237    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc491ee-9692-4acb-be14-68d1535cffd2" path="/var/lib/kubelet/pods/6bc491ee-9692-4acb-be14-68d1535cffd2/volumes"
Sep 10 21:05:13.657049 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:13.657012    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:13.721125 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:13.721094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:13.934479 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:13.934402    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:30.586281 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:30.586239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:30.654117 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:30.654083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:41.944232 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:41.944200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:43.000388 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.000353    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:43.422317 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.422281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:43.721915 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.721838    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"]
Sep 10 21:05:43.722360 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722333    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy"
Sep 10 21:05:43.722502 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722429    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy"
Sep 10 21:05:43.722502 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722459    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy"
Sep 10 21:05:43.722502 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722468    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy"
Sep 10 21:05:43.722502 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722482    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy"
Sep 10 21:05:43.722502 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722490    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy"
Sep 10 21:05:43.722502 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722498    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f119bd-60cc-47fd-9102-22d359b15ce2" containerName="payload-pre-processing"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722508    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f119bd-60cc-47fd-9102-22d359b15ce2" containerName="payload-pre-processing"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722518    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722526    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722536    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722545    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722554    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722562    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722574    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc491ee-9692-4acb-be14-68d1535cffd2" containerName="payload-processing"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722582    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc491ee-9692-4acb-be14-68d1535cffd2" containerName="payload-processing"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722596    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed818ee-ffa2-40dd-b421-7898573553cc" containerName="payload-pre-processing"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722605    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed818ee-ffa2-40dd-b421-7898573553cc" containerName="payload-pre-processing"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722751    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ed818ee-ffa2-40dd-b421-7898573553cc" containerName="payload-pre-processing"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722768    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722778    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722788    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d8cab4b-d9a2-453c-a9d4-9fc7f7ce25ef" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722798    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722807    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bc491ee-9692-4acb-be14-68d1535cffd2" containerName="payload-processing"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722815    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f119bd-60cc-47fd-9102-22d359b15ce2" containerName="payload-pre-processing"
Sep 10 21:05:43.722839 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.722823    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13a0a46-413b-4196-b258-b84187a90918" containerName="istio-proxy"
Sep 10 21:05:43.726205 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.726183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.728911 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.728887    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b73da3-openshift-default-dockercfg-46tqg\""
Sep 10 21:05:43.738303 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.738282    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"]
Sep 10 21:05:43.750320 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.750294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:43.838549 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.838517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-envoy\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.838727 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.838558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5j4n\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-kube-api-access-p5j4n\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.838727 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.838583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-credential-socket\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.838727 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.838597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-podinfo\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.838727 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.838689    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-socket\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.838882 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.838783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-certs\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.838882 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.838808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istiod-ca-cert\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.838882 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.838831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-data\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.838882 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.838867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-token\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.939518 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5j4n\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-kube-api-access-p5j4n\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.939518 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-credential-socket\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.939794 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-podinfo\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.939794 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-socket\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.939794 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-certs\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.939794 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istiod-ca-cert\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.939794 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-data\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.939794 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-token\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.939794 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-envoy\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.940187 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.939994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-credential-socket\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.940187 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.940009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-socket\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.940187 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.940167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-certs\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.940321 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.940219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-data\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.940450 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.940429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istiod-ca-cert\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.941973 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.941953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-envoy\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.942218 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.942202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-podinfo\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.948038 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.948017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-token\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.948390 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.948368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5j4n\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-kube-api-access-p5j4n\") pod \"e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") " pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:43.962243 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:43.962219    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:44.037144 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:44.037063    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:44.312703 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:44.312680    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"]
Sep 10 21:05:44.314287 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:05:44.314257    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a1cf0a_06b1_45a4_8d52_cc3226ef4f00.slice/crio-06ed7ee31e4fdd7db0b97e553f2220fe23f74bf85c0173de36cafbefe1f6f120 WatchSource:0}: Error finding container 06ed7ee31e4fdd7db0b97e553f2220fe23f74bf85c0173de36cafbefe1f6f120: Status 404 returned error can't find the container with id 06ed7ee31e4fdd7db0b97e553f2220fe23f74bf85c0173de36cafbefe1f6f120
Sep 10 21:05:44.316696 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:44.316661    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:05:44.316774 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:44.316731    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:05:44.316774 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:44.316760    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:05:44.674379 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:44.674351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" event={"ID":"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00","Type":"ContainerStarted","Data":"78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7"}
Sep 10 21:05:44.674540 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:44.674397    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" event={"ID":"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00","Type":"ContainerStarted","Data":"06ed7ee31e4fdd7db0b97e553f2220fe23f74bf85c0173de36cafbefe1f6f120"}
Sep 10 21:05:44.695599 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:44.695548    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" podStartSLOduration=1.695507093 podStartE2EDuration="1.695507093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:44.694525407 +0000 UTC m=+1769.731426921" watchObservedRunningTime="2026-09-10 21:05:44.695507093 +0000 UTC m=+1769.732408606"
Sep 10 21:05:45.037304 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:45.037218    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:45.042778 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:45.042757    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:45.679134 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:45.679104    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:45.680433 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:45.680410    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:05:46.573033 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:46.573002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:46.674901 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:46.674867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:47.908836 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:47.908794    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:48.008966 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.008932    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:48.149112 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.149081    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:48.248842 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.248727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:48.424167 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.424132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:48.524884 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.524797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:48.537545 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.537519    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"]
Sep 10 21:05:48.538049 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.538028    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0794470-e9b7-4311-9fa9-1aab7964fb7d" containerName="istio-proxy"
Sep 10 21:05:48.540837 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.540823    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:05:48.543551 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.543524    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b73da3\""
Sep 10 21:05:48.543670 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.543589    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b73da3-dockercfg-sz4wb\""
Sep 10 21:05:48.552229 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.552203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"]
Sep 10 21:05:48.556021 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.555997    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"]
Sep 10 21:05:48.559423 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.559404    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:05:48.571618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.571594    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"]
Sep 10 21:05:48.682766 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.682729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssfk\" (UniqueName: \"kubernetes.io/projected/b1c612d4-9a55-4b5a-9991-975e97b1e78c-kube-api-access-2ssfk\") pod \"payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j\" (UID: \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:05:48.682952 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.682785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntcjh\" (UniqueName: \"kubernetes.io/projected/09eefde4-4f9c-4fe2-b711-863a48059f02-kube-api-access-ntcjh\") pod \"payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh\" (UID: \"09eefde4-4f9c-4fe2-b711-863a48059f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:05:48.682952 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.682812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09eefde4-4f9c-4fe2-b711-863a48059f02-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh\" (UID: \"09eefde4-4f9c-4fe2-b711-863a48059f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:05:48.682952 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.682888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1c612d4-9a55-4b5a-9991-975e97b1e78c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j\" (UID: \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:05:48.783753 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.783659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssfk\" (UniqueName: \"kubernetes.io/projected/b1c612d4-9a55-4b5a-9991-975e97b1e78c-kube-api-access-2ssfk\") pod \"payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j\" (UID: \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:05:48.783753 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.783705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntcjh\" (UniqueName: \"kubernetes.io/projected/09eefde4-4f9c-4fe2-b711-863a48059f02-kube-api-access-ntcjh\") pod \"payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh\" (UID: \"09eefde4-4f9c-4fe2-b711-863a48059f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:05:48.783753 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.783728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09eefde4-4f9c-4fe2-b711-863a48059f02-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh\" (UID: \"09eefde4-4f9c-4fe2-b711-863a48059f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:05:48.784069 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.783877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1c612d4-9a55-4b5a-9991-975e97b1e78c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j\" (UID: \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:05:48.784661 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.784619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09eefde4-4f9c-4fe2-b711-863a48059f02-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh\" (UID: \"09eefde4-4f9c-4fe2-b711-863a48059f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:05:48.784767 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.784752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1c612d4-9a55-4b5a-9991-975e97b1e78c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j\" (UID: \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:05:48.792096 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.792076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntcjh\" (UniqueName: \"kubernetes.io/projected/09eefde4-4f9c-4fe2-b711-863a48059f02-kube-api-access-ntcjh\") pod \"payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh\" (UID: \"09eefde4-4f9c-4fe2-b711-863a48059f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:05:48.792289 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.792268    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssfk\" (UniqueName: \"kubernetes.io/projected/b1c612d4-9a55-4b5a-9991-975e97b1e78c-kube-api-access-2ssfk\") pod \"payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j\" (UID: \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:05:48.853142 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.853108    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:05:48.871980 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:48.871957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:05:49.128935 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.128911    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"]
Sep 10 21:05:49.130598 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:05:49.130566    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09eefde4_4f9c_4fe2_b711_863a48059f02.slice/crio-50e6fe93923b8432c859aa7c64a8ec3dd8bfaee3b32c22a419d79713f7f93702 WatchSource:0}: Error finding container 50e6fe93923b8432c859aa7c64a8ec3dd8bfaee3b32c22a419d79713f7f93702: Status 404 returned error can't find the container with id 50e6fe93923b8432c859aa7c64a8ec3dd8bfaee3b32c22a419d79713f7f93702
Sep 10 21:05:49.157369 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.157348    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"]
Sep 10 21:05:49.160737 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:05:49.160712    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c612d4_9a55_4b5a_9991_975e97b1e78c.slice/crio-59f2a88bdd2add2747a2cbe71ce25dc39d367d6831847752d8223b43dbc531c1 WatchSource:0}: Error finding container 59f2a88bdd2add2747a2cbe71ce25dc39d367d6831847752d8223b43dbc531c1: Status 404 returned error can't find the container with id 59f2a88bdd2add2747a2cbe71ce25dc39d367d6831847752d8223b43dbc531c1
Sep 10 21:05:49.699520 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.699481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh" event={"ID":"09eefde4-4f9c-4fe2-b711-863a48059f02","Type":"ContainerStarted","Data":"7b0f50fa62a61c91710ee81d6af5ab8e393e2d910c3a272782304c3518dcf5ee"}
Sep 10 21:05:49.699757 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.699558    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:05:49.699757 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.699585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh" event={"ID":"09eefde4-4f9c-4fe2-b711-863a48059f02","Type":"ContainerStarted","Data":"50e6fe93923b8432c859aa7c64a8ec3dd8bfaee3b32c22a419d79713f7f93702"}
Sep 10 21:05:49.701130 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.701102    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j" event={"ID":"b1c612d4-9a55-4b5a-9991-975e97b1e78c","Type":"ContainerStarted","Data":"7d2ca149b701b478f96c715af2754efe31c9862fe79ea59ab5476ae3b1d181c9"}
Sep 10 21:05:49.701229 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.701149    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j" event={"ID":"b1c612d4-9a55-4b5a-9991-975e97b1e78c","Type":"ContainerStarted","Data":"59f2a88bdd2add2747a2cbe71ce25dc39d367d6831847752d8223b43dbc531c1"}
Sep 10 21:05:49.701229 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.701172    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:05:49.717499 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.717463    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh" podStartSLOduration=1.717444499 podStartE2EDuration="1.717444499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:49.717004626 +0000 UTC m=+1774.753906139" watchObservedRunningTime="2026-09-10 21:05:49.717444499 +0000 UTC m=+1774.754346015"
Sep 10 21:05:49.734591 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:05:49.734552    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j" podStartSLOduration=1.734539786 podStartE2EDuration="1.734539786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:49.733408135 +0000 UTC m=+1774.770309648" watchObservedRunningTime="2026-09-10 21:05:49.734539786 +0000 UTC m=+1774.771441299"
Sep 10 21:06:00.708787 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:00.708753    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:06:00.709246 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:00.708846    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:06:01.720806 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:01.720756    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:06:01.721313 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:01.720830    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:06:02.777654 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:02.777546    2579 generic.go:356] "Generic (PLEG): container finished" podID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerID="78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7" exitCode=0
Sep 10 21:06:02.777654 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:02.777624    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" event={"ID":"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00","Type":"ContainerDied","Data":"78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7"}
Sep 10 21:06:02.778099 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:02.778026    2579 scope.go:117] "RemoveContainer" containerID="78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7"
Sep 10 21:06:02.779120 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:02.779088    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:06:02.779221 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:02.779177    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:06:02.779283 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:02.779224    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:06:03.784159 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:03.784126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" event={"ID":"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00","Type":"ContainerStarted","Data":"f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c"}
Sep 10 21:06:04.038195 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:04.038089    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:06:04.038386 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:04.038226    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:06:04.038386 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:04.038271    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:06:05.037708 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:05.037666    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:06:05.038285 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:05.038251    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:06:06.039651 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:06.039193    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:06:06.039651 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:06.039257    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:06:07.038318 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:07.038274    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:06:07.038532 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:07.038361    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:06:08.038263 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:08.038167    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:06:08.038909 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:08.038871    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:06:09.038039 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:09.038002    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:06:09.038224 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:09.038055    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:06:10.040832 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:10.040799    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:06:10.041254 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:10.041166    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:06:10.042022 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:10.042000    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:06:11.583283 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:11.583238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:12.261338 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:12.261300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:12.558516 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:12.558404    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:12.675291 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:12.675256    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:15.700901 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:15.700875    2579 scope.go:117] "RemoveContainer" containerID="25843b48caa3df83cd3287deba8be8261eef80a82883f0ae3bd77c585e41a97a"
Sep 10 21:06:15.840449 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:15.840270    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:15.929958 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:15.929916    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:17.057082 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:17.057045    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:17.157393 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:17.157358    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:17.211651 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:17.211599    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:17.647567 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:17.647527    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:17.747597 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:17.747567    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:40.732769 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:40.732736    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:52.906938 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:06:52.906897    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:26.641552 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:26.641517    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j_b1c612d4-9a55-4b5a-9991-975e97b1e78c/payload-processing/0.log"
Sep 10 21:07:27.134468 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.134427    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:27.420519 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.420482    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"]
Sep 10 21:07:27.424878 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.424853    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.428222 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.428197    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-eb2a90-openshift-default-dockercfg-n4dkm\""
Sep 10 21:07:27.436402 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.436379    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"]
Sep 10 21:07:27.447974 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.447949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-envoy\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.448094 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.447982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgdw\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-kube-api-access-gcgdw\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.448094 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.448011    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-certs\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.448177 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.448157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-data\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.448222 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.448208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-credential-socket\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.448270 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.448245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-socket\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.448311 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.448285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006bab71-e759-4a38-a22c-1d339706a3d0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.448311 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.448303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006bab71-e759-4a38-a22c-1d339706a3d0-istio-podinfo\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.448389 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.448319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-istio-token\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.453370 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.453340    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:27.549313 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006bab71-e759-4a38-a22c-1d339706a3d0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549313 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006bab71-e759-4a38-a22c-1d339706a3d0-istio-podinfo\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549551 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-istio-token\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549551 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-envoy\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549551 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgdw\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-kube-api-access-gcgdw\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549551 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-certs\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549551 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-data\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549551 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-credential-socket\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549923 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549563    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-socket\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549986 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-certs\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.549986 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.549969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-socket\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.550170 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.550141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006bab71-e759-4a38-a22c-1d339706a3d0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.550245 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.550204    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-data\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.550288 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.550242    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-credential-socket\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.551780 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.551756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-envoy\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.551885 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.551856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006bab71-e759-4a38-a22c-1d339706a3d0-istio-podinfo\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.566055 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.558466    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-istio-token\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.566055 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.558868    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgdw\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-kube-api-access-gcgdw\") pod \"e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") " pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.736252 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.736156    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:27.846741 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:27.846707    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:28.018351 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:28.018326    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"]
Sep 10 21:07:28.021135 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:07:28.021109    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006bab71_e759_4a38_a22c_1d339706a3d0.slice/crio-ab3a2f9c0b71251ccdf17d3f1ad3c19d5a486556333611198f8e1e1ca6c0d762 WatchSource:0}: Error finding container ab3a2f9c0b71251ccdf17d3f1ad3c19d5a486556333611198f8e1e1ca6c0d762: Status 404 returned error can't find the container with id ab3a2f9c0b71251ccdf17d3f1ad3c19d5a486556333611198f8e1e1ca6c0d762
Sep 10 21:07:28.023435 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:28.023398    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:07:28.023527 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:28.023466    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:07:28.023527 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:28.023496    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:07:28.202104 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:28.202062    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" event={"ID":"006bab71-e759-4a38-a22c-1d339706a3d0","Type":"ContainerStarted","Data":"dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a"}
Sep 10 21:07:28.202286 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:28.202134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" event={"ID":"006bab71-e759-4a38-a22c-1d339706a3d0","Type":"ContainerStarted","Data":"ab3a2f9c0b71251ccdf17d3f1ad3c19d5a486556333611198f8e1e1ca6c0d762"}
Sep 10 21:07:28.225432 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:28.225377    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" podStartSLOduration=1.225360075 podStartE2EDuration="1.225360075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:07:28.223346362 +0000 UTC m=+1873.260247897" watchObservedRunningTime="2026-09-10 21:07:28.225360075 +0000 UTC m=+1873.262261587"
Sep 10 21:07:28.736464 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:28.736420    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:29.742139 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:29.742107    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:30.126739 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:30.126622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:30.213078 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:30.213046    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:30.214134 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:30.214114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:30.221272 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:30.221247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:31.389843 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:31.389811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:31.499190 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:31.499155    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:31.668454 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:31.668421    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:31.948200 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:31.948118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:32.053810 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.053781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:32.058081 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.058056    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"]
Sep 10 21:07:32.061614 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.061598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:32.064542 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.064520    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-eb2a90\""
Sep 10 21:07:32.073136 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.073116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"]
Sep 10 21:07:32.094646 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.094609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md99r\" (UniqueName: \"kubernetes.io/projected/6e579ba1-66bd-4059-a545-3269a10dd84a-kube-api-access-md99r\") pod \"payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd\" (UID: \"6e579ba1-66bd-4059-a545-3269a10dd84a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:32.094779 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.094673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e579ba1-66bd-4059-a545-3269a10dd84a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd\" (UID: \"6e579ba1-66bd-4059-a545-3269a10dd84a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:32.196821 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.195842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e579ba1-66bd-4059-a545-3269a10dd84a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd\" (UID: \"6e579ba1-66bd-4059-a545-3269a10dd84a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:32.196997 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.196785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e579ba1-66bd-4059-a545-3269a10dd84a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd\" (UID: \"6e579ba1-66bd-4059-a545-3269a10dd84a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:32.197069 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.197045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md99r\" (UniqueName: \"kubernetes.io/projected/6e579ba1-66bd-4059-a545-3269a10dd84a-kube-api-access-md99r\") pod \"payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd\" (UID: \"6e579ba1-66bd-4059-a545-3269a10dd84a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:32.209200 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.209111    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md99r\" (UniqueName: \"kubernetes.io/projected/6e579ba1-66bd-4059-a545-3269a10dd84a-kube-api-access-md99r\") pod \"payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd\" (UID: \"6e579ba1-66bd-4059-a545-3269a10dd84a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:32.373051 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.373013    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:32.646293 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:32.646268    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"]
Sep 10 21:07:32.648302 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:07:32.648272    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e579ba1_66bd_4059_a545_3269a10dd84a.slice/crio-0cb67f029d3b8bb07cbbdaaf6aa26ac4907532aa93f1aa7c4c6f51cd782d2862 WatchSource:0}: Error finding container 0cb67f029d3b8bb07cbbdaaf6aa26ac4907532aa93f1aa7c4c6f51cd782d2862: Status 404 returned error can't find the container with id 0cb67f029d3b8bb07cbbdaaf6aa26ac4907532aa93f1aa7c4c6f51cd782d2862
Sep 10 21:07:33.231694 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:33.231661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd" event={"ID":"6e579ba1-66bd-4059-a545-3269a10dd84a","Type":"ContainerStarted","Data":"254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6"}
Sep 10 21:07:33.231906 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:33.231721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd" event={"ID":"6e579ba1-66bd-4059-a545-3269a10dd84a","Type":"ContainerStarted","Data":"0cb67f029d3b8bb07cbbdaaf6aa26ac4907532aa93f1aa7c4c6f51cd782d2862"}
Sep 10 21:07:33.231906 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:33.231747    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:33.250451 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:33.250403    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd" podStartSLOduration=1.25038789 podStartE2EDuration="1.25038789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:07:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:07:33.248070284 +0000 UTC m=+1878.284971810" watchObservedRunningTime="2026-09-10 21:07:33.25038789 +0000 UTC m=+1878.287289404"
Sep 10 21:07:44.239910 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:44.239823    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:07:51.326472 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:51.326438    2579 generic.go:356] "Generic (PLEG): container finished" podID="006bab71-e759-4a38-a22c-1d339706a3d0" containerID="dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a" exitCode=0
Sep 10 21:07:51.326903 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:51.326514    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" event={"ID":"006bab71-e759-4a38-a22c-1d339706a3d0","Type":"ContainerDied","Data":"dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a"}
Sep 10 21:07:51.326986 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:51.326971    2579 scope.go:117] "RemoveContainer" containerID="dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a"
Sep 10 21:07:51.328062 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:51.328034    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:07:51.328120 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:51.328107    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:07:51.328168 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:51.328157    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 21:07:52.342246 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:52.342204    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" event={"ID":"006bab71-e759-4a38-a22c-1d339706a3d0","Type":"ContainerStarted","Data":"5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525"}
Sep 10 21:07:52.736816 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:52.736777    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:52.737299 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:52.737269    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 21:07:52.737875 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:52.737514    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 21:07:53.737059 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:53.737015    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 21:07:53.737579 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:53.737086    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 21:07:54.737468 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:54.737416    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 21:07:54.738039 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:54.737494    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 21:07:55.098716 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:55.098598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:55.736983 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:55.736941    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 21:07:55.737276 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:55.737242    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 21:07:56.738121 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:56.737659    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 10 21:07:56.738121 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:56.737723    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 10 21:07:57.741203 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:57.741173    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:57.741584 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:57.741454    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:07:57.742176 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:07:57.742158    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:08:02.039868 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.039796    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:02.078354 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.078321    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"]
Sep 10 21:08:02.078844 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.078810    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd" podUID="6e579ba1-66bd-4059-a545-3269a10dd84a" containerName="payload-pre-processing" containerID="cri-o://254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6" gracePeriod=30
Sep 10 21:08:02.114652 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.114599    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:02.183693 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.183624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:02.259999 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.259968    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:02.323027 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.322935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:02.352160 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.352138    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:08:02.396238 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.396201    2579 generic.go:356] "Generic (PLEG): container finished" podID="6e579ba1-66bd-4059-a545-3269a10dd84a" containerID="254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6" exitCode=0
Sep 10 21:08:02.396399 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.396373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd" event={"ID":"6e579ba1-66bd-4059-a545-3269a10dd84a","Type":"ContainerDied","Data":"254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6"}
Sep 10 21:08:02.396468 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.396455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd" event={"ID":"6e579ba1-66bd-4059-a545-3269a10dd84a","Type":"ContainerDied","Data":"0cb67f029d3b8bb07cbbdaaf6aa26ac4907532aa93f1aa7c4c6f51cd782d2862"}
Sep 10 21:08:02.396520 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.396483    2579 scope.go:117] "RemoveContainer" containerID="254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6"
Sep 10 21:08:02.396648 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.396588    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"
Sep 10 21:08:02.409120 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.408286    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e579ba1-66bd-4059-a545-3269a10dd84a-plugins-config-volume\") pod \"6e579ba1-66bd-4059-a545-3269a10dd84a\" (UID: \"6e579ba1-66bd-4059-a545-3269a10dd84a\") "
Sep 10 21:08:02.409120 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.408350    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md99r\" (UniqueName: \"kubernetes.io/projected/6e579ba1-66bd-4059-a545-3269a10dd84a-kube-api-access-md99r\") pod \"6e579ba1-66bd-4059-a545-3269a10dd84a\" (UID: \"6e579ba1-66bd-4059-a545-3269a10dd84a\") "
Sep 10 21:08:02.412533 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.412133    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e579ba1-66bd-4059-a545-3269a10dd84a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e579ba1-66bd-4059-a545-3269a10dd84a" (UID: "6e579ba1-66bd-4059-a545-3269a10dd84a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:08:02.412533 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.412268    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e579ba1-66bd-4059-a545-3269a10dd84a-kube-api-access-md99r" (OuterVolumeSpecName: "kube-api-access-md99r") pod "6e579ba1-66bd-4059-a545-3269a10dd84a" (UID: "6e579ba1-66bd-4059-a545-3269a10dd84a"). InnerVolumeSpecName "kube-api-access-md99r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:08:02.420682 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.420217    2579 scope.go:117] "RemoveContainer" containerID="254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6"
Sep 10 21:08:02.420773 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:08:02.420742    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6\": container with ID starting with 254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6 not found: ID does not exist" containerID="254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6"
Sep 10 21:08:02.420833 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.420778    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6"} err="failed to get container status \"254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6\": rpc error: code = NotFound desc = could not find container \"254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6\": container with ID starting with 254677a4304edb39bf1e3f2d8679f2a15e2da3dde6c8a0eb85bf36b1240d1ee6 not found: ID does not exist"
Sep 10 21:08:02.509579 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.509543    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e579ba1-66bd-4059-a545-3269a10dd84a-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:02.509579 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.509576    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md99r\" (UniqueName: \"kubernetes.io/projected/6e579ba1-66bd-4059-a545-3269a10dd84a-kube-api-access-md99r\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:02.603054 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.602976    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:02.719642 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.719600    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"]
Sep 10 21:08:02.724279 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:02.724254    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd"]
Sep 10 21:08:03.487364 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:03.487332    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e579ba1-66bd-4059-a545-3269a10dd84a" path="/var/lib/kubelet/pods/6e579ba1-66bd-4059-a545-3269a10dd84a/volumes"
Sep 10 21:08:07.858749 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:07.858703    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:08.780837 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:08.780793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:08.837824 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:08.837785    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:09.020744 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:09.020711    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"]
Sep 10 21:08:09.021233 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:09.020946    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy" containerID="cri-o://5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525" gracePeriod=30
Sep 10 21:08:09.042291 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:09.042213    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:12.744325 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:12.744291    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:08:12.744723 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:12.744350    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:08:12.829361 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:12.829330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:14.274837 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.274809    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:08:14.327064 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.326982    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006bab71-e759-4a38-a22c-1d339706a3d0-istio-podinfo\") pod \"006bab71-e759-4a38-a22c-1d339706a3d0\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") "
Sep 10 21:08:14.327064 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327025    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-istio-token\") pod \"006bab71-e759-4a38-a22c-1d339706a3d0\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") "
Sep 10 21:08:14.327064 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327043    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-socket\") pod \"006bab71-e759-4a38-a22c-1d339706a3d0\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") "
Sep 10 21:08:14.327314 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327069    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcgdw\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-kube-api-access-gcgdw\") pod \"006bab71-e759-4a38-a22c-1d339706a3d0\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") "
Sep 10 21:08:14.327314 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327157    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-data\") pod \"006bab71-e759-4a38-a22c-1d339706a3d0\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") "
Sep 10 21:08:14.327314 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327202    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-envoy\") pod \"006bab71-e759-4a38-a22c-1d339706a3d0\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") "
Sep 10 21:08:14.327314 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327265    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-certs\") pod \"006bab71-e759-4a38-a22c-1d339706a3d0\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") "
Sep 10 21:08:14.327314 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327308    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-credential-socket\") pod \"006bab71-e759-4a38-a22c-1d339706a3d0\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") "
Sep 10 21:08:14.327570 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327319    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "006bab71-e759-4a38-a22c-1d339706a3d0" (UID: "006bab71-e759-4a38-a22c-1d339706a3d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:08:14.327570 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327340    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006bab71-e759-4a38-a22c-1d339706a3d0-istiod-ca-cert\") pod \"006bab71-e759-4a38-a22c-1d339706a3d0\" (UID: \"006bab71-e759-4a38-a22c-1d339706a3d0\") "
Sep 10 21:08:14.327570 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "006bab71-e759-4a38-a22c-1d339706a3d0" (UID: "006bab71-e759-4a38-a22c-1d339706a3d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:08:14.327751 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327562    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "006bab71-e759-4a38-a22c-1d339706a3d0" (UID: "006bab71-e759-4a38-a22c-1d339706a3d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:08:14.327842 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327813    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "006bab71-e759-4a38-a22c-1d339706a3d0" (UID: "006bab71-e759-4a38-a22c-1d339706a3d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:08:14.328021 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327859    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/006bab71-e759-4a38-a22c-1d339706a3d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "006bab71-e759-4a38-a22c-1d339706a3d0" (UID: "006bab71-e759-4a38-a22c-1d339706a3d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:08:14.328021 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.327865    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:14.328162 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.328093    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:14.328162 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.328112    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:14.330046 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.330008    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "006bab71-e759-4a38-a22c-1d339706a3d0" (UID: "006bab71-e759-4a38-a22c-1d339706a3d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:08:14.330046 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.330024    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-kube-api-access-gcgdw" (OuterVolumeSpecName: "kube-api-access-gcgdw") pod "006bab71-e759-4a38-a22c-1d339706a3d0" (UID: "006bab71-e759-4a38-a22c-1d339706a3d0"). InnerVolumeSpecName "kube-api-access-gcgdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:08:14.330046 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.330014    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/006bab71-e759-4a38-a22c-1d339706a3d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "006bab71-e759-4a38-a22c-1d339706a3d0" (UID: "006bab71-e759-4a38-a22c-1d339706a3d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:08:14.330304 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.330280    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "006bab71-e759-4a38-a22c-1d339706a3d0" (UID: "006bab71-e759-4a38-a22c-1d339706a3d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:08:14.428963 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.428927    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006bab71-e759-4a38-a22c-1d339706a3d0-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:14.428963 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.428956    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006bab71-e759-4a38-a22c-1d339706a3d0-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:14.428963 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.428968    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:14.429192 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.428979    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcgdw\" (UniqueName: \"kubernetes.io/projected/006bab71-e759-4a38-a22c-1d339706a3d0-kube-api-access-gcgdw\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:14.429192 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.428993    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:14.429192 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.429005    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006bab71-e759-4a38-a22c-1d339706a3d0-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:14.457990 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.457961    2579 generic.go:356] "Generic (PLEG): container finished" podID="006bab71-e759-4a38-a22c-1d339706a3d0" containerID="5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525" exitCode=0
Sep 10 21:08:14.458113 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.458022    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"
Sep 10 21:08:14.458113 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.458025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" event={"ID":"006bab71-e759-4a38-a22c-1d339706a3d0","Type":"ContainerDied","Data":"5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525"}
Sep 10 21:08:14.458201 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.458153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw" event={"ID":"006bab71-e759-4a38-a22c-1d339706a3d0","Type":"ContainerDied","Data":"ab3a2f9c0b71251ccdf17d3f1ad3c19d5a486556333611198f8e1e1ca6c0d762"}
Sep 10 21:08:14.458201 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.458175    2579 scope.go:117] "RemoveContainer" containerID="5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525"
Sep 10 21:08:14.467546 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.467529    2579 scope.go:117] "RemoveContainer" containerID="dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a"
Sep 10 21:08:14.475527 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.475511    2579 scope.go:117] "RemoveContainer" containerID="5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525"
Sep 10 21:08:14.475801 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:08:14.475780    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525\": container with ID starting with 5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525 not found: ID does not exist" containerID="5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525"
Sep 10 21:08:14.475860 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.475809    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525"} err="failed to get container status \"5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525\": rpc error: code = NotFound desc = could not find container \"5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525\": container with ID starting with 5c0480cd0853fd5a3d8a71ad29e51bdaf4bef472184423e717228f1b36c62525 not found: ID does not exist"
Sep 10 21:08:14.475860 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.475827    2579 scope.go:117] "RemoveContainer" containerID="dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a"
Sep 10 21:08:14.476062 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:08:14.476043    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a\": container with ID starting with dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a not found: ID does not exist" containerID="dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a"
Sep 10 21:08:14.476110 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.476067    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a"} err="failed to get container status \"dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a\": rpc error: code = NotFound desc = could not find container \"dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a\": container with ID starting with dad7f17428e101c55f344a44860a39a1c6983be7976ffd734f0cc2585860ff8a not found: ID does not exist"
Sep 10 21:08:14.482046 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.482025    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"]
Sep 10 21:08:14.488575 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:14.488543    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw"]
Sep 10 21:08:15.487492 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:15.487461    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" path="/var/lib/kubelet/pods/006bab71-e759-4a38-a22c-1d339706a3d0/volumes"
Sep 10 21:08:28.232503 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.232468    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:28.268522 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.268487    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"]
Sep 10 21:08:28.268799 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.268769    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j" podUID="b1c612d4-9a55-4b5a-9991-975e97b1e78c" containerName="payload-processing" containerID="cri-o://7d2ca149b701b478f96c715af2754efe31c9862fe79ea59ab5476ae3b1d181c9" gracePeriod=30
Sep 10 21:08:28.275508 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.275471    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"]
Sep 10 21:08:28.275747 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.275710    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh" podUID="09eefde4-4f9c-4fe2-b711-863a48059f02" containerName="payload-pre-processing" containerID="cri-o://7b0f50fa62a61c91710ee81d6af5ab8e393e2d910c3a272782304c3518dcf5ee" gracePeriod=30
Sep 10 21:08:28.300699 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.300622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:28.401693 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.401561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:28.462865 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.462832    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:28.529507 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.529404    2579 generic.go:356] "Generic (PLEG): container finished" podID="b1c612d4-9a55-4b5a-9991-975e97b1e78c" containerID="7d2ca149b701b478f96c715af2754efe31c9862fe79ea59ab5476ae3b1d181c9" exitCode=0
Sep 10 21:08:28.529507 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.529444    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j" event={"ID":"b1c612d4-9a55-4b5a-9991-975e97b1e78c","Type":"ContainerDied","Data":"7d2ca149b701b478f96c715af2754efe31c9862fe79ea59ab5476ae3b1d181c9"}
Sep 10 21:08:28.531356 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.531331    2579 generic.go:356] "Generic (PLEG): container finished" podID="09eefde4-4f9c-4fe2-b711-863a48059f02" containerID="7b0f50fa62a61c91710ee81d6af5ab8e393e2d910c3a272782304c3518dcf5ee" exitCode=0
Sep 10 21:08:28.531481 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.531363    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh" event={"ID":"09eefde4-4f9c-4fe2-b711-863a48059f02","Type":"ContainerDied","Data":"7b0f50fa62a61c91710ee81d6af5ab8e393e2d910c3a272782304c3518dcf5ee"}
Sep 10 21:08:28.560042 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.560020    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:08:28.563060 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.563043    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:08:28.661479 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.661445    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09eefde4-4f9c-4fe2-b711-863a48059f02-plugins-config-volume\") pod \"09eefde4-4f9c-4fe2-b711-863a48059f02\" (UID: \"09eefde4-4f9c-4fe2-b711-863a48059f02\") "
Sep 10 21:08:28.661693 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.661528    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1c612d4-9a55-4b5a-9991-975e97b1e78c-plugins-config-volume\") pod \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\" (UID: \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\") "
Sep 10 21:08:28.661693 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.661556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntcjh\" (UniqueName: \"kubernetes.io/projected/09eefde4-4f9c-4fe2-b711-863a48059f02-kube-api-access-ntcjh\") pod \"09eefde4-4f9c-4fe2-b711-863a48059f02\" (UID: \"09eefde4-4f9c-4fe2-b711-863a48059f02\") "
Sep 10 21:08:28.661693 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.661573    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ssfk\" (UniqueName: \"kubernetes.io/projected/b1c612d4-9a55-4b5a-9991-975e97b1e78c-kube-api-access-2ssfk\") pod \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\" (UID: \"b1c612d4-9a55-4b5a-9991-975e97b1e78c\") "
Sep 10 21:08:28.661887 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.661861    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09eefde4-4f9c-4fe2-b711-863a48059f02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "09eefde4-4f9c-4fe2-b711-863a48059f02" (UID: "09eefde4-4f9c-4fe2-b711-863a48059f02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:08:28.661974 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.661955    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09eefde4-4f9c-4fe2-b711-863a48059f02-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:28.662028 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.661985    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c612d4-9a55-4b5a-9991-975e97b1e78c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b1c612d4-9a55-4b5a-9991-975e97b1e78c" (UID: "b1c612d4-9a55-4b5a-9991-975e97b1e78c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:08:28.663718 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.663699    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09eefde4-4f9c-4fe2-b711-863a48059f02-kube-api-access-ntcjh" (OuterVolumeSpecName: "kube-api-access-ntcjh") pod "09eefde4-4f9c-4fe2-b711-863a48059f02" (UID: "09eefde4-4f9c-4fe2-b711-863a48059f02"). InnerVolumeSpecName "kube-api-access-ntcjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:08:28.663822 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.663802    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c612d4-9a55-4b5a-9991-975e97b1e78c-kube-api-access-2ssfk" (OuterVolumeSpecName: "kube-api-access-2ssfk") pod "b1c612d4-9a55-4b5a-9991-975e97b1e78c" (UID: "b1c612d4-9a55-4b5a-9991-975e97b1e78c"). InnerVolumeSpecName "kube-api-access-2ssfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:08:28.762739 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.762705    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1c612d4-9a55-4b5a-9991-975e97b1e78c-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:28.762739 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.762731    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntcjh\" (UniqueName: \"kubernetes.io/projected/09eefde4-4f9c-4fe2-b711-863a48059f02-kube-api-access-ntcjh\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:28.762739 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.762740    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ssfk\" (UniqueName: \"kubernetes.io/projected/b1c612d4-9a55-4b5a-9991-975e97b1e78c-kube-api-access-2ssfk\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:08:28.825421 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:28.825338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:29.537754 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.537723    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"
Sep 10 21:08:29.538185 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.537752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j" event={"ID":"b1c612d4-9a55-4b5a-9991-975e97b1e78c","Type":"ContainerDied","Data":"59f2a88bdd2add2747a2cbe71ce25dc39d367d6831847752d8223b43dbc531c1"}
Sep 10 21:08:29.538185 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.537810    2579 scope.go:117] "RemoveContainer" containerID="7d2ca149b701b478f96c715af2754efe31c9862fe79ea59ab5476ae3b1d181c9"
Sep 10 21:08:29.539279 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.539246    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh" event={"ID":"09eefde4-4f9c-4fe2-b711-863a48059f02","Type":"ContainerDied","Data":"50e6fe93923b8432c859aa7c64a8ec3dd8bfaee3b32c22a419d79713f7f93702"}
Sep 10 21:08:29.539363 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.539269    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"
Sep 10 21:08:29.546776 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.546753    2579 scope.go:117] "RemoveContainer" containerID="7b0f50fa62a61c91710ee81d6af5ab8e393e2d910c3a272782304c3518dcf5ee"
Sep 10 21:08:29.556251 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.556231    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"]
Sep 10 21:08:29.559849 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.559827    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j"]
Sep 10 21:08:29.570705 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.570684    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"]
Sep 10 21:08:29.578190 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:29.578169    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh"]
Sep 10 21:08:31.487800 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:31.487770    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09eefde4-4f9c-4fe2-b711-863a48059f02" path="/var/lib/kubelet/pods/09eefde4-4f9c-4fe2-b711-863a48059f02/volumes"
Sep 10 21:08:31.488164 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:31.488136    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c612d4-9a55-4b5a-9991-975e97b1e78c" path="/var/lib/kubelet/pods/b1c612d4-9a55-4b5a-9991-975e97b1e78c/volumes"
Sep 10 21:08:33.842392 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:33.842351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:43.113676 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:43.113610    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:57.822543 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:57.822504    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:57.874510 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:08:57.874481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:10.643164 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:10.643080    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:11.236746 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:11.236707    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:12.016432 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:12.016391    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:17.504300 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:17.504260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:17.565680 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:17.565646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:17.756386 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:17.756302    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"]
Sep 10 21:09:17.756623 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:17.756595    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy" containerID="cri-o://f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c" gracePeriod=30
Sep 10 21:09:17.772062 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:17.772030    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:18.325346 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:18.325314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:20.522467 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:20.522422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:23.004099 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.004074    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:09:23.069928 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.069853    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-envoy\") pod \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") "
Sep 10 21:09:23.069928 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.069883    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-certs\") pod \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") "
Sep 10 21:09:23.070139 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.069937    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-data\") pod \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") "
Sep 10 21:09:23.070139 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.069962    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5j4n\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-kube-api-access-p5j4n\") pod \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") "
Sep 10 21:09:23.070139 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.069990    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-podinfo\") pod \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") "
Sep 10 21:09:23.070307 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070148    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istiod-ca-cert\") pod \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") "
Sep 10 21:09:23.070307 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070195    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-credential-socket\") pod \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") "
Sep 10 21:09:23.070307 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070220    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-data" (OuterVolumeSpecName: "istio-data") pod "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" (UID: "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:23.070307 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070247    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-token\") pod \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") "
Sep 10 21:09:23.070307 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070297    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-socket\") pod \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\" (UID: \"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00\") "
Sep 10 21:09:23.070569 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070308    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" (UID: "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:23.070569 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070428    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" (UID: "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:23.070569 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070524    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" (UID: "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:09:23.070767 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070607    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" (UID: "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:23.070822 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070765    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:23.070822 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070778    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:23.070822 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070787    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:23.070822 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070795    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:23.070822 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.070803    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:23.072251 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.072219    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-kube-api-access-p5j4n" (OuterVolumeSpecName: "kube-api-access-p5j4n") pod "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" (UID: "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00"). InnerVolumeSpecName "kube-api-access-p5j4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:09:23.072251 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.072234    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-token" (OuterVolumeSpecName: "istio-token") pod "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" (UID: "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:09:23.072438 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.072422    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" (UID: "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:09:23.072482 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.072437    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" (UID: "57a1cf0a-06b1-45a4-8d52-cc3226ef4f00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:23.171742 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.171708    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5j4n\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-kube-api-access-p5j4n\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:23.171742 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.171736    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:23.171742 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.171748    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:23.171974 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.171756    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:23.800987 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.800893    2579 generic.go:356] "Generic (PLEG): container finished" podID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerID="f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c" exitCode=0
Sep 10 21:09:23.800987 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.800939    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"
Sep 10 21:09:23.800987 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.800975    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" event={"ID":"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00","Type":"ContainerDied","Data":"f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c"}
Sep 10 21:09:23.801266 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.801041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf" event={"ID":"57a1cf0a-06b1-45a4-8d52-cc3226ef4f00","Type":"ContainerDied","Data":"06ed7ee31e4fdd7db0b97e553f2220fe23f74bf85c0173de36cafbefe1f6f120"}
Sep 10 21:09:23.801266 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.801070    2579 scope.go:117] "RemoveContainer" containerID="f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c"
Sep 10 21:09:23.809663 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.809644    2579 scope.go:117] "RemoveContainer" containerID="78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7"
Sep 10 21:09:23.817273 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.817256    2579 scope.go:117] "RemoveContainer" containerID="f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c"
Sep 10 21:09:23.817560 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:09:23.817543    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c\": container with ID starting with f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c not found: ID does not exist" containerID="f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c"
Sep 10 21:09:23.817608 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.817570    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c"} err="failed to get container status \"f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c\": rpc error: code = NotFound desc = could not find container \"f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c\": container with ID starting with f8855e1ed2240ee378cafdf1616fcfd6a5ebef99ca0a00241f588d0f64975a6c not found: ID does not exist"
Sep 10 21:09:23.817608 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.817586    2579 scope.go:117] "RemoveContainer" containerID="78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7"
Sep 10 21:09:23.817839 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:09:23.817820    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7\": container with ID starting with 78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7 not found: ID does not exist" containerID="78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7"
Sep 10 21:09:23.817881 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.817846    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7"} err="failed to get container status \"78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7\": rpc error: code = NotFound desc = could not find container \"78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7\": container with ID starting with 78e1600b347c2211e723a69129b7d0d25cc1b84684451df3ef5124f45fb317f7 not found: ID does not exist"
Sep 10 21:09:23.821039 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.821017    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"]
Sep 10 21:09:23.824935 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:23.824916    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf"]
Sep 10 21:09:25.350794 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:25.350764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:25.486860 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:25.486831    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" path="/var/lib/kubelet/pods/57a1cf0a-06b1-45a4-8d52-cc3226ef4f00/volumes"
Sep 10 21:09:27.781129 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:27.781095    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:27.845358 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:27.845323    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:28.278745 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:28.278710    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:28.936396 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:28.936363    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.035168 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:29.035132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.134902 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:29.134867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.235409 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:29.235325    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.556550 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:29.556456    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:35.674303 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:35.674263    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:35.750410 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:35.750373    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:35.951481 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:35.951394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:36.510509 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:36.510474    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:46.862157 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:46.862113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:46.881006 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:46.880970    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"]
Sep 10 21:09:46.881262 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:46.881206    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk" podUID="4f5a5919-7631-48cf-917c-be6c9d0c772f" containerName="payload-processing" containerID="cri-o://1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db" gracePeriod=30
Sep 10 21:09:46.895977 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:46.895945    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"]
Sep 10 21:09:46.896204 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:46.896175    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg" podUID="f8d61787-97aa-4696-a2ee-2de85ddc79c8" containerName="payload-pre-processing" containerID="cri-o://0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907" gracePeriod=30
Sep 10 21:09:46.936371 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:46.936337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:47.029421 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.029392    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:47.146293 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.146186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:47.175542 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.175508    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 21:09:47.179426 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.179404    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 21:09:47.211454 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.211410    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:47.295068 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.295036    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d61787-97aa-4696-a2ee-2de85ddc79c8-plugins-config-volume\") pod \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\" (UID: \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\") "
Sep 10 21:09:47.295253 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.295075    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kr7q\" (UniqueName: \"kubernetes.io/projected/4f5a5919-7631-48cf-917c-be6c9d0c772f-kube-api-access-6kr7q\") pod \"4f5a5919-7631-48cf-917c-be6c9d0c772f\" (UID: \"4f5a5919-7631-48cf-917c-be6c9d0c772f\") "
Sep 10 21:09:47.295253 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.295198    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5a5919-7631-48cf-917c-be6c9d0c772f-plugins-config-volume\") pod \"4f5a5919-7631-48cf-917c-be6c9d0c772f\" (UID: \"4f5a5919-7631-48cf-917c-be6c9d0c772f\") "
Sep 10 21:09:47.295253 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.295234    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8xwv\" (UniqueName: \"kubernetes.io/projected/f8d61787-97aa-4696-a2ee-2de85ddc79c8-kube-api-access-p8xwv\") pod \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\" (UID: \"f8d61787-97aa-4696-a2ee-2de85ddc79c8\") "
Sep 10 21:09:47.295482 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.295456    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d61787-97aa-4696-a2ee-2de85ddc79c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8d61787-97aa-4696-a2ee-2de85ddc79c8" (UID: "f8d61787-97aa-4696-a2ee-2de85ddc79c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:09:47.295587 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.295564    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8d61787-97aa-4696-a2ee-2de85ddc79c8-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:47.295587 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.295564    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5a5919-7631-48cf-917c-be6c9d0c772f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4f5a5919-7631-48cf-917c-be6c9d0c772f" (UID: "4f5a5919-7631-48cf-917c-be6c9d0c772f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:09:47.297381 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.297361    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f5a5919-7631-48cf-917c-be6c9d0c772f-kube-api-access-6kr7q" (OuterVolumeSpecName: "kube-api-access-6kr7q") pod "4f5a5919-7631-48cf-917c-be6c9d0c772f" (UID: "4f5a5919-7631-48cf-917c-be6c9d0c772f"). InnerVolumeSpecName "kube-api-access-6kr7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:09:47.297563 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.297545    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d61787-97aa-4696-a2ee-2de85ddc79c8-kube-api-access-p8xwv" (OuterVolumeSpecName: "kube-api-access-p8xwv") pod "f8d61787-97aa-4696-a2ee-2de85ddc79c8" (UID: "f8d61787-97aa-4696-a2ee-2de85ddc79c8"). InnerVolumeSpecName "kube-api-access-p8xwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:09:47.396996 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.396913    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5a5919-7631-48cf-917c-be6c9d0c772f-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:47.396996 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.396944    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8xwv\" (UniqueName: \"kubernetes.io/projected/f8d61787-97aa-4696-a2ee-2de85ddc79c8-kube-api-access-p8xwv\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:47.396996 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.396954    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kr7q\" (UniqueName: \"kubernetes.io/projected/4f5a5919-7631-48cf-917c-be6c9d0c772f-kube-api-access-6kr7q\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:47.550470 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.550429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:47.922000 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.921965    2579 generic.go:356] "Generic (PLEG): container finished" podID="f8d61787-97aa-4696-a2ee-2de85ddc79c8" containerID="0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907" exitCode=0
Sep 10 21:09:47.922407 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.922020    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"
Sep 10 21:09:47.922407 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.922052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg" event={"ID":"f8d61787-97aa-4696-a2ee-2de85ddc79c8","Type":"ContainerDied","Data":"0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907"}
Sep 10 21:09:47.922407 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.922137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg" event={"ID":"f8d61787-97aa-4696-a2ee-2de85ddc79c8","Type":"ContainerDied","Data":"48b53a1215f7f669a503ba746bc81bc650947306f8a5229d4482dd836d568efc"}
Sep 10 21:09:47.922407 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.922165    2579 scope.go:117] "RemoveContainer" containerID="0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907"
Sep 10 21:09:47.923588 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.923423    2579 generic.go:356] "Generic (PLEG): container finished" podID="4f5a5919-7631-48cf-917c-be6c9d0c772f" containerID="1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db" exitCode=0
Sep 10 21:09:47.923588 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.923501    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"
Sep 10 21:09:47.923588 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.923519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk" event={"ID":"4f5a5919-7631-48cf-917c-be6c9d0c772f","Type":"ContainerDied","Data":"1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db"}
Sep 10 21:09:47.923588 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.923573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk" event={"ID":"4f5a5919-7631-48cf-917c-be6c9d0c772f","Type":"ContainerDied","Data":"c29a2c6c4eb99be6ce065e6170678766cbfe14cc2a223e349df853310d6b9cfc"}
Sep 10 21:09:47.931801 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.931785    2579 scope.go:117] "RemoveContainer" containerID="0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907"
Sep 10 21:09:47.932334 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:09:47.932311    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907\": container with ID starting with 0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907 not found: ID does not exist" containerID="0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907"
Sep 10 21:09:47.932476 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.932456    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907"} err="failed to get container status \"0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907\": rpc error: code = NotFound desc = could not find container \"0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907\": container with ID starting with 0a8f9422c1d42ceafc9c336f32be8e0638cea89e7fb255671e2c5bc8b8880907 not found: ID does not exist"
Sep 10 21:09:47.932567 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.932558    2579 scope.go:117] "RemoveContainer" containerID="1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db"
Sep 10 21:09:47.940685 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.940662    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"]
Sep 10 21:09:47.941090 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.941073    2579 scope.go:117] "RemoveContainer" containerID="1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db"
Sep 10 21:09:47.941365 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:09:47.941348    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db\": container with ID starting with 1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db not found: ID does not exist" containerID="1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db"
Sep 10 21:09:47.941425 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.941371    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db"} err="failed to get container status \"1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db\": rpc error: code = NotFound desc = could not find container \"1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db\": container with ID starting with 1ab482c33bbc77b0d5e0824271bd0d1f3535ed227682911d2663f2729b2226db not found: ID does not exist"
Sep 10 21:09:47.944618 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.944598    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg"]
Sep 10 21:09:47.956270 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.956247    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"]
Sep 10 21:09:47.960075 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:47.960052    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk"]
Sep 10 21:09:49.487461 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:49.487432    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f5a5919-7631-48cf-917c-be6c9d0c772f" path="/var/lib/kubelet/pods/4f5a5919-7631-48cf-917c-be6c9d0c772f/volumes"
Sep 10 21:09:49.487844 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:49.487807    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8d61787-97aa-4696-a2ee-2de85ddc79c8" path="/var/lib/kubelet/pods/f8d61787-97aa-4696-a2ee-2de85ddc79c8/volumes"
Sep 10 21:09:53.786505 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:53.786460    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:53.889333 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:53.889292    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:54.044182 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:54.044086    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"]
Sep 10 21:09:54.044407 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:54.044378    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy" containerID="cri-o://e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba" gracePeriod=30
Sep 10 21:09:54.071896 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:54.071870    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:54.510331 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:54.510291    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:55.080435 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:55.080402    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:09:55.080810 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:55.080467    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:09:59.299730 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.299708    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 21:09:59.402407 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402370    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-socket\") pod \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") "
Sep 10 21:09:59.402582 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402429    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-certs\") pod \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") "
Sep 10 21:09:59.402582 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402453    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-data\") pod \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") "
Sep 10 21:09:59.402582 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402491    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22k97\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-kube-api-access-22k97\") pod \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") "
Sep 10 21:09:59.402582 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402543    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-podinfo\") pod \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") "
Sep 10 21:09:59.402836 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402595    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-envoy\") pod \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") "
Sep 10 21:09:59.402836 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402618    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-token\") pod \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") "
Sep 10 21:09:59.402836 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402665    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istiod-ca-cert\") pod \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") "
Sep 10 21:09:59.402836 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402693    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-credential-socket\") pod \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\" (UID: \"2dcfc00c-361d-4a8a-b172-9ab211484ba0\") "
Sep 10 21:09:59.402836 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402734    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2dcfc00c-361d-4a8a-b172-9ab211484ba0" (UID: "2dcfc00c-361d-4a8a-b172-9ab211484ba0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:59.402836 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402751    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2dcfc00c-361d-4a8a-b172-9ab211484ba0" (UID: "2dcfc00c-361d-4a8a-b172-9ab211484ba0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:59.403142 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402921    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-data" (OuterVolumeSpecName: "istio-data") pod "2dcfc00c-361d-4a8a-b172-9ab211484ba0" (UID: "2dcfc00c-361d-4a8a-b172-9ab211484ba0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:59.403142 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402967    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.403142 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.402988    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-workload-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.403142 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.403027    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2dcfc00c-361d-4a8a-b172-9ab211484ba0" (UID: "2dcfc00c-361d-4a8a-b172-9ab211484ba0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:59.403142 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.403071    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2dcfc00c-361d-4a8a-b172-9ab211484ba0" (UID: "2dcfc00c-361d-4a8a-b172-9ab211484ba0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:09:59.404809 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.404790    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-kube-api-access-22k97" (OuterVolumeSpecName: "kube-api-access-22k97") pod "2dcfc00c-361d-4a8a-b172-9ab211484ba0" (UID: "2dcfc00c-361d-4a8a-b172-9ab211484ba0"). InnerVolumeSpecName "kube-api-access-22k97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:09:59.404914 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.404839    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2dcfc00c-361d-4a8a-b172-9ab211484ba0" (UID: "2dcfc00c-361d-4a8a-b172-9ab211484ba0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:09:59.405176 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.405157    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-token" (OuterVolumeSpecName: "istio-token") pod "2dcfc00c-361d-4a8a-b172-9ab211484ba0" (UID: "2dcfc00c-361d-4a8a-b172-9ab211484ba0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:09:59.405219 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.405164    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2dcfc00c-361d-4a8a-b172-9ab211484ba0" (UID: "2dcfc00c-361d-4a8a-b172-9ab211484ba0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:09:59.504395 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.504370    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-data\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.504519 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.504397    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22k97\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-kube-api-access-22k97\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.504519 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.504411    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-podinfo\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.504519 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.504440    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-envoy\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.504519 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.504451    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istio-token\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.504519 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.504462    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dcfc00c-361d-4a8a-b172-9ab211484ba0-istiod-ca-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.504519 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.504474    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dcfc00c-361d-4a8a-b172-9ab211484ba0-credential-socket\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:09:59.980403 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.980364    2579 generic.go:356] "Generic (PLEG): container finished" podID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerID="e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba" exitCode=0
Sep 10 21:09:59.980648 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.980440    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"
Sep 10 21:09:59.980648 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.980459    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" event={"ID":"2dcfc00c-361d-4a8a-b172-9ab211484ba0","Type":"ContainerDied","Data":"e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba"}
Sep 10 21:09:59.980648 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.980530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh" event={"ID":"2dcfc00c-361d-4a8a-b172-9ab211484ba0","Type":"ContainerDied","Data":"b573e83147897dc254109b8aad919e9526fdd30085f87843d3543443f03d9318"}
Sep 10 21:09:59.980648 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.980563    2579 scope.go:117] "RemoveContainer" containerID="e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba"
Sep 10 21:09:59.989221 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.989200    2579 scope.go:117] "RemoveContainer" containerID="16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3"
Sep 10 21:09:59.997004 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.996986    2579 scope.go:117] "RemoveContainer" containerID="e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba"
Sep 10 21:09:59.997329 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:09:59.997307    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba\": container with ID starting with e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba not found: ID does not exist" containerID="e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba"
Sep 10 21:09:59.997848 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.997335    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba"} err="failed to get container status \"e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba\": rpc error: code = NotFound desc = could not find container \"e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba\": container with ID starting with e1528a506878726569ea3b70eaff3bc5f3a458eee92c57923256548a863a72ba not found: ID does not exist"
Sep 10 21:09:59.997848 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.997353    2579 scope.go:117] "RemoveContainer" containerID="16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3"
Sep 10 21:09:59.997848 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:09:59.997714    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3\": container with ID starting with 16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3 not found: ID does not exist" containerID="16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3"
Sep 10 21:09:59.997848 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.997746    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3"} err="failed to get container status \"16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3\": rpc error: code = NotFound desc = could not find container \"16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3\": container with ID starting with 16a669ebf9d71eae02ca58e17abdb3cec39dec967cb5716dd749638ac8cf85d3 not found: ID does not exist"
Sep 10 21:09:59.999895 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:09:59.999875    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"]
Sep 10 21:10:00.003939 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:00.003918    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh"]
Sep 10 21:10:01.487116 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:01.487084    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" path="/var/lib/kubelet/pods/2dcfc00c-361d-4a8a-b172-9ab211484ba0/volumes"
Sep 10 21:10:05.097638 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.097594    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv"]
Sep 10 21:10:05.101179 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.101151    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-f4fe4f-29817900-xj2kv"]
Sep 10 21:10:05.102963 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.102934    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:05.132373 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.132344    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"]
Sep 10 21:10:05.132564 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.132526    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc" podUID="278626a8-a86c-4ef8-bdb9-73e20ef08a23" containerName="payload-pre-processing" containerID="cri-o://3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde" gracePeriod=30
Sep 10 21:10:05.162691 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.162665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:05.265704 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.265673    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:05.325484 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.325365    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:05.393902 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.393875    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 21:10:05.455567 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.455528    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/278626a8-a86c-4ef8-bdb9-73e20ef08a23-plugins-config-volume\") pod \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\" (UID: \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\") "
Sep 10 21:10:05.455786 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.455658    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx7cg\" (UniqueName: \"kubernetes.io/projected/278626a8-a86c-4ef8-bdb9-73e20ef08a23-kube-api-access-gx7cg\") pod \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\" (UID: \"278626a8-a86c-4ef8-bdb9-73e20ef08a23\") "
Sep 10 21:10:05.455938 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.455915    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/278626a8-a86c-4ef8-bdb9-73e20ef08a23-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "278626a8-a86c-4ef8-bdb9-73e20ef08a23" (UID: "278626a8-a86c-4ef8-bdb9-73e20ef08a23"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:10:05.456189 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.456169    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/278626a8-a86c-4ef8-bdb9-73e20ef08a23-plugins-config-volume\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:10:05.458042 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.458015    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/278626a8-a86c-4ef8-bdb9-73e20ef08a23-kube-api-access-gx7cg" (OuterVolumeSpecName: "kube-api-access-gx7cg") pod "278626a8-a86c-4ef8-bdb9-73e20ef08a23" (UID: "278626a8-a86c-4ef8-bdb9-73e20ef08a23"). InnerVolumeSpecName "kube-api-access-gx7cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:05.489178 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.487660    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95cafba8-aaba-4979-af47-981f6b656b24" path="/var/lib/kubelet/pods/95cafba8-aaba-4979-af47-981f6b656b24/volumes"
Sep 10 21:10:05.557078 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.557044    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx7cg\" (UniqueName: \"kubernetes.io/projected/278626a8-a86c-4ef8-bdb9-73e20ef08a23-kube-api-access-gx7cg\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:10:05.668475 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:05.668428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:06.009851 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:06.009765    2579 generic.go:356] "Generic (PLEG): container finished" podID="278626a8-a86c-4ef8-bdb9-73e20ef08a23" containerID="3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde" exitCode=0
Sep 10 21:10:06.009851 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:06.009823    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"
Sep 10 21:10:06.010085 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:06.009846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc" event={"ID":"278626a8-a86c-4ef8-bdb9-73e20ef08a23","Type":"ContainerDied","Data":"3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde"}
Sep 10 21:10:06.010085 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:06.009908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc" event={"ID":"278626a8-a86c-4ef8-bdb9-73e20ef08a23","Type":"ContainerDied","Data":"3a6623316330f0452f830af030a3a35bce2f89534686ad93800e2e97db179fa0"}
Sep 10 21:10:06.010085 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:06.009936    2579 scope.go:117] "RemoveContainer" containerID="3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde"
Sep 10 21:10:06.018459 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:06.018439    2579 scope.go:117] "RemoveContainer" containerID="3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde"
Sep 10 21:10:06.018759 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:10:06.018733    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde\": container with ID starting with 3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde not found: ID does not exist" containerID="3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde"
Sep 10 21:10:06.018850 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:06.018771    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde"} err="failed to get container status \"3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde\": rpc error: code = NotFound desc = could not find container \"3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde\": container with ID starting with 3232fd67a72d5261eb137694c05c3f32498ac0e9cdbcffc40385106f24a0bbde not found: ID does not exist"
Sep 10 21:10:06.027913 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:06.027885    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"]
Sep 10 21:10:06.029582 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:06.029557    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc"]
Sep 10 21:10:07.486970 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:07.486928    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="278626a8-a86c-4ef8-bdb9-73e20ef08a23" path="/var/lib/kubelet/pods/278626a8-a86c-4ef8-bdb9-73e20ef08a23/volumes"
Sep 10 21:10:12.001073 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:12.001041    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:12.103911 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:12.103875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:12.274220 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:12.274128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.676234 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:14.676203    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-jpsjs"]
Sep 10 21:10:14.676646 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:14.676396    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6db979f4bf-jpsjs" podUID="4f886574-1899-4a7c-bbe6-622cfd167339" containerName="manager" containerID="cri-o://99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333" gracePeriod=30
Sep 10 21:10:14.926384 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:14.926327    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 21:10:15.039884 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.039856    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-webhook-cert\") pod \"4f886574-1899-4a7c-bbe6-622cfd167339\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") "
Sep 10 21:10:15.039884 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.039887    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-metrics-certs\") pod \"4f886574-1899-4a7c-bbe6-622cfd167339\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") "
Sep 10 21:10:15.040070 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.039932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl99v\" (UniqueName: \"kubernetes.io/projected/4f886574-1899-4a7c-bbe6-622cfd167339-kube-api-access-cl99v\") pod \"4f886574-1899-4a7c-bbe6-622cfd167339\" (UID: \"4f886574-1899-4a7c-bbe6-622cfd167339\") "
Sep 10 21:10:15.042027 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.042000    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4f886574-1899-4a7c-bbe6-622cfd167339" (UID: "4f886574-1899-4a7c-bbe6-622cfd167339"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:10:15.042159 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.042046    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4f886574-1899-4a7c-bbe6-622cfd167339" (UID: "4f886574-1899-4a7c-bbe6-622cfd167339"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:10:15.042159 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.042058    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f886574-1899-4a7c-bbe6-622cfd167339-kube-api-access-cl99v" (OuterVolumeSpecName: "kube-api-access-cl99v") pod "4f886574-1899-4a7c-bbe6-622cfd167339" (UID: "4f886574-1899-4a7c-bbe6-622cfd167339"). InnerVolumeSpecName "kube-api-access-cl99v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:15.054208 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.054168    2579 generic.go:356] "Generic (PLEG): container finished" podID="4f886574-1899-4a7c-bbe6-622cfd167339" containerID="99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333" exitCode=0
Sep 10 21:10:15.054208 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.054205    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-jpsjs"
Sep 10 21:10:15.054348 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.054240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-jpsjs" event={"ID":"4f886574-1899-4a7c-bbe6-622cfd167339","Type":"ContainerDied","Data":"99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333"}
Sep 10 21:10:15.054348 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.054292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-jpsjs" event={"ID":"4f886574-1899-4a7c-bbe6-622cfd167339","Type":"ContainerDied","Data":"16d37d3232a29b82a4078aa57be7b6d7522cd4c67874ba1471fbb0f50a4786a2"}
Sep 10 21:10:15.054348 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.054315    2579 scope.go:117] "RemoveContainer" containerID="99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333"
Sep 10 21:10:15.064069 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.064049    2579 scope.go:117] "RemoveContainer" containerID="99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333"
Sep 10 21:10:15.064323 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:10:15.064305    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333\": container with ID starting with 99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333 not found: ID does not exist" containerID="99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333"
Sep 10 21:10:15.064368 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.064331    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333"} err="failed to get container status \"99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333\": rpc error: code = NotFound desc = could not find container \"99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333\": container with ID starting with 99aef260a76832afee0064f2616568a3696d9bd9e17d177180991ca6f5971333 not found: ID does not exist"
Sep 10 21:10:15.077309 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.077268    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-jpsjs"]
Sep 10 21:10:15.079465 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.079444    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-jpsjs"]
Sep 10 21:10:15.140911 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.140888    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl99v\" (UniqueName: \"kubernetes.io/projected/4f886574-1899-4a7c-bbe6-622cfd167339-kube-api-access-cl99v\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.140911 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.140910    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-webhook-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.141037 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.140921    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f886574-1899-4a7c-bbe6-622cfd167339-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:10:15.488138 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.488107    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f886574-1899-4a7c-bbe6-622cfd167339" path="/var/lib/kubelet/pods/4f886574-1899-4a7c-bbe6-622cfd167339/volumes"
Sep 10 21:10:15.757191 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.757122    2579 scope.go:117] "RemoveContainer" containerID="fe46a9669d0ffc19518556cfaa4c700fa7ef74294b61ac4ece105532a058d082"
Sep 10 21:10:15.764813 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:10:15.764792    2579 scope.go:117] "RemoveContainer" containerID="75ee58efac3e63208ac70a2378bbcb28a83981a7cbf407c44d1bf1b7520fd89c"
Sep 10 21:11:15.868729 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.868696    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6db979f4bf-p9698"]
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869039    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869051    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869062    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869069    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869076    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869108    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869120    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e579ba1-66bd-4059-a545-3269a10dd84a" containerName="payload-pre-processing"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869125    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e579ba1-66bd-4059-a545-3269a10dd84a" containerName="payload-pre-processing"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869135    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d61787-97aa-4696-a2ee-2de85ddc79c8" containerName="payload-pre-processing"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869143    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d61787-97aa-4696-a2ee-2de85ddc79c8" containerName="payload-pre-processing"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869153    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869161    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869175    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869184    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869195    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c612d4-9a55-4b5a-9991-975e97b1e78c" containerName="payload-processing"
Sep 10 21:11:15.869202 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869204    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c612d4-9a55-4b5a-9991-975e97b1e78c" containerName="payload-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869216    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09eefde4-4f9c-4fe2-b711-863a48059f02" containerName="payload-pre-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869221    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09eefde4-4f9c-4fe2-b711-863a48059f02" containerName="payload-pre-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869234    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f886574-1899-4a7c-bbe6-622cfd167339" containerName="manager"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869239    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f886574-1899-4a7c-bbe6-622cfd167339" containerName="manager"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869248    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5a5919-7631-48cf-917c-be6c9d0c772f" containerName="payload-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869253    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5a5919-7631-48cf-917c-be6c9d0c772f" containerName="payload-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869260    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="278626a8-a86c-4ef8-bdb9-73e20ef08a23" containerName="payload-pre-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869265    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="278626a8-a86c-4ef8-bdb9-73e20ef08a23" containerName="payload-pre-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869326    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869335    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="006bab71-e759-4a38-a22c-1d339706a3d0" containerName="istio-proxy"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869340    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869347    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="09eefde4-4f9c-4fe2-b711-863a48059f02" containerName="payload-pre-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869353    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f886574-1899-4a7c-bbe6-622cfd167339" containerName="manager"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869358    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e579ba1-66bd-4059-a545-3269a10dd84a" containerName="payload-pre-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869364    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f5a5919-7631-48cf-917c-be6c9d0c772f" containerName="payload-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869370    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869376    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869381    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="278626a8-a86c-4ef8-bdb9-73e20ef08a23" containerName="payload-pre-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869388    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c612d4-9a55-4b5a-9991-975e97b1e78c" containerName="payload-processing"
Sep 10 21:11:15.869877 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.869395    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d61787-97aa-4696-a2ee-2de85ddc79c8" containerName="payload-pre-processing"
Sep 10 21:11:15.872516 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.872496    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:15.876890 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.876860    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 21:11:15.876890 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.876863    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 21:11:15.877063 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.876968    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k557b\""
Sep 10 21:11:15.877112 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.877084    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 21:11:15.882591 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.882573    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-p9698"]
Sep 10 21:11:15.971479 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.971424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-webhook-cert\") pod \"maas-controller-6db979f4bf-p9698\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") " pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:15.971702 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.971501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-metrics-certs\") pod \"maas-controller-6db979f4bf-p9698\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") " pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:15.971702 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:15.971578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5c4h\" (UniqueName: \"kubernetes.io/projected/237a1521-890d-46d5-aac3-4308d8388af9-kube-api-access-h5c4h\") pod \"maas-controller-6db979f4bf-p9698\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") " pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:16.072127 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:16.072093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5c4h\" (UniqueName: \"kubernetes.io/projected/237a1521-890d-46d5-aac3-4308d8388af9-kube-api-access-h5c4h\") pod \"maas-controller-6db979f4bf-p9698\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") " pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:16.072318 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:16.072137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-webhook-cert\") pod \"maas-controller-6db979f4bf-p9698\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") " pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:16.072318 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:16.072282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-metrics-certs\") pod \"maas-controller-6db979f4bf-p9698\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") " pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:16.074730 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:16.074702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-webhook-cert\") pod \"maas-controller-6db979f4bf-p9698\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") " pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:16.074855 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:16.074702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-metrics-certs\") pod \"maas-controller-6db979f4bf-p9698\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") " pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:16.080682 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:16.080655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5c4h\" (UniqueName: \"kubernetes.io/projected/237a1521-890d-46d5-aac3-4308d8388af9-kube-api-access-h5c4h\") pod \"maas-controller-6db979f4bf-p9698\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") " pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:16.183751 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:16.183720    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:16.457750 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:16.457724    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-p9698"]
Sep 10 21:11:16.459919 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:11:16.459890    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237a1521_890d_46d5_aac3_4308d8388af9.slice/crio-acaa186df897edbe7aedf96cab0a742284d6a8aecbfac627abce5c852019041d WatchSource:0}: Error finding container acaa186df897edbe7aedf96cab0a742284d6a8aecbfac627abce5c852019041d: Status 404 returned error can't find the container with id acaa186df897edbe7aedf96cab0a742284d6a8aecbfac627abce5c852019041d
Sep 10 21:11:16.461325 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:16.461302    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:11:17.321507 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:17.321416    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-p9698" event={"ID":"237a1521-890d-46d5-aac3-4308d8388af9","Type":"ContainerStarted","Data":"6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31"}
Sep 10 21:11:17.321507 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:17.321477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-p9698" event={"ID":"237a1521-890d-46d5-aac3-4308d8388af9","Type":"ContainerStarted","Data":"acaa186df897edbe7aedf96cab0a742284d6a8aecbfac627abce5c852019041d"}
Sep 10 21:11:17.321963 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:17.321525    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:17.340855 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:17.340804    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6db979f4bf-p9698" podStartSLOduration=1.731923444 podStartE2EDuration="2.340784863s" totalImagesPullingTime="608.861419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:17.34026141 +0000 UTC m=+2102.377162924" watchObservedRunningTime="2026-09-10 21:11:17.340784863 +0000 UTC m=+2102.377686377"
Sep 10 21:11:28.327666 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:28.327614    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:35.038568 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.038533    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:35.413967 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.413933    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:35.511099 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.511055    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-p9698"]
Sep 10 21:11:35.511334 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.511304    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6db979f4bf-p9698" podUID="237a1521-890d-46d5-aac3-4308d8388af9" containerName="manager" containerID="cri-o://6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31" gracePeriod=30
Sep 10 21:11:35.761125 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.761102    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:35.849997 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.849967    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-webhook-cert\") pod \"237a1521-890d-46d5-aac3-4308d8388af9\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") "
Sep 10 21:11:35.850157 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.850007    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5c4h\" (UniqueName: \"kubernetes.io/projected/237a1521-890d-46d5-aac3-4308d8388af9-kube-api-access-h5c4h\") pod \"237a1521-890d-46d5-aac3-4308d8388af9\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") "
Sep 10 21:11:35.850157 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.850024    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-metrics-certs\") pod \"237a1521-890d-46d5-aac3-4308d8388af9\" (UID: \"237a1521-890d-46d5-aac3-4308d8388af9\") "
Sep 10 21:11:35.852164 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.852123    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/237a1521-890d-46d5-aac3-4308d8388af9-kube-api-access-h5c4h" (OuterVolumeSpecName: "kube-api-access-h5c4h") pod "237a1521-890d-46d5-aac3-4308d8388af9" (UID: "237a1521-890d-46d5-aac3-4308d8388af9"). InnerVolumeSpecName "kube-api-access-h5c4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:35.852418 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.852297    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "237a1521-890d-46d5-aac3-4308d8388af9" (UID: "237a1521-890d-46d5-aac3-4308d8388af9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:35.852418 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.852327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "237a1521-890d-46d5-aac3-4308d8388af9" (UID: "237a1521-890d-46d5-aac3-4308d8388af9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:35.951180 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.951071    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-webhook-cert\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:11:35.951180 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.951118    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5c4h\" (UniqueName: \"kubernetes.io/projected/237a1521-890d-46d5-aac3-4308d8388af9-kube-api-access-h5c4h\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:11:35.951180 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:35.951130    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237a1521-890d-46d5-aac3-4308d8388af9-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:11:36.409968 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:36.409936    2579 generic.go:356] "Generic (PLEG): container finished" podID="237a1521-890d-46d5-aac3-4308d8388af9" containerID="6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31" exitCode=0
Sep 10 21:11:36.410376 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:36.409983    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-p9698"
Sep 10 21:11:36.410376 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:36.410026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-p9698" event={"ID":"237a1521-890d-46d5-aac3-4308d8388af9","Type":"ContainerDied","Data":"6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31"}
Sep 10 21:11:36.410376 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:36.410092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-p9698" event={"ID":"237a1521-890d-46d5-aac3-4308d8388af9","Type":"ContainerDied","Data":"acaa186df897edbe7aedf96cab0a742284d6a8aecbfac627abce5c852019041d"}
Sep 10 21:11:36.410376 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:36.410124    2579 scope.go:117] "RemoveContainer" containerID="6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31"
Sep 10 21:11:36.419203 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:36.419187    2579 scope.go:117] "RemoveContainer" containerID="6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31"
Sep 10 21:11:36.419488 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:11:36.419471    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31\": container with ID starting with 6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31 not found: ID does not exist" containerID="6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31"
Sep 10 21:11:36.419536 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:36.419496    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31"} err="failed to get container status \"6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31\": rpc error: code = NotFound desc = could not find container \"6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31\": container with ID starting with 6cb482e25e262cfa4aed7e6bc6bff13cf1ccf4c0c33b97364d8e2da2a0a32f31 not found: ID does not exist"
Sep 10 21:11:36.432962 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:36.432938    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-p9698"]
Sep 10 21:11:36.438289 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:36.438270    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-p9698"]
Sep 10 21:11:37.122415 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.122377    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:37.242246 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.242208    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6db979f4bf-48tlz"]
Sep 10 21:11:37.242677 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.242658    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="237a1521-890d-46d5-aac3-4308d8388af9" containerName="manager"
Sep 10 21:11:37.242783 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.242678    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="237a1521-890d-46d5-aac3-4308d8388af9" containerName="manager"
Sep 10 21:11:37.242783 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.242697    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy"
Sep 10 21:11:37.242783 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.242705    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dcfc00c-361d-4a8a-b172-9ab211484ba0" containerName="istio-proxy"
Sep 10 21:11:37.242783 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.242782    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="237a1521-890d-46d5-aac3-4308d8388af9" containerName="manager"
Sep 10 21:11:37.242977 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.242800    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57a1cf0a-06b1-45a4-8d52-cc3226ef4f00" containerName="istio-proxy"
Sep 10 21:11:37.247137 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.247117    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.251539 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.251513    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 21:11:37.251673 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.251517    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k557b\""
Sep 10 21:11:37.251673 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.251599    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 21:11:37.251934 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.251690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 21:11:37.255403 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.255373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-48tlz"]
Sep 10 21:11:37.263642 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.263605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85kd2\" (UniqueName: \"kubernetes.io/projected/40d81493-542b-489d-a8f7-93060aa403d3-kube-api-access-85kd2\") pod \"maas-controller-6db979f4bf-48tlz\" (UID: \"40d81493-542b-489d-a8f7-93060aa403d3\") " pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.263728 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.263695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40d81493-542b-489d-a8f7-93060aa403d3-webhook-cert\") pod \"maas-controller-6db979f4bf-48tlz\" (UID: \"40d81493-542b-489d-a8f7-93060aa403d3\") " pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.263783 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.263755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40d81493-542b-489d-a8f7-93060aa403d3-metrics-certs\") pod \"maas-controller-6db979f4bf-48tlz\" (UID: \"40d81493-542b-489d-a8f7-93060aa403d3\") " pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.364612 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.364570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kd2\" (UniqueName: \"kubernetes.io/projected/40d81493-542b-489d-a8f7-93060aa403d3-kube-api-access-85kd2\") pod \"maas-controller-6db979f4bf-48tlz\" (UID: \"40d81493-542b-489d-a8f7-93060aa403d3\") " pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.364816 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.364658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40d81493-542b-489d-a8f7-93060aa403d3-webhook-cert\") pod \"maas-controller-6db979f4bf-48tlz\" (UID: \"40d81493-542b-489d-a8f7-93060aa403d3\") " pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.364816 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.364705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40d81493-542b-489d-a8f7-93060aa403d3-metrics-certs\") pod \"maas-controller-6db979f4bf-48tlz\" (UID: \"40d81493-542b-489d-a8f7-93060aa403d3\") " pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.367177 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.367153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40d81493-542b-489d-a8f7-93060aa403d3-metrics-certs\") pod \"maas-controller-6db979f4bf-48tlz\" (UID: \"40d81493-542b-489d-a8f7-93060aa403d3\") " pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.367334 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.367185    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40d81493-542b-489d-a8f7-93060aa403d3-webhook-cert\") pod \"maas-controller-6db979f4bf-48tlz\" (UID: \"40d81493-542b-489d-a8f7-93060aa403d3\") " pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.374792 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.374719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85kd2\" (UniqueName: \"kubernetes.io/projected/40d81493-542b-489d-a8f7-93060aa403d3-kube-api-access-85kd2\") pod \"maas-controller-6db979f4bf-48tlz\" (UID: \"40d81493-542b-489d-a8f7-93060aa403d3\") " pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.486381 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.486348    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="237a1521-890d-46d5-aac3-4308d8388af9" path="/var/lib/kubelet/pods/237a1521-890d-46d5-aac3-4308d8388af9/volumes"
Sep 10 21:11:37.557749 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.557709    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:37.828771 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:37.828685    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6db979f4bf-48tlz"]
Sep 10 21:11:37.831124 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:11:37.831089    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d81493_542b_489d_a8f7_93060aa403d3.slice/crio-c2b6d7b661f2bc41a41f0fa24942fc940b81a816e67725f204a489a4ca289849 WatchSource:0}: Error finding container c2b6d7b661f2bc41a41f0fa24942fc940b81a816e67725f204a489a4ca289849: Status 404 returned error can't find the container with id c2b6d7b661f2bc41a41f0fa24942fc940b81a816e67725f204a489a4ca289849
Sep 10 21:11:38.422363 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:38.422329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-48tlz" event={"ID":"40d81493-542b-489d-a8f7-93060aa403d3","Type":"ContainerStarted","Data":"bc4cbfd45130f5a0dd0346bf3545cda36d2c239dc0eaaf30a48fce7d20e1fd86"}
Sep 10 21:11:38.422568 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:38.422386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6db979f4bf-48tlz" event={"ID":"40d81493-542b-489d-a8f7-93060aa403d3","Type":"ContainerStarted","Data":"c2b6d7b661f2bc41a41f0fa24942fc940b81a816e67725f204a489a4ca289849"}
Sep 10 21:11:38.422568 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:38.422453    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:11:38.446093 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:38.446039    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6db979f4bf-48tlz" podStartSLOduration=1.15894839 podStartE2EDuration="1.446023176s" totalImagesPullingTime="287.074786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:38.444940555 +0000 UTC m=+2123.481842081" watchObservedRunningTime="2026-09-10 21:11:38.446023176 +0000 UTC m=+2123.482924731"
Sep 10 21:11:49.429482 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:11:49.429440    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6db979f4bf-48tlz"
Sep 10 21:12:09.105670 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:12:09.105558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:30.405683 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:12:30.405622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:30.503345 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:12:30.503310    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:27.167784 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:14:27.167744    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:27.252462 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:14:27.252431    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:33.130716 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:14:33.130686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:50.727645 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:14:50.727604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:16.495643 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:16.495597    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:18.611106 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:18.611071    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:49.759712 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.759673    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"]
Sep 10 21:15:49.763046 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.763027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.775510 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.775484    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"]
Sep 10 21:15:49.804722 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.804682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c809ee-1047-48ed-b051-7249fc3f238b-openshift-service-ca\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.804875 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.804748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c809ee-1047-48ed-b051-7249fc3f238b-metrics-certs\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.804875 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.804798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcxwm\" (UniqueName: \"kubernetes.io/projected/10c809ee-1047-48ed-b051-7249fc3f238b-kube-api-access-gcxwm\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.804972 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.804874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c809ee-1047-48ed-b051-7249fc3f238b-maas-api-tls\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.906118 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.906080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c809ee-1047-48ed-b051-7249fc3f238b-metrics-certs\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.906301 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.906128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcxwm\" (UniqueName: \"kubernetes.io/projected/10c809ee-1047-48ed-b051-7249fc3f238b-kube-api-access-gcxwm\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.906301 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.906156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c809ee-1047-48ed-b051-7249fc3f238b-maas-api-tls\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.906301 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.906193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c809ee-1047-48ed-b051-7249fc3f238b-openshift-service-ca\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.906840 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.906821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c809ee-1047-48ed-b051-7249fc3f238b-openshift-service-ca\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.908609 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.908580    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c809ee-1047-48ed-b051-7249fc3f238b-metrics-certs\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.908743 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.908722    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c809ee-1047-48ed-b051-7249fc3f238b-maas-api-tls\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:49.914852 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:49.914828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcxwm\" (UniqueName: \"kubernetes.io/projected/10c809ee-1047-48ed-b051-7249fc3f238b-kube-api-access-gcxwm\") pod \"maas-api-7c74b8f674-9tjk2\" (UID: \"10c809ee-1047-48ed-b051-7249fc3f238b\") " pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:50.073491 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:50.073399    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:50.347998 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:50.347925    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"]
Sep 10 21:15:50.351129 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:15:50.351105    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c809ee_1047_48ed_b051_7249fc3f238b.slice/crio-05384aa4f49994275dfd4c8f0a8e3c12cf0b7d79b2cc5232eb8e388cb9cc351a WatchSource:0}: Error finding container 05384aa4f49994275dfd4c8f0a8e3c12cf0b7d79b2cc5232eb8e388cb9cc351a: Status 404 returned error can't find the container with id 05384aa4f49994275dfd4c8f0a8e3c12cf0b7d79b2cc5232eb8e388cb9cc351a
Sep 10 21:15:50.544583 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:50.544544    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2" event={"ID":"10c809ee-1047-48ed-b051-7249fc3f238b","Type":"ContainerStarted","Data":"05384aa4f49994275dfd4c8f0a8e3c12cf0b7d79b2cc5232eb8e388cb9cc351a"}
Sep 10 21:15:51.550362 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:51.550328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2" event={"ID":"10c809ee-1047-48ed-b051-7249fc3f238b","Type":"ContainerStarted","Data":"61b54bddba31f1ec2dbc3d871ee752e6a9a7035fb01c9288d43b674d7c281932"}
Sep 10 21:15:51.550825 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:51.550447    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:51.576933 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:51.576888    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2" podStartSLOduration=2.24679475 podStartE2EDuration="2.57687206s" totalImagesPullingTime="330.07731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:51.574937254 +0000 UTC m=+2376.611838768" watchObservedRunningTime="2026-09-10 21:15:51.57687206 +0000 UTC m=+2376.613773572"
Sep 10 21:15:57.561154 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:57.561125    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7c74b8f674-9tjk2"
Sep 10 21:15:57.623904 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:57.623873    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"]
Sep 10 21:15:57.624114 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:57.624091    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76" podUID="371f6bb1-c93e-44bf-ad42-9bf18f6204b1" containerName="maas-api" containerID="cri-o://5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e" gracePeriod=30
Sep 10 21:15:58.863020 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:58.862995    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 21:15:58.990652 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:58.990557    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-maas-api-tls\") pod \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") "
Sep 10 21:15:58.990652 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:58.990590    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-metrics-certs\") pod \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") "
Sep 10 21:15:58.990845 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:58.990671    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6psh\" (UniqueName: \"kubernetes.io/projected/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-kube-api-access-m6psh\") pod \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") "
Sep 10 21:15:58.990845 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:58.990717    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-openshift-service-ca\") pod \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\" (UID: \"371f6bb1-c93e-44bf-ad42-9bf18f6204b1\") "
Sep 10 21:15:58.991132 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:58.991110    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "371f6bb1-c93e-44bf-ad42-9bf18f6204b1" (UID: "371f6bb1-c93e-44bf-ad42-9bf18f6204b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:15:58.992821 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:58.992785    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-kube-api-access-m6psh" (OuterVolumeSpecName: "kube-api-access-m6psh") pod "371f6bb1-c93e-44bf-ad42-9bf18f6204b1" (UID: "371f6bb1-c93e-44bf-ad42-9bf18f6204b1"). InnerVolumeSpecName "kube-api-access-m6psh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:15:58.992821 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:58.992797    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "371f6bb1-c93e-44bf-ad42-9bf18f6204b1" (UID: "371f6bb1-c93e-44bf-ad42-9bf18f6204b1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:15:58.992821 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:58.992815    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "371f6bb1-c93e-44bf-ad42-9bf18f6204b1" (UID: "371f6bb1-c93e-44bf-ad42-9bf18f6204b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:15:59.092078 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.092045    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-maas-api-tls\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:15:59.092078 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.092070    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-metrics-certs\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:15:59.092078 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.092081    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6psh\" (UniqueName: \"kubernetes.io/projected/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-kube-api-access-m6psh\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:15:59.092290 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.092090    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371f6bb1-c93e-44bf-ad42-9bf18f6204b1-openshift-service-ca\") on node \"ip-10-0-143-160.ec2.internal\" DevicePath \"\""
Sep 10 21:15:59.586724 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.586688    2579 generic.go:356] "Generic (PLEG): container finished" podID="371f6bb1-c93e-44bf-ad42-9bf18f6204b1" containerID="5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e" exitCode=0
Sep 10 21:15:59.586888 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.586738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76" event={"ID":"371f6bb1-c93e-44bf-ad42-9bf18f6204b1","Type":"ContainerDied","Data":"5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e"}
Sep 10 21:15:59.586888 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.586779    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76" event={"ID":"371f6bb1-c93e-44bf-ad42-9bf18f6204b1","Type":"ContainerDied","Data":"d051c9cd4d70e3a9bdb6cfbe88340fd0a81085036d43bcd0a3252a145bcae8e6"}
Sep 10 21:15:59.586888 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.586800    2579 scope.go:117] "RemoveContainer" containerID="5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e"
Sep 10 21:15:59.586888 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.586743    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"
Sep 10 21:15:59.595388 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.595370    2579 scope.go:117] "RemoveContainer" containerID="5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e"
Sep 10 21:15:59.595667 ip-10-0-143-160 kubenswrapper[2579]: E0910 21:15:59.595646    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e\": container with ID starting with 5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e not found: ID does not exist" containerID="5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e"
Sep 10 21:15:59.595718 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.595677    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e"} err="failed to get container status \"5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e\": rpc error: code = NotFound desc = could not find container \"5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e\": container with ID starting with 5fc245235578513612c7f100c8780e1c3b11464044c8b2fd44daeda7d445ca9e not found: ID does not exist"
Sep 10 21:15:59.607453 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.607429    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"]
Sep 10 21:15:59.611126 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:15:59.611106    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5999f65fcd-zwl76"]
Sep 10 21:16:01.486538 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:01.486503    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="371f6bb1-c93e-44bf-ad42-9bf18f6204b1" path="/var/lib/kubelet/pods/371f6bb1-c93e-44bf-ad42-9bf18f6204b1/volumes"
Sep 10 21:16:08.753756 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:08.753724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:17.501326 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:17.501295    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6db979f4bf-48tlz_40d81493-542b-489d-a8f7-93060aa403d3/manager/0.log"
Sep 10 21:16:18.005402 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:18.005376    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59df7859b6-dtrv8_ad26bcba-0fe0-423e-a260-4f0e8bae8ae5/copy-manifests/0.log"
Sep 10 21:16:18.012576 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:18.012552    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59df7859b6-dtrv8_ad26bcba-0fe0-423e-a260-4f0e8bae8ae5/manager/0.log"
Sep 10 21:16:18.573453 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:18.573418    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7c74b8f674-9tjk2_10c809ee-1047-48ed-b051-7249fc3f238b/maas-api/0.log"
Sep 10 21:16:18.909457 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:18.909422    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zgvqd_349dccb8-bf4f-4dd6-8f1b-36eb0a22df37/postgres/0.log"
Sep 10 21:16:20.855134 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:20.855103    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qsxgf_33585c70-a0b0-4f7a-88aa-1bcbbea313dd/discovery/0.log"
Sep 10 21:16:21.557864 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:21.557837    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-644c5d48fd-8jn7w_d6aa23a4-abe7-44dc-9690-f0e612b133c8/router/0.log"
Sep 10 21:16:22.020234 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:22.020206    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-m9m6h_a22b5186-8c8a-485c-852e-456d377e4d86/main/0.log"
Sep 10 21:16:22.255908 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:22.255875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6w9qm_660f449a-d30e-46e5-9dea-657ae07592ef/main/0.log"
Sep 10 21:16:22.370733 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:22.370658    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxsghf_425b4f92-481f-44b5-a0ef-0732bbefcee7/main/0.log"
Sep 10 21:16:27.651813 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:27.651781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:27.751820 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:27.751791    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:30.633016 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:30.632985    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b8mq6_2fd289a0-76aa-4446-8a89-f221bd4d7bd8/global-pull-secret-syncer/0.log"
Sep 10 21:16:30.782029 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:30.781992    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5klwv_eb077d28-c480-4c8d-87ea-524fbd67a571/konnectivity-agent/0.log"
Sep 10 21:16:30.956597 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:30.956567    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-160.ec2.internal_de650f0c6b3437c5758879ed16ef7713/haproxy/0.log"
Sep 10 21:16:37.666330 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:37.666294    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-jntp6_53fcf57c-3ebd-4596-b0d5-c5c2d069c246/cluster-monitoring-operator/0.log"
Sep 10 21:16:37.707213 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:37.707174    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-rtkcg_0505a9f1-6e41-49af-8a19-2adb29dbc315/kube-state-metrics/0.log"
Sep 10 21:16:37.723958 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:37.723891    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-rtkcg_0505a9f1-6e41-49af-8a19-2adb29dbc315/kube-rbac-proxy-main/0.log"
Sep 10 21:16:37.747326 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:37.747300    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-rtkcg_0505a9f1-6e41-49af-8a19-2adb29dbc315/kube-rbac-proxy-self/0.log"
Sep 10 21:16:37.806065 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:37.806044    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-8h2qm_846d113e-4adc-4e8e-82fe-bb89660507e6/monitoring-plugin/0.log"
Sep 10 21:16:37.850383 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:37.850356    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dbjpt_bbd613fc-fc2b-41d1-b66a-45845f29cfac/node-exporter/0.log"
Sep 10 21:16:37.875130 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:37.875099    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dbjpt_bbd613fc-fc2b-41d1-b66a-45845f29cfac/kube-rbac-proxy/0.log"
Sep 10 21:16:37.901467 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:37.901399    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dbjpt_bbd613fc-fc2b-41d1-b66a-45845f29cfac/init-textfile/0.log"
Sep 10 21:16:38.234868 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:38.234831    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798e8793-a52b-41ad-9795-0efff31f3462/prometheus/0.log"
Sep 10 21:16:38.257897 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:38.257873    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798e8793-a52b-41ad-9795-0efff31f3462/config-reloader/0.log"
Sep 10 21:16:38.286211 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:38.286191    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798e8793-a52b-41ad-9795-0efff31f3462/thanos-sidecar/0.log"
Sep 10 21:16:38.316640 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:38.316611    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798e8793-a52b-41ad-9795-0efff31f3462/kube-rbac-proxy-web/0.log"
Sep 10 21:16:38.336218 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:38.336197    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798e8793-a52b-41ad-9795-0efff31f3462/kube-rbac-proxy/0.log"
Sep 10 21:16:38.358000 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:38.357979    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798e8793-a52b-41ad-9795-0efff31f3462/kube-rbac-proxy-thanos/0.log"
Sep 10 21:16:38.381390 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:38.381370    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798e8793-a52b-41ad-9795-0efff31f3462/init-config-reloader/0.log"
Sep 10 21:16:39.939715 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:39.939683    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-g667l_2397d76c-5ec4-4dac-b7b9-7d377710d97f/networking-console-plugin/0.log"
Sep 10 21:16:40.644575 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.644539    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"]
Sep 10 21:16:40.645071 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.645054    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="371f6bb1-c93e-44bf-ad42-9bf18f6204b1" containerName="maas-api"
Sep 10 21:16:40.645120 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.645075    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="371f6bb1-c93e-44bf-ad42-9bf18f6204b1" containerName="maas-api"
Sep 10 21:16:40.645160 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.645152    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="371f6bb1-c93e-44bf-ad42-9bf18f6204b1" containerName="maas-api"
Sep 10 21:16:40.648433 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.648417    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.651439 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.651416    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zw7zh\"/\"openshift-service-ca.crt\""
Sep 10 21:16:40.651559 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.651486    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zw7zh\"/\"default-dockercfg-sck8c\""
Sep 10 21:16:40.651559 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.651490    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zw7zh\"/\"kube-root-ca.crt\""
Sep 10 21:16:40.654996 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.654976    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"]
Sep 10 21:16:40.744788 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.744753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-lib-modules\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.744975 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.744818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nb8m\" (UniqueName: \"kubernetes.io/projected/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-kube-api-access-4nb8m\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.744975 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.744840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-proc\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.744975 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.744862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-sys\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.744975 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.744879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-podres\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.845413 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.845371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-sys\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.845413 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.845419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-podres\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.845744 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.845499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-lib-modules\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.845744 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.845514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-sys\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.845744 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.845588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nb8m\" (UniqueName: \"kubernetes.io/projected/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-kube-api-access-4nb8m\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.845744 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.845616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-proc\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.845744 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.845621    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-podres\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.845744 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.845723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-lib-modules\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.845744 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.845733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-proc\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.854230 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.854207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nb8m\" (UniqueName: \"kubernetes.io/projected/b1a3bc55-baac-4c5e-85aa-b4fc44b61636-kube-api-access-4nb8m\") pod \"perf-node-gather-daemonset-6nmt6\" (UID: \"b1a3bc55-baac-4c5e-85aa-b4fc44b61636\") " pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:40.959267 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:40.959237    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:41.231157 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:41.231074    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"]
Sep 10 21:16:41.234542 ip-10-0-143-160 kubenswrapper[2579]: W0910 21:16:41.234511    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb1a3bc55_baac_4c5e_85aa_b4fc44b61636.slice/crio-01249515d0af30a7bafb0c96e99cc2d10bdc7202921b5c964f59dbe0d4f4cfcb WatchSource:0}: Error finding container 01249515d0af30a7bafb0c96e99cc2d10bdc7202921b5c964f59dbe0d4f4cfcb: Status 404 returned error can't find the container with id 01249515d0af30a7bafb0c96e99cc2d10bdc7202921b5c964f59dbe0d4f4cfcb
Sep 10 21:16:41.772932 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:41.772898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6" event={"ID":"b1a3bc55-baac-4c5e-85aa-b4fc44b61636","Type":"ContainerStarted","Data":"aad55b1f30f3a4aed7c6ab68e8bfeb1373e640e36133929f35e29cc3333650b4"}
Sep 10 21:16:41.773152 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:41.772953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6" event={"ID":"b1a3bc55-baac-4c5e-85aa-b4fc44b61636","Type":"ContainerStarted","Data":"01249515d0af30a7bafb0c96e99cc2d10bdc7202921b5c964f59dbe0d4f4cfcb"}
Sep 10 21:16:41.773152 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:41.773022    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:41.790757 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:41.790713    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6" podStartSLOduration=1.790697124 podStartE2EDuration="1.790697124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:41.789531171 +0000 UTC m=+2426.826432683" watchObservedRunningTime="2026-09-10 21:16:41.790697124 +0000 UTC m=+2426.827598639"
Sep 10 21:16:43.015095 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:43.015064    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5nbzf_159ab7b6-4a77-418a-94d1-22a814d1bb64/dns/0.log"
Sep 10 21:16:43.036584 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:43.036560    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5nbzf_159ab7b6-4a77-418a-94d1-22a814d1bb64/kube-rbac-proxy/0.log"
Sep 10 21:16:43.177649 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:43.177599    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rwh9z_081cc327-993f-45e7-9ef1-27d71931fdc3/dns-node-resolver/0.log"
Sep 10 21:16:43.723122 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:43.723088    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5dc7d765b9-t8ghf_0c63fa15-f821-4fc2-a32b-0492f68e0853/registry/0.log"
Sep 10 21:16:43.800461 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:43.800431    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zrqqq_25035a46-ed7d-4b5b-96f2-044d90402f30/node-ca/0.log"
Sep 10 21:16:44.985060 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:44.985030    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qsxgf_33585c70-a0b0-4f7a-88aa-1bcbbea313dd/discovery/0.log"
Sep 10 21:16:45.222812 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:45.222783    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-644c5d48fd-8jn7w_d6aa23a4-abe7-44dc-9690-f0e612b133c8/router/0.log"
Sep 10 21:16:46.166482 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:46.166451    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zhn5f_c00bd33f-8694-48a2-87b5-0c85c323752b/serve-healthcheck-canary/0.log"
Sep 10 21:16:46.751538 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:46.751511    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t4j98_f4b69635-fc44-42aa-9405-a21c0c485f8e/kube-rbac-proxy/0.log"
Sep 10 21:16:46.773418 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:46.773372    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t4j98_f4b69635-fc44-42aa-9405-a21c0c485f8e/exporter/0.log"
Sep 10 21:16:46.794764 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:46.794743    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t4j98_f4b69635-fc44-42aa-9405-a21c0c485f8e/extractor/0.log"
Sep 10 21:16:47.786772 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:47.786746    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zw7zh/perf-node-gather-daemonset-6nmt6"
Sep 10 21:16:49.343647 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:49.343602    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6db979f4bf-48tlz_40d81493-542b-489d-a8f7-93060aa403d3/manager/0.log"
Sep 10 21:16:49.668659 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:49.668620    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59df7859b6-dtrv8_ad26bcba-0fe0-423e-a260-4f0e8bae8ae5/manager/0.log"
Sep 10 21:16:49.690340 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:49.690316    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59df7859b6-dtrv8_ad26bcba-0fe0-423e-a260-4f0e8bae8ae5/copy-manifests/0.log"
Sep 10 21:16:51.138463 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:51.138390    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8d95fb99-9frtv_26ba509d-49cd-4204-93ba-083e92f43674/manager/0.log"
Sep 10 21:16:51.288534 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:51.288507    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qsxgf_33585c70-a0b0-4f7a-88aa-1bcbbea313dd/discovery/0.log"
Sep 10 21:16:51.433605 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:51.433583    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-644c5d48fd-8jn7w_d6aa23a4-abe7-44dc-9690-f0e612b133c8/router/0.log"
Sep 10 21:16:53.110546 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:53.110507    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qsxgf_33585c70-a0b0-4f7a-88aa-1bcbbea313dd/discovery/0.log"
Sep 10 21:16:53.259287 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:53.259264    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-644c5d48fd-8jn7w_d6aa23a4-abe7-44dc-9690-f0e612b133c8/router/0.log"
Sep 10 21:16:56.759755 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:56.759724    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-fk9n8_a9511892-7ea1-4dc9-a501-3f878a6c1d0f/kube-storage-version-migrator-operator/1.log"
Sep 10 21:16:56.760364 ip-10-0-143-160 kubenswrapper[2579]: I0910 21:16:56.760343    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-fk9n8_a9511892-7ea1-4dc9-a501-3f878a6c1d0f/kube-storage-version-migrator-operator/0.log"