Sep 10 22:05:20.014116 ip-10-0-143-165 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 22:05:20.366086 ip-10-0-143-165 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:05:20.366086 ip-10-0-143-165 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 22:05:20.366086 ip-10-0-143-165 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:05:20.366714 ip-10-0-143-165 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 22:05:20.366714 ip-10-0-143-165 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:05:20.368424 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.368320    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 22:05:20.371428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371412    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:05:20.371428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371428    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371431    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371434    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371437    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371441    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371444    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371447    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371450    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371453    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371456    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371459    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371461    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371464    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371466    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371469    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371472    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371474    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371477    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371480    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371482    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:05:20.371486 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371485    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371488    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371490    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371493    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371496    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371499    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371502    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371505    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371507    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371510    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371513    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371515    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371518    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371520    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371523    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371527    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371531    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371534    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371537    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:05:20.371984 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371540    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371543    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371545    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371548    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371550    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371553    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371556    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371558    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371561    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371563    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371567    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371571    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371574    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371577    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371580    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371583    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371586    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371589    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371592    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:05:20.372439 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371595    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371597    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371600    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371603    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371605    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371608    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371610    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371614    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371617    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371620    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371623    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371626    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371629    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371631    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371634    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371637    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371640    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371642    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371645    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371647    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:05:20.372955 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371650    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371652    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371655    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371657    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371660    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371662    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371664    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371667    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371670    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371673    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371676    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371678    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371681    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371684    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371686    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371689    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371691    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371694    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371697    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.371699    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:05:20.373434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372380    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372387    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372390    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372392    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372395    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372399    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372402    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372405    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372408    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372410    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372413    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372416    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372418    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372421    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372423    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372426    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372428    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372431    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372435    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372438    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:05:20.373931 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372441    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372444    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372447    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372450    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372453    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372455    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372458    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372460    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372463    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372465    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372468    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372470    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372473    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372475    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372478    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372481    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372483    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372486    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372488    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372491    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:05:20.374433 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372493    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372497    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372499    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372502    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372504    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372507    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372510    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372512    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372515    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372517    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372521    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372523    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372526    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372531    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372534    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372538    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372541    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372544    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372547    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:05:20.374936 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372549    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372552    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372554    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372557    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372560    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372563    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372565    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372567    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372570    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372573    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372575    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372578    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372580    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372583    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372585    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372589    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372592    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372595    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372598    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372600    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:05:20.375416 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372604    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372606    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372610    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372613    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372617    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372619    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372622    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372624    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372627    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372629    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372632    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372634    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372637    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372640    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372642    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372645    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372649    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372652    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372655    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:05:20.375923 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.372658    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373095    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373102    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373105    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373108    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373111    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373115    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373118    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373121    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373124    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373127    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373130    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373133    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373136    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373138    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373141    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373144    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373147    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373149    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373152    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:05:20.376430 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373154    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373157    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373160    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373162    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373165    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373167    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373170    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373173    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373175    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373177    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373180    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373182    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373185    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373187    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373190    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373192    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373195    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373197    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373199    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:05:20.376945 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373202    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373205    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373208    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373211    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373215    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373219    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373222    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373224    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373227    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373229    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373231    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373234    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373236    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373239    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373241    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373243    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373246    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373248    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373251    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:05:20.377428 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373253    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373256    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373258    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373261    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373263    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373265    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373268    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373270    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373273    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373275    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373278    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373280    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373282    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373285    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373288    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373290    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373295    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373297    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373300    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373302    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:05:20.377944 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373305    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373307    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373310    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373312    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373315    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373317    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373320    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373322    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373325    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373327    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373330    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373333    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373337    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373340    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373343    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373346    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373349    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373351    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373354    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:05:20.378435 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373356    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373360    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.373363    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373423    2573 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373455    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373462    2573 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373467    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373473    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373478    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373485    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373491    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373494    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373498    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373503    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373507    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373510    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373514    2573 flags.go:64] FLAG: --cgroup-root=""
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373517    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373520    2573 flags.go:64] FLAG: --client-ca-file=""
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373523    2573 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373526    2573 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373530    2573 flags.go:64] FLAG: --cluster-domain=""
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373533    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 22:05:20.378913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373536    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373539    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373542    2573 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373546    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373549    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373552    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373556    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373558    2573 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373561    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373564    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373567    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373570    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373574    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373577    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373580    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373583    2573 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373586    2573 flags.go:64] FLAG: --enable-server="true"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373589    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373594    2573 flags.go:64] FLAG: --event-burst="100"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373597    2573 flags.go:64] FLAG: --event-qps="50"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373601    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373604    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373607    2573 flags.go:64] FLAG: --eviction-hard=""
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373611    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 22:05:20.379479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373613    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373617    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373620    2573 flags.go:64] FLAG: --eviction-soft=""
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373623    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373625    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373628    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373631    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373634    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373637    2573 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373640    2573 flags.go:64] FLAG: --feature-gates=""
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373643    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373646    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373649    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373652    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373655    2573 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373658    2573 flags.go:64] FLAG: --help="false"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373661    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373664    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373667    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373670    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373673    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373676    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373679    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 22:05:20.380080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373682    2573 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373688    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373691    2573 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373694    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373697    2573 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373700    2573 flags.go:64] FLAG: --kube-reserved=""
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373704    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373706    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373709    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373712    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373715    2573 flags.go:64] FLAG: --lock-file=""
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373718    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373721    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373724    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373729    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373732    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373735    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373737    2573 flags.go:64] FLAG: --logging-format="text"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373740    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373744    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373747    2573 flags.go:64] FLAG: --manifest-url=""
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373749    2573 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373754    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373756    2573 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373761    2573 flags.go:64] FLAG: --max-pods="110"
Sep 10 22:05:20.380667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373763    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373766    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373769    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373772    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373776    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373778    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373781    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373788    2573 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373793    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373796    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373799    2573 flags.go:64] FLAG: --pod-cidr=""
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373802    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373807    2573 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373810    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373813    2573 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373816    2573 flags.go:64] FLAG: --port="10250"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373819    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373822    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0741805634ef11c1e"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373825    2573 flags.go:64] FLAG: --qos-reserved=""
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373828    2573 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373831    2573 flags.go:64] FLAG: --register-node="true"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373834    2573 flags.go:64] FLAG: --register-with-taints=""
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373850    2573 flags.go:64] FLAG: --registry-burst="10"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373853    2573 flags.go:64] FLAG: --registry-qps="5"
Sep 10 22:05:20.381683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373856    2573 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373859    2573 flags.go:64] FLAG: --reserved-memory=""
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373863    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373877    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373880    2573 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373883    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373886    2573 flags.go:64] FLAG: --runonce="false"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373889    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373892    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373895    2573 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373898    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373901    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373904    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373908    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373911    2573 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373914    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373918    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373924    2573 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373947    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373952    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373955    2573 flags.go:64] FLAG: --system-cgroups=""
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373958    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373964    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373968    2573 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373971    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 22:05:20.382450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373975    2573 flags.go:64] FLAG: --tls-min-version=""
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373978    2573 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373980    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373983    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373986    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373990    2573 flags.go:64] FLAG: --v="2"
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373993    2573 flags.go:64] FLAG: --version="false"
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.373997    2573 flags.go:64] FLAG: --vmodule=""
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.374001    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.374004    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374124    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374129    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374134    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374138    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374141    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374144    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374147    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374151    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374154    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374156    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374159    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:05:20.383109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374161    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374166    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374171    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374175    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374178    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374181    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374183    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374186    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374189    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374192    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374195    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374198    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374202    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374206    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374208    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374211    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374214    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374216    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374219    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374221    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:05:20.383619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374224    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374227    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374229    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374232    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374234    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374237    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374240    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374242    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374245    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374248    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374250    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374253    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374255    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374258    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374261    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374265    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374268    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374271    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374274    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374277    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:05:20.384131 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374279    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374282    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374285    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374288    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374290    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374293    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374296    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374298    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374301    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374304    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374306    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374308    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374311    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374314    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374317    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374319    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374322    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374324    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374327    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374329    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:05:20.384631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374332    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374334    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374337    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374339    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374342    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374344    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374348    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374352    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374354    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374357    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374360    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374363    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374365    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374368    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374372    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374376    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374379    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374382    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374385    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:05:20.385173 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374387    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374390    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374392    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374395    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374397    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374400    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374402    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374405    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.374407    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.375173    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.384008    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.384025    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.384050    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.384055    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 22:05:20.385689 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384126    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384131    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384135    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384138    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384141    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384145    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384149    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384152    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384156    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384159    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384163    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384167    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384171    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384174    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384177    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384180    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384182    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384185    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384187    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:05:20.386069 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384191    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384194    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384196    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384199    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384202    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384204    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384207    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384209    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384212    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384215    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384218    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384221    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384224    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384227    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384229    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384232    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384235    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384238    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384240    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:05:20.386542 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384243    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384246    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384248    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384251    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384253    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384256    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384258    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384261    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384263    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384266    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384268    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384271    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384274    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384277    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384279    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384283    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384285    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384288    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384291    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384294    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:05:20.387114 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384296    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384299    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384302    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384304    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384307    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384310    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384312    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384315    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384317    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384320    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384322    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384325    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384328    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384331    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384333    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384336    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384338    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384341    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384343    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384346    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:05:20.387655 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384349    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384358    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384361    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384363    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384366    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384368    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384371    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384374    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384376    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384379    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384381    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384384    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384388    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384392    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384395    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384398    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384400    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384403    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384406    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384409    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:05:20.388164 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384411    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.384416    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384554    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384560    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384563    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384566    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384568    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384571    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384574    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384576    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384579    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384581    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384584    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384587    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384596    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:05:20.388754 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384599    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384601    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384604    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384607    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384610    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384612    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384615    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384617    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384620    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384623    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384626    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384629    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384631    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384635    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384637    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384640    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384642    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384645    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384648    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:05:20.389145 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384651    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384653    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384656    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384660    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384663    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384666    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384669    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384672    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384675    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384678    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384680    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384683    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384686    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384694    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384697    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384699    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384702    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384704    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384707    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:05:20.389701 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384709    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384712    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384714    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384717    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384720    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384722    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384725    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384728    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384732    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384735    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384738    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384740    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384743    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384746    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384749    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384752    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384754    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384757    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384760    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384762    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:05:20.390333 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384765    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384767    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384770    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384773    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384775    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384778    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384780    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384784    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384787    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384789    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384792    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384794    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384797    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384799    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384802    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384804    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384807    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384811    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384814    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:05:20.391109 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384817    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384819    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384822    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384824    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384827    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384829    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384832    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384834    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:20.384849    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.384854    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.384978    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.387253    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.388190    2573 server.go:1019] "Starting client certificate rotation"
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.388305    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:05:20.391623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.388347    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:05:20.392027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.390540    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:05:20.392027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.391677    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:05:20.401407 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.401390    2573 log.go:25] "Validated CRI v1 runtime API"
Sep 10 22:05:20.404891 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.404875    2573 log.go:25] "Validated CRI v1 image API"
Sep 10 22:05:20.407820 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.407806    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 22:05:20.410806 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.410745    2573 fs.go:135] Filesystem UUIDs: map[3aed46c2-c3cc-4c50-97f7-b075d5e4c87d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9755b48c-77d9-4705-b306-1dd3e1567584:/dev/nvme0n1p3]
Sep 10 22:05:20.410902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.410808    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 22:05:20.416405 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.416291    2573 manager.go:216] Machine: {Timestamp:2026-09-10 22:05:20.415039728 +0000 UTC m=+0.297524086 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094746 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f090b64a3a19d2b153d1af0d496df SystemUUID:ec2f090b-64a3-a19d-2b15-3d1af0d496df BootID:507d96c5-5ef2-4829-8560-b2b70ac1cd13 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:86:d1:bb:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:86:d1:bb:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:a2:0f:d8:c0:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 22:05:20.416405 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.416390    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 22:05:20.416546 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.416462    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 22:05:20.417317 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.417302    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:05:20.418051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.418027    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 22:05:20.418179 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.418055    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 22:05:20.418774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.418765    2573 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 22:05:20.418805 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.418775    2573 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 22:05:20.418805 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.418783    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:05:20.419418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.419406    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:05:20.420502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.420492    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 22:05:20.424503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.424492    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:05:20.424615 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.424606    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 22:05:20.424654 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.424636    2573 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 22:05:20.424654 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.424646    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 22:05:20.424737 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.424664    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 22:05:20.424737 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.424674    2573 kubelet.go:398] "Adding apiserver pod source"
Sep 10 22:05:20.424737 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.424683    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 22:05:20.425000 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.424988    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:05:20.425063 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.425010    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:05:20.430208 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.430180    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 22:05:20.433054 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.433039    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 22:05:20.433124 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.433069    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 22:05:20.434853 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434829    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434862    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434873    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434880    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434889    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434894    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434907    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434913    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434920    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434925    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 22:05:20.434928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434933    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 22:05:20.435346 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.434939    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 22:05:20.435465 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.435454    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 22:05:20.435465 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.435464    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 22:05:20.436464 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.436443    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 22:05:20.436666 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.436646    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 22:05:20.439041 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.439028    2573 server.go:1268] "Started kubelet"
Sep 10 22:05:20.439139 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.439115    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 22:05:20.439139 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.439104    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 22:05:20.439218 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.439167    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 22:05:20.439760 ip-10-0-143-165 systemd[1]: Started Kubernetes Kubelet.
Sep 10 22:05:20.440399 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.440378    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 22:05:20.441067 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.441050    2573 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 22:05:20.444100 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.443325    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 22:05:20.445802 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.445611    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 22:05:20.446296 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.445492    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-165.ec2.internal.18d414e3c342e6e6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-165.ec2.internal,UID:ip-10-0-143-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-165.ec2.internal,},FirstTimestamp:2026-09-10 22:05:20.439002854 +0000 UTC m=+0.321487212,LastTimestamp:2026-09-10 22:05:20.439002854 +0000 UTC m=+0.321487212,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-165.ec2.internal,}"
Sep 10 22:05:20.446988 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.446971    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 22:05:20.447514 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.447500    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 22:05:20.447655 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.447640    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:20.448061 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.448041    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8tz9d"
Sep 10 22:05:20.448130 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.448112    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 22:05:20.448130 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.448115    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 22:05:20.448236 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.448142    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 22:05:20.448236 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.448185    2573 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 22:05:20.448671 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.448194    2573 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 22:05:20.449648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.449627    2573 factory.go:153] Registering CRI-O factory
Sep 10 22:05:20.449648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.449646    2573 factory.go:223] Registration of the crio container factory successfully
Sep 10 22:05:20.449792 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.449698    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 22:05:20.449792 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.449707    2573 factory.go:55] Registering systemd factory
Sep 10 22:05:20.449792 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.449715    2573 factory.go:223] Registration of the systemd container factory successfully
Sep 10 22:05:20.449792 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.449733    2573 factory.go:103] Registering Raw factory
Sep 10 22:05:20.449792 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.449753    2573 manager.go:1196] Started watching for new ooms in manager
Sep 10 22:05:20.450168 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.450154    2573 manager.go:349] Starting recovery of all containers
Sep 10 22:05:20.452384 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.452364    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 22:05:20.452648 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.452623    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 22:05:20.455877 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.455857    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8tz9d"
Sep 10 22:05:20.457132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.457082    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 22:05:20.460092 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.460073    2573 manager.go:354] Recovery completed
Sep 10 22:05:20.464632 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.464618    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:05:20.466418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.466305    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:05:20.466418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.466339    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:05:20.466418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.466353    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:05:20.466919 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.466904    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 22:05:20.466919 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.466913    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:05:20.467024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.466917    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 22:05:20.467024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.466975    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:05:20.468073 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.468056    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:05:20.468153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.468086    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:05:20.468153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.468100    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:05:20.468516 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.468455    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-165.ec2.internal.18d414e3c4e3b76f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-165.ec2.internal,UID:ip-10-0-143-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-165.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-165.ec2.internal,},FirstTimestamp:2026-09-10 22:05:20.466319215 +0000 UTC m=+0.348803573,LastTimestamp:2026-09-10 22:05:20.466319215 +0000 UTC m=+0.348803573,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-165.ec2.internal,}"
Sep 10 22:05:20.468948 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.468937    2573 policy_none.go:49] "None policy: Start"
Sep 10 22:05:20.468999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.468952    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 22:05:20.468999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.468964    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 22:05:20.470889 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.470878    2573 policy_none.go:47] "Start"
Sep 10 22:05:20.503494 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.503477    2573 manager.go:337] "Starting Device Plugin manager"
Sep 10 22:05:20.529372 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.503528    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 22:05:20.529372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.503543    2573 server.go:87] "Starting device plugin registration server"
Sep 10 22:05:20.529372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.503890    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 22:05:20.529372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.503904    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 22:05:20.529372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.504003    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 22:05:20.529372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.504071    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 22:05:20.529372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.504078    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 22:05:20.529372 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.504596    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 22:05:20.529372 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.504640    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:20.546282 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.546257    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 22:05:20.546365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.546315    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 22:05:20.546365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.546338    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 22:05:20.546467 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.546379    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 22:05:20.549163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.549147    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:05:20.604948 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.604929    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:05:20.605827 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.605813    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:05:20.605942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.605859    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:05:20.605942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.605873    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:05:20.605942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.605900    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.612548 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.612532    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.612614 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.612554    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-165.ec2.internal\": node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:20.632087 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.631986    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:20.647261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.647227    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal"]
Sep 10 22:05:20.647360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.647320    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:05:20.648282 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.648266    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:05:20.648371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.648296    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:05:20.648371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.648310    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:05:20.649408 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.649389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81e835015ef18fd79319f1af18d7d65f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal\" (UID: \"81e835015ef18fd79319f1af18d7d65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.649477 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.649419    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81e835015ef18fd79319f1af18d7d65f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal\" (UID: \"81e835015ef18fd79319f1af18d7d65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.650351 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.650337    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:05:20.650473 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.650456    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.650519 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.650498    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:05:20.651045 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.651031    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:05:20.651119 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.651058    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:05:20.651119 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.651072    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:05:20.651641 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.651624    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:05:20.651715 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.651653    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:05:20.651715 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.651663    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:05:20.653668 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.653653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.653768 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.653677    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:05:20.654299 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.654283    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:05:20.654369 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.654311    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:05:20.654369 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.654321    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:05:20.681500 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.681480    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-165.ec2.internal\" not found" node="ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.685863 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.685850    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-165.ec2.internal\" not found" node="ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.732657 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.732638    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:20.749999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.749980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81e835015ef18fd79319f1af18d7d65f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal\" (UID: \"81e835015ef18fd79319f1af18d7d65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.750062 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.750002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81e835015ef18fd79319f1af18d7d65f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal\" (UID: \"81e835015ef18fd79319f1af18d7d65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.750062 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.750021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3752174baf855d01c4a6df678c4937e-config\") pod \"kube-apiserver-proxy-ip-10-0-143-165.ec2.internal\" (UID: \"a3752174baf855d01c4a6df678c4937e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.750132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.750081    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81e835015ef18fd79319f1af18d7d65f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal\" (UID: \"81e835015ef18fd79319f1af18d7d65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.750132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.750089    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81e835015ef18fd79319f1af18d7d65f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal\" (UID: \"81e835015ef18fd79319f1af18d7d65f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.833266 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.833226    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:20.850568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.850546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3752174baf855d01c4a6df678c4937e-config\") pod \"kube-apiserver-proxy-ip-10-0-143-165.ec2.internal\" (UID: \"a3752174baf855d01c4a6df678c4937e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.850655 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.850598    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3752174baf855d01c4a6df678c4937e-config\") pod \"kube-apiserver-proxy-ip-10-0-143-165.ec2.internal\" (UID: \"a3752174baf855d01c4a6df678c4937e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.934031 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:20.933957    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:20.984469 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.984446    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:20.989400 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:20.989201    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:21.034985 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:21.034955    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:21.135509 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:21.135472    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:21.236005 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:21.235948    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:21.286276 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.286252    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:05:21.336583 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:21.336550    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:21.388098 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.388066    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 22:05:21.388543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.388259    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 22:05:21.388543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.388262    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 22:05:21.437199 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:21.437167    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:21.461717 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.461685    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 22:00:21 +0000 UTC" deadline="2028-02-07 07:50:26.074535428 +0000 UTC"
Sep 10 22:05:21.461717 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.461711    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12345h45m4.612828043s"
Sep 10 22:05:21.538282 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:21.538230    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:21.639406 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:21.639378    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:21.695078 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:21.695042    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3752174baf855d01c4a6df678c4937e.slice/crio-e9eb5cf807a60fd06519856a2771fef5d7631c04a3c9e7abecd02e326cc99c05 WatchSource:0}: Error finding container e9eb5cf807a60fd06519856a2771fef5d7631c04a3c9e7abecd02e326cc99c05: Status 404 returned error can't find the container with id e9eb5cf807a60fd06519856a2771fef5d7631c04a3c9e7abecd02e326cc99c05
Sep 10 22:05:21.700286 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.700268    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:05:21.705806 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:21.705785    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e835015ef18fd79319f1af18d7d65f.slice/crio-543ea5ed47160d72a68dc2c6029b72ef4364a07709a3b0c58d6c26ec7eb00814 WatchSource:0}: Error finding container 543ea5ed47160d72a68dc2c6029b72ef4364a07709a3b0c58d6c26ec7eb00814: Status 404 returned error can't find the container with id 543ea5ed47160d72a68dc2c6029b72ef4364a07709a3b0c58d6c26ec7eb00814
Sep 10 22:05:21.740333 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:21.740310    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:21.759221 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.759204    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:05:21.846918 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:21.846839    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-165.ec2.internal\" not found"
Sep 10 22:05:21.888058 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.888035    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:05:21.947887 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.947853    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:21.959559 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.959542    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:05:21.960546 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.960533    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal"
Sep 10 22:05:21.969836 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:21.969818    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:05:22.196260 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.196188    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:05:22.427446 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.427387    2573 apiserver.go:52] "Watching apiserver"
Sep 10 22:05:22.437360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.436424    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 22:05:22.437360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.436951    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-9pbfz","openshift-dns/node-resolver-c47x8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal","openshift-multus/multus-additional-cni-plugins-mwthv","openshift-multus/multus-xw8nk","kube-system/global-pull-secret-syncer-svkw5","openshift-image-registry/node-ca-zgbcm","openshift-multus/network-metrics-daemon-s2rmw","openshift-network-diagnostics/network-check-target-8m9nm","openshift-network-operator/iptables-alerter-nd62s","openshift-ovn-kubernetes/ovnkube-node-g94rr","kube-system/konnectivity-agent-4zcsl","kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"]
Sep 10 22:05:22.439999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.439974    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.442840 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.442282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.442840 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.442672    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 22:05:22.443071 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.443041    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 22:05:22.443189 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.443114    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gtppr\""
Sep 10 22:05:22.443189 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.443041    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 22:05:22.444600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.444580    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.451976 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.451396    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 22:05:22.451976 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.451627    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 22:05:22.451976 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.451841    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.453074    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.453175    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.453203    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.453558    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qsmdd\""
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.453807    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.454155    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.454545    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.454571    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.454703    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2zdlw\""
Sep 10 22:05:22.455247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.455244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.458784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.458365    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 22:05:22.458784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.458420    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.458784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.458656    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nplk2\""
Sep 10 22:05:22.459315 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-cni-netd\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.459397 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2860e2d-36c3-4495-b40d-45c6fbaa3540-ovnkube-config\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.459397 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459360    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2860e2d-36c3-4495-b40d-45c6fbaa3540-ovn-node-metrics-cert\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.459397 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2860e2d-36c3-4495-b40d-45c6fbaa3540-ovnkube-script-lib\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.459596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-registration-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.459596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/401a84c5-0ae9-4eb7-80c1-f1b782c022ad-serviceca\") pod \"node-ca-zgbcm\" (UID: \"401a84c5-0ae9-4eb7-80c1-f1b782c022ad\") " pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.459596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-socket-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.459596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb56703-ab5b-459e-a153-0fce5bfea7af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.459596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-var-lib-kubelet\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.459596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-run-systemd\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.459596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-var-lib-openvswitch\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.459596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-run-ovn\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb56703-ab5b-459e-a153-0fce5bfea7af-system-cni-dir\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb56703-ab5b-459e-a153-0fce5bfea7af-cni-binary-copy\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459671    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-run-k8s-cni-cncf-io\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-etc-kubernetes\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdkx4\" (UniqueName: \"kubernetes.io/projected/401a84c5-0ae9-4eb7-80c1-f1b782c022ad-kube-api-access-mdkx4\") pod \"node-ca-zgbcm\" (UID: \"401a84c5-0ae9-4eb7-80c1-f1b782c022ad\") " pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459742    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-run-netns\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459780    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-etc-openvswitch\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-run-openvswitch\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0cb56703-ab5b-459e-a153-0fce5bfea7af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459890    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-cni-binary-copy\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.459912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-run-netns\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460025    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-kubelet\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb56703-ab5b-459e-a153-0fce5bfea7af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-system-cni-dir\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460098    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-socket-dir-parent\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.460401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-var-lib-cni-multus\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-hostroot\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-conf-dir\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-run-multus-certs\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-slash\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-log-socket\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460295    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-cni-bin\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460352    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2860e2d-36c3-4495-b40d-45c6fbaa3540-env-overrides\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-sys-fs\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb56703-ab5b-459e-a153-0fce5bfea7af-cnibin\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-node-log\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwg9g\" (UniqueName: \"kubernetes.io/projected/e2860e2d-36c3-4495-b40d-45c6fbaa3540-kube-api-access-kwg9g\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460559    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-device-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-etc-selinux\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460593    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-daemon-config\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.461334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/401a84c5-0ae9-4eb7-80c1-f1b782c022ad-host\") pod \"node-ca-zgbcm\" (UID: \"401a84c5-0ae9-4eb7-80c1-f1b782c022ad\") " pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.462263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-systemd-units\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.462263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.462263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460729    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qggk6\" (UniqueName: \"kubernetes.io/projected/60de261a-eaae-4b6c-bbab-99b171d21c35-kube-api-access-qggk6\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.462263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f4dw\" (UniqueName: \"kubernetes.io/projected/0cb56703-ab5b-459e-a153-0fce5bfea7af-kube-api-access-8f4dw\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.462263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-cni-dir\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.462263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-cnibin\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.462263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-var-lib-cni-bin\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.462263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgj94\" (UniqueName: \"kubernetes.io/projected/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-kube-api-access-hgj94\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.462263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.460934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-run-ovn-kubernetes\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.462814 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.462708    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 22:05:22.463605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.462964    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 22:05:22.463605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.463214    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 22:05:22.463605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.463357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:22.463605 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.463425    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:22.463605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.463516    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 22:05:22.463954 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.463883    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 22:05:22.464112 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.464096    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sfgwp\""
Sep 10 22:05:22.465180 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.465158    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:22.465275 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.465231    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:22.467535 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.467514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:22.467695 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.467582    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:22.474543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.471239    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.474543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.471943    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:05:22.474543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.473911    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.475052 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.474770    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 22:05:22.475152 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.475078    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 22:05:22.475521 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.475358    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cjlzl\""
Sep 10 22:05:22.477617 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.477595    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 22:05:22.477866 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.477850    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 22:05:22.478045 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.478018    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.478165 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.478146    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:05:22.478241 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.478168    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2cbt4\""
Sep 10 22:05:22.480132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.480108    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:22.480749 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.480728    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 22:05:22.480942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.480923    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-89pn5\""
Sep 10 22:05:22.481019 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.480973    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:05:22.482470 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.482450    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 22:05:22.482638 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.482620    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pbdpp\""
Sep 10 22:05:22.483121 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.483102    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 22:05:22.513685 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.513664    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kg2hn"
Sep 10 22:05:22.523090 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.523070    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kg2hn"
Sep 10 22:05:22.549448 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.549286    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 22:05:22.552260 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.552203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal" event={"ID":"81e835015ef18fd79319f1af18d7d65f","Type":"ContainerStarted","Data":"543ea5ed47160d72a68dc2c6029b72ef4364a07709a3b0c58d6c26ec7eb00814"}
Sep 10 22:05:22.554082 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.554053    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal" event={"ID":"a3752174baf855d01c4a6df678c4937e","Type":"ContainerStarted","Data":"e9eb5cf807a60fd06519856a2771fef5d7631c04a3c9e7abecd02e326cc99c05"}
Sep 10 22:05:22.561141 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f87f3df-f63b-4b04-a948-e35c11230537-etc-tuned\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.561348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561154    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f87f3df-f63b-4b04-a948-e35c11230537-tmp\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.561348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561186    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2860e2d-36c3-4495-b40d-45c6fbaa3540-ovnkube-script-lib\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.561348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-registration-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.561348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-socket-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.561348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb56703-ab5b-459e-a153-0fce5bfea7af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.561348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-var-lib-kubelet\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.561348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:22.561348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-kubernetes\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-run-systemd\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb56703-ab5b-459e-a153-0fce5bfea7af-cni-binary-copy\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561450    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-etc-openvswitch\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-run-netns\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561507    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-socket-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561558    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-etc-openvswitch\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16f500b5-5bb9-4835-aca8-27d68fbe830c-dbus\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b00e522-ca7d-42f2-8ad1-cdc860c83856-tmp-dir\") pod \"node-resolver-c47x8\" (UID: \"4b00e522-ca7d-42f2-8ad1-cdc860c83856\") " pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8dsj\" (UniqueName: \"kubernetes.io/projected/64bee373-8991-49bb-b2a6-a5dde5eac0f7-kube-api-access-c8dsj\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561682    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e4a241f-3d98-46de-a331-337365b84c14-agent-certs\") pod \"konnectivity-agent-4zcsl\" (UID: \"3e4a241f-3d98-46de-a331-337365b84c14\") " pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgj94\" (UniqueName: \"kubernetes.io/projected/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-kube-api-access-hgj94\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.561796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdkx4\" (UniqueName: \"kubernetes.io/projected/401a84c5-0ae9-4eb7-80c1-f1b782c022ad-kube-api-access-mdkx4\") pod \"node-ca-zgbcm\" (UID: \"401a84c5-0ae9-4eb7-80c1-f1b782c022ad\") " pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-socket-dir-parent\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-var-lib-cni-multus\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561937    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-run-multus-certs\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-sysctl-conf\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.561991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-log-socket\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-var-lib-kubelet\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-host\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2860e2d-36c3-4495-b40d-45c6fbaa3540-ovnkube-script-lib\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwg9g\" (UniqueName: \"kubernetes.io/projected/e2860e2d-36c3-4495-b40d-45c6fbaa3540-kube-api-access-kwg9g\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-device-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb56703-ab5b-459e-a153-0fce5bfea7af-cni-binary-copy\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/401a84c5-0ae9-4eb7-80c1-f1b782c022ad-host\") pod \"node-ca-zgbcm\" (UID: \"401a84c5-0ae9-4eb7-80c1-f1b782c022ad\") " pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562196    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-device-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562204    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-var-lib-cni-multus\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562223    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-run-multus-certs\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562251    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-log-socket\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.562468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562261    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-run-systemd\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-run-netns\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-sysctl-d\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562300    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-var-lib-kubelet\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562335    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-socket-dir-parent\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562340    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-systemd\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-registration-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-systemd-units\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562414    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-systemd-units\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qggk6\" (UniqueName: \"kubernetes.io/projected/60de261a-eaae-4b6c-bbab-99b171d21c35-kube-api-access-qggk6\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562448    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/401a84c5-0ae9-4eb7-80c1-f1b782c022ad-host\") pod \"node-ca-zgbcm\" (UID: \"401a84c5-0ae9-4eb7-80c1-f1b782c022ad\") " pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562467    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-cni-dir\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-cnibin\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562650    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-cni-dir\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-var-lib-cni-bin\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-cnibin\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.563361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562717    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb56703-ab5b-459e-a153-0fce5bfea7af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/401a84c5-0ae9-4eb7-80c1-f1b782c022ad-serviceca\") pod \"node-ca-zgbcm\" (UID: \"401a84c5-0ae9-4eb7-80c1-f1b782c022ad\") " pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-run-ovn-kubernetes\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-cni-netd\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562823    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2860e2d-36c3-4495-b40d-45c6fbaa3540-ovnkube-config\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2860e2d-36c3-4495-b40d-45c6fbaa3540-ovn-node-metrics-cert\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562894    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-var-lib-cni-bin\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562928    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-run-ovn-kubernetes\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562960    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-cni-netd\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.562982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e4a241f-3d98-46de-a331-337365b84c14-konnectivity-ca\") pod \"konnectivity-agent-4zcsl\" (UID: \"3e4a241f-3d98-46de-a331-337365b84c14\") " pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16f500b5-5bb9-4835-aca8-27d68fbe830c-kubelet-config\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b00e522-ca7d-42f2-8ad1-cdc860c83856-hosts-file\") pod \"node-resolver-c47x8\" (UID: \"4b00e522-ca7d-42f2-8ad1-cdc860c83856\") " pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-var-lib-openvswitch\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563088    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-run-ovn\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb56703-ab5b-459e-a153-0fce5bfea7af-system-cni-dir\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-run-k8s-cni-cncf-io\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.564305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-etc-kubernetes\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8eb0b2e-0a48-4cc3-ae1a-560ff5289233-host-slash\") pod \"iptables-alerter-nd62s\" (UID: \"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233\") " pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-modprobe-d\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563196    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/401a84c5-0ae9-4eb7-80c1-f1b782c022ad-serviceca\") pod \"node-ca-zgbcm\" (UID: \"401a84c5-0ae9-4eb7-80c1-f1b782c022ad\") " pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-sys\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-run-netns\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-etc-kubernetes\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-run-openvswitch\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563311    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-var-lib-openvswitch\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563352    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb56703-ab5b-459e-a153-0fce5bfea7af-system-cni-dir\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2860e2d-36c3-4495-b40d-45c6fbaa3540-ovnkube-config\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563383    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-run-ovn\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0cb56703-ab5b-459e-a153-0fce5bfea7af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563434    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-run-netns\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-host-run-k8s-cni-cncf-io\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-cni-binary-copy\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-run-openvswitch\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.565182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-lib-modules\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-kubelet\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb56703-ab5b-459e-a153-0fce5bfea7af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-system-cni-dir\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-hostroot\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-conf-dir\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-slash\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563764    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-cni-bin\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2860e2d-36c3-4495-b40d-45c6fbaa3540-env-overrides\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564054    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-conf-dir\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563903    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-cni-bin\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563938    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-kubelet\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563967    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0cb56703-ab5b-459e-a153-0fce5bfea7af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-sys-fs\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564012    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb56703-ab5b-459e-a153-0fce5bfea7af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564044    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-slash\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.563857    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb56703-ab5b-459e-a153-0fce5bfea7af-cnibin\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-hostroot\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-daemon-config\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-node-log\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-etc-selinux\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvjxg\" (UniqueName: \"kubernetes.io/projected/4b00e522-ca7d-42f2-8ad1-cdc860c83856-kube-api-access-fvjxg\") pod \"node-resolver-c47x8\" (UID: \"4b00e522-ca7d-42f2-8ad1-cdc860c83856\") " pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-system-cni-dir\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8eb0b2e-0a48-4cc3-ae1a-560ff5289233-iptables-alerter-script\") pod \"iptables-alerter-nd62s\" (UID: \"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233\") " pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plvwk\" (UniqueName: \"kubernetes.io/projected/a8eb0b2e-0a48-4cc3-ae1a-560ff5289233-kube-api-access-plvwk\") pod \"iptables-alerter-nd62s\" (UID: \"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233\") " pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-sysconfig\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s95s2\" (UniqueName: \"kubernetes.io/projected/0f87f3df-f63b-4b04-a948-e35c11230537-kube-api-access-s95s2\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564435    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb56703-ab5b-459e-a153-0fce5bfea7af-cnibin\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f4dw\" (UniqueName: \"kubernetes.io/projected/0cb56703-ab5b-459e-a153-0fce5bfea7af-kube-api-access-8f4dw\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-cni-binary-copy\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564516    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2860e2d-36c3-4495-b40d-45c6fbaa3540-env-overrides\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.566857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564616    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-run\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.567768 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2860e2d-36c3-4495-b40d-45c6fbaa3540-node-log\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.567768 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-etc-selinux\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.567768 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564840    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60de261a-eaae-4b6c-bbab-99b171d21c35-sys-fs\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.567768 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.564907    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-multus-daemon-config\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.569569 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.569547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2860e2d-36c3-4495-b40d-45c6fbaa3540-ovn-node-metrics-cert\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.584015 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.583988    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdkx4\" (UniqueName: \"kubernetes.io/projected/401a84c5-0ae9-4eb7-80c1-f1b782c022ad-kube-api-access-mdkx4\") pod \"node-ca-zgbcm\" (UID: \"401a84c5-0ae9-4eb7-80c1-f1b782c022ad\") " pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.584291 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.584257    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgj94\" (UniqueName: \"kubernetes.io/projected/5bc27de9-d3ad-4a51-bdf3-f80311f6c129-kube-api-access-hgj94\") pod \"multus-xw8nk\" (UID: \"5bc27de9-d3ad-4a51-bdf3-f80311f6c129\") " pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.591715 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.591685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qggk6\" (UniqueName: \"kubernetes.io/projected/60de261a-eaae-4b6c-bbab-99b171d21c35-kube-api-access-qggk6\") pod \"aws-ebs-csi-driver-node-7sv87\" (UID: \"60de261a-eaae-4b6c-bbab-99b171d21c35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.598231 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.598177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f4dw\" (UniqueName: \"kubernetes.io/projected/0cb56703-ab5b-459e-a153-0fce5bfea7af-kube-api-access-8f4dw\") pod \"multus-additional-cni-plugins-mwthv\" (UID: \"0cb56703-ab5b-459e-a153-0fce5bfea7af\") " pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.599777 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.599749    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwg9g\" (UniqueName: \"kubernetes.io/projected/e2860e2d-36c3-4495-b40d-45c6fbaa3540-kube-api-access-kwg9g\") pod \"ovnkube-node-g94rr\" (UID: \"e2860e2d-36c3-4495-b40d-45c6fbaa3540\") " pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.665828 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.665791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-var-lib-kubelet\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.665828 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.665830    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-host\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.665868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-sysctl-d\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.665892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-systemd\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.665923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:22.666031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.665951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e4a241f-3d98-46de-a331-337365b84c14-konnectivity-ca\") pod \"konnectivity-agent-4zcsl\" (UID: \"3e4a241f-3d98-46de-a331-337365b84c14\") " pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:22.666031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.665978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16f500b5-5bb9-4835-aca8-27d68fbe830c-kubelet-config\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:22.666031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.665984    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-host\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666013    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-systemd\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b00e522-ca7d-42f2-8ad1-cdc860c83856-hosts-file\") pod \"node-resolver-c47x8\" (UID: \"4b00e522-ca7d-42f2-8ad1-cdc860c83856\") " pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666041    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16f500b5-5bb9-4835-aca8-27d68fbe830c-kubelet-config\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-var-lib-kubelet\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666081    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b00e522-ca7d-42f2-8ad1-cdc860c83856-hosts-file\") pod \"node-resolver-c47x8\" (UID: \"4b00e522-ca7d-42f2-8ad1-cdc860c83856\") " pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-sysctl-d\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8eb0b2e-0a48-4cc3-ae1a-560ff5289233-host-slash\") pod \"iptables-alerter-nd62s\" (UID: \"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233\") " pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8eb0b2e-0a48-4cc3-ae1a-560ff5289233-host-slash\") pod \"iptables-alerter-nd62s\" (UID: \"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233\") " pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-modprobe-d\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-sys\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666175    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-sys\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-lib-modules\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666226    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-modprobe-d\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666228    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvjxg\" (UniqueName: \"kubernetes.io/projected/4b00e522-ca7d-42f2-8ad1-cdc860c83856-kube-api-access-fvjxg\") pod \"node-resolver-c47x8\" (UID: \"4b00e522-ca7d-42f2-8ad1-cdc860c83856\") " pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666296    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-lib-modules\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8eb0b2e-0a48-4cc3-ae1a-560ff5289233-iptables-alerter-script\") pod \"iptables-alerter-nd62s\" (UID: \"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233\") " pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plvwk\" (UniqueName: \"kubernetes.io/projected/a8eb0b2e-0a48-4cc3-ae1a-560ff5289233-kube-api-access-plvwk\") pod \"iptables-alerter-nd62s\" (UID: \"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233\") " pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.666511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-sysconfig\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.666379    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s95s2\" (UniqueName: \"kubernetes.io/projected/0f87f3df-f63b-4b04-a948-e35c11230537-kube-api-access-s95s2\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-run\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.666470    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs podName:64bee373-8991-49bb-b2a6-a5dde5eac0f7 nodeName:}" failed. No retries permitted until 2026-09-10 22:05:23.166427631 +0000 UTC m=+3.048911996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs") pod "network-metrics-daemon-s2rmw" (UID: "64bee373-8991-49bb-b2a6-a5dde5eac0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f87f3df-f63b-4b04-a948-e35c11230537-etc-tuned\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f87f3df-f63b-4b04-a948-e35c11230537-tmp\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666534    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-run\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666549    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-kubernetes\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16f500b5-5bb9-4835-aca8-27d68fbe830c-dbus\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666600    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e4a241f-3d98-46de-a331-337365b84c14-konnectivity-ca\") pod \"konnectivity-agent-4zcsl\" (UID: \"3e4a241f-3d98-46de-a331-337365b84c14\") " pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b00e522-ca7d-42f2-8ad1-cdc860c83856-tmp-dir\") pod \"node-resolver-c47x8\" (UID: \"4b00e522-ca7d-42f2-8ad1-cdc860c83856\") " pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8dsj\" (UniqueName: \"kubernetes.io/projected/64bee373-8991-49bb-b2a6-a5dde5eac0f7-kube-api-access-c8dsj\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666677    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-sysconfig\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.666746    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.666812    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret podName:16f500b5-5bb9-4835-aca8-27d68fbe830c nodeName:}" failed. No retries permitted until 2026-09-10 22:05:23.166792926 +0000 UTC m=+3.049277292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret") pod "global-pull-secret-syncer-svkw5" (UID: "16f500b5-5bb9-4835-aca8-27d68fbe830c") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:22.667579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666845    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-kubernetes\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.668489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e4a241f-3d98-46de-a331-337365b84c14-agent-certs\") pod \"konnectivity-agent-4zcsl\" (UID: \"3e4a241f-3d98-46de-a331-337365b84c14\") " pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:22.668489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666932    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b00e522-ca7d-42f2-8ad1-cdc860c83856-tmp-dir\") pod \"node-resolver-c47x8\" (UID: \"4b00e522-ca7d-42f2-8ad1-cdc860c83856\") " pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.668489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-sysctl-conf\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.668489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.666990    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8eb0b2e-0a48-4cc3-ae1a-560ff5289233-iptables-alerter-script\") pod \"iptables-alerter-nd62s\" (UID: \"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233\") " pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.668489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.667036    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16f500b5-5bb9-4835-aca8-27d68fbe830c-dbus\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:22.668489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.667060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f87f3df-f63b-4b04-a948-e35c11230537-etc-sysctl-conf\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.669032 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.669015    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f87f3df-f63b-4b04-a948-e35c11230537-tmp\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.669474 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.669456    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f87f3df-f63b-4b04-a948-e35c11230537-etc-tuned\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.669624 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.669607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e4a241f-3d98-46de-a331-337365b84c14-agent-certs\") pod \"konnectivity-agent-4zcsl\" (UID: \"3e4a241f-3d98-46de-a331-337365b84c14\") " pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:22.699270 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.699237    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:05:22.699270 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.699268    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:05:22.699586 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.699286    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4qrmn for pod openshift-network-diagnostics/network-check-target-8m9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:22.699586 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:22.699354    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn podName:aaede5a8-c1da-4f53-bebb-173bd3b9770b nodeName:}" failed. No retries permitted until 2026-09-10 22:05:23.199334639 +0000 UTC m=+3.081818987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4qrmn" (UniqueName: "kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn") pod "network-check-target-8m9nm" (UID: "aaede5a8-c1da-4f53-bebb-173bd3b9770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:22.702088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.702060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plvwk\" (UniqueName: \"kubernetes.io/projected/a8eb0b2e-0a48-4cc3-ae1a-560ff5289233-kube-api-access-plvwk\") pod \"iptables-alerter-nd62s\" (UID: \"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233\") " pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.702237 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.702213    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s95s2\" (UniqueName: \"kubernetes.io/projected/0f87f3df-f63b-4b04-a948-e35c11230537-kube-api-access-s95s2\") pod \"tuned-9pbfz\" (UID: \"0f87f3df-f63b-4b04-a948-e35c11230537\") " pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.702287 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.702257    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvjxg\" (UniqueName: \"kubernetes.io/projected/4b00e522-ca7d-42f2-8ad1-cdc860c83856-kube-api-access-fvjxg\") pod \"node-resolver-c47x8\" (UID: \"4b00e522-ca7d-42f2-8ad1-cdc860c83856\") " pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.702654 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.702628    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8dsj\" (UniqueName: \"kubernetes.io/projected/64bee373-8991-49bb-b2a6-a5dde5eac0f7-kube-api-access-c8dsj\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:22.760892 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.760856    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zgbcm"
Sep 10 22:05:22.770637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.770605    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:22.782742 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.782721    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87"
Sep 10 22:05:22.791626 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.791604    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mwthv"
Sep 10 22:05:22.800047 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.800023    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xw8nk"
Sep 10 22:05:22.807411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.807392    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c47x8"
Sep 10 22:05:22.817229 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.817191    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nd62s"
Sep 10 22:05:22.825256 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.825230    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9pbfz"
Sep 10 22:05:22.831322 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:22.831288    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:23.169620 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:23.169531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:23.169620 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:23.169589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:23.169857 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:23.169725    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:23.169857 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:23.169739    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:23.169857 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:23.169810    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret podName:16f500b5-5bb9-4835-aca8-27d68fbe830c nodeName:}" failed. No retries permitted until 2026-09-10 22:05:24.169791171 +0000 UTC m=+4.052275529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret") pod "global-pull-secret-syncer-svkw5" (UID: "16f500b5-5bb9-4835-aca8-27d68fbe830c") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:23.169857 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:23.169833    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs podName:64bee373-8991-49bb-b2a6-a5dde5eac0f7 nodeName:}" failed. No retries permitted until 2026-09-10 22:05:24.169821758 +0000 UTC m=+4.052306106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs") pod "network-metrics-daemon-s2rmw" (UID: "64bee373-8991-49bb-b2a6-a5dde5eac0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:23.270109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:23.270068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:23.270267 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:23.270239    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:05:23.270323 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:23.270271    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:05:23.270323 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:23.270287    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4qrmn for pod openshift-network-diagnostics/network-check-target-8m9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:23.270404 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:23.270358    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn podName:aaede5a8-c1da-4f53-bebb-173bd3b9770b nodeName:}" failed. No retries permitted until 2026-09-10 22:05:24.270338332 +0000 UTC m=+4.152822684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qrmn" (UniqueName: "kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn") pod "network-check-target-8m9nm" (UID: "aaede5a8-c1da-4f53-bebb-173bd3b9770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:23.526761 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:23.526651    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 22:00:23 +0000 UTC" deadline="2028-02-11 11:11:13.794987983 +0000 UTC"
Sep 10 22:05:23.526761 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:23.526703    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12445h5m50.268288861s"
Sep 10 22:05:23.547102 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:23.547054    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:23.547257 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:23.547202    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:23.779175 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:23.778849    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60de261a_eaae_4b6c_bbab_99b171d21c35.slice/crio-b13d729c0c837d98fb217c0082d74a2edf9bf2df67dbcb18447a84dc8dad0f9e WatchSource:0}: Error finding container b13d729c0c837d98fb217c0082d74a2edf9bf2df67dbcb18447a84dc8dad0f9e: Status 404 returned error can't find the container with id b13d729c0c837d98fb217c0082d74a2edf9bf2df67dbcb18447a84dc8dad0f9e
Sep 10 22:05:23.780232 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:23.780209    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb56703_ab5b_459e_a153_0fce5bfea7af.slice/crio-9d0bf13f8b0574bbd5187e54996e8db0de9ce0acad80bf6afc4ed02870480937 WatchSource:0}: Error finding container 9d0bf13f8b0574bbd5187e54996e8db0de9ce0acad80bf6afc4ed02870480937: Status 404 returned error can't find the container with id 9d0bf13f8b0574bbd5187e54996e8db0de9ce0acad80bf6afc4ed02870480937
Sep 10 22:05:23.782064 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:23.782015    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b00e522_ca7d_42f2_8ad1_cdc860c83856.slice/crio-d4b3f060edcd8729ec078a8488fbfc92420be83371f9ec24dcd0de30de690b1f WatchSource:0}: Error finding container d4b3f060edcd8729ec078a8488fbfc92420be83371f9ec24dcd0de30de690b1f: Status 404 returned error can't find the container with id d4b3f060edcd8729ec078a8488fbfc92420be83371f9ec24dcd0de30de690b1f
Sep 10 22:05:23.785056 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:23.785033    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8eb0b2e_0a48_4cc3_ae1a_560ff5289233.slice/crio-f5b04f4a1dac3016bd06e54b50f2891104f698cd237f8d5409ccccc6bda736bc WatchSource:0}: Error finding container f5b04f4a1dac3016bd06e54b50f2891104f698cd237f8d5409ccccc6bda736bc: Status 404 returned error can't find the container with id f5b04f4a1dac3016bd06e54b50f2891104f698cd237f8d5409ccccc6bda736bc
Sep 10 22:05:23.786359 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:23.786336    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401a84c5_0ae9_4eb7_80c1_f1b782c022ad.slice/crio-f0792c03df02b3f8e3eba3e4f9f3b253303da45412b6486a92ec577ae19db235 WatchSource:0}: Error finding container f0792c03df02b3f8e3eba3e4f9f3b253303da45412b6486a92ec577ae19db235: Status 404 returned error can't find the container with id f0792c03df02b3f8e3eba3e4f9f3b253303da45412b6486a92ec577ae19db235
Sep 10 22:05:23.787682 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:23.787652    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4a241f_3d98_46de_a331_337365b84c14.slice/crio-3ce60911a18360d0b13613efe38b56d43e0b43a35414327ad9488b284368bea4 WatchSource:0}: Error finding container 3ce60911a18360d0b13613efe38b56d43e0b43a35414327ad9488b284368bea4: Status 404 returned error can't find the container with id 3ce60911a18360d0b13613efe38b56d43e0b43a35414327ad9488b284368bea4
Sep 10 22:05:23.788395 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:23.788282    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc27de9_d3ad_4a51_bdf3_f80311f6c129.slice/crio-dd91a2d7f1af4be9aeb68a9b5efc7137143b0cf111c006a4554b650ab197efd7 WatchSource:0}: Error finding container dd91a2d7f1af4be9aeb68a9b5efc7137143b0cf111c006a4554b650ab197efd7: Status 404 returned error can't find the container with id dd91a2d7f1af4be9aeb68a9b5efc7137143b0cf111c006a4554b650ab197efd7
Sep 10 22:05:23.790201 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:23.790172    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f87f3df_f63b_4b04_a948_e35c11230537.slice/crio-4a23562ff7b9e651411dd3a5419c68ce7ef98e465576833a0cc97e045731d2bb WatchSource:0}: Error finding container 4a23562ff7b9e651411dd3a5419c68ce7ef98e465576833a0cc97e045731d2bb: Status 404 returned error can't find the container with id 4a23562ff7b9e651411dd3a5419c68ce7ef98e465576833a0cc97e045731d2bb
Sep 10 22:05:23.790806 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:23.790671    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2860e2d_36c3_4495_b40d_45c6fbaa3540.slice/crio-cca078e4ea4f4a279a49a0e4fb3710a3da4410ebcf75e570c717db322dc7f778 WatchSource:0}: Error finding container cca078e4ea4f4a279a49a0e4fb3710a3da4410ebcf75e570c717db322dc7f778: Status 404 returned error can't find the container with id cca078e4ea4f4a279a49a0e4fb3710a3da4410ebcf75e570c717db322dc7f778
Sep 10 22:05:23.977753 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:23.977725    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:05:24.178611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.178574    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:24.178611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.178614    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:24.178813 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.178728    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:24.178813 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.178735    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:24.178813 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.178782    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret podName:16f500b5-5bb9-4835-aca8-27d68fbe830c nodeName:}" failed. No retries permitted until 2026-09-10 22:05:26.178768401 +0000 UTC m=+6.061252745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret") pod "global-pull-secret-syncer-svkw5" (UID: "16f500b5-5bb9-4835-aca8-27d68fbe830c") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:24.178813 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.178799    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs podName:64bee373-8991-49bb-b2a6-a5dde5eac0f7 nodeName:}" failed. No retries permitted until 2026-09-10 22:05:26.178789797 +0000 UTC m=+6.061274142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs") pod "network-metrics-daemon-s2rmw" (UID: "64bee373-8991-49bb-b2a6-a5dde5eac0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:24.279999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.279301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:24.279999 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.279471    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:05:24.279999 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.279494    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:05:24.279999 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.279508    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4qrmn for pod openshift-network-diagnostics/network-check-target-8m9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:24.279999 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.279570    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn podName:aaede5a8-c1da-4f53-bebb-173bd3b9770b nodeName:}" failed. No retries permitted until 2026-09-10 22:05:26.279550626 +0000 UTC m=+6.162034975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qrmn" (UniqueName: "kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn") pod "network-check-target-8m9nm" (UID: "aaede5a8-c1da-4f53-bebb-173bd3b9770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:24.527159 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.527113    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 22:00:23 +0000 UTC" deadline="2028-04-14 14:26:04.163830554 +0000 UTC"
Sep 10 22:05:24.527159 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.527158    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13960h20m39.636677458s"
Sep 10 22:05:24.550089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.550019    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:24.550233 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.550152    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:24.550581 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.550558    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:24.550688 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:24.550668    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:24.589686 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.589651    2573 generic.go:356] "Generic (PLEG): container finished" podID="81e835015ef18fd79319f1af18d7d65f" containerID="1b8b512fbcb4ef524c622c1713023824325ca2ba69b8eb611d3dadc71140d7be" exitCode=0
Sep 10 22:05:24.590173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.589906    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal" event={"ID":"81e835015ef18fd79319f1af18d7d65f","Type":"ContainerDied","Data":"1b8b512fbcb4ef524c622c1713023824325ca2ba69b8eb611d3dadc71140d7be"}
Sep 10 22:05:24.603562 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.603491    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal" event={"ID":"a3752174baf855d01c4a6df678c4937e","Type":"ContainerStarted","Data":"7cd8cac1de074f3d604fc1832f915cdd0ed8edbfaf8478cd9027df0ce2b678f0"}
Sep 10 22:05:24.621971 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.621843    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" event={"ID":"e2860e2d-36c3-4495-b40d-45c6fbaa3540","Type":"ContainerStarted","Data":"cca078e4ea4f4a279a49a0e4fb3710a3da4410ebcf75e570c717db322dc7f778"}
Sep 10 22:05:24.629526 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.629490    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xw8nk" event={"ID":"5bc27de9-d3ad-4a51-bdf3-f80311f6c129","Type":"ContainerStarted","Data":"dd91a2d7f1af4be9aeb68a9b5efc7137143b0cf111c006a4554b650ab197efd7"}
Sep 10 22:05:24.635295 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.635265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c47x8" event={"ID":"4b00e522-ca7d-42f2-8ad1-cdc860c83856","Type":"ContainerStarted","Data":"d4b3f060edcd8729ec078a8488fbfc92420be83371f9ec24dcd0de30de690b1f"}
Sep 10 22:05:24.643231 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.643149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwthv" event={"ID":"0cb56703-ab5b-459e-a153-0fce5bfea7af","Type":"ContainerStarted","Data":"9d0bf13f8b0574bbd5187e54996e8db0de9ce0acad80bf6afc4ed02870480937"}
Sep 10 22:05:24.663224 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.663131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87" event={"ID":"60de261a-eaae-4b6c-bbab-99b171d21c35","Type":"ContainerStarted","Data":"b13d729c0c837d98fb217c0082d74a2edf9bf2df67dbcb18447a84dc8dad0f9e"}
Sep 10 22:05:24.677742 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.677663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9pbfz" event={"ID":"0f87f3df-f63b-4b04-a948-e35c11230537","Type":"ContainerStarted","Data":"4a23562ff7b9e651411dd3a5419c68ce7ef98e465576833a0cc97e045731d2bb"}
Sep 10 22:05:24.699071 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.699033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4zcsl" event={"ID":"3e4a241f-3d98-46de-a331-337365b84c14","Type":"ContainerStarted","Data":"3ce60911a18360d0b13613efe38b56d43e0b43a35414327ad9488b284368bea4"}
Sep 10 22:05:24.719422 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.719387    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zgbcm" event={"ID":"401a84c5-0ae9-4eb7-80c1-f1b782c022ad","Type":"ContainerStarted","Data":"f0792c03df02b3f8e3eba3e4f9f3b253303da45412b6486a92ec577ae19db235"}
Sep 10 22:05:24.740161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:24.739992    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nd62s" event={"ID":"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233","Type":"ContainerStarted","Data":"f5b04f4a1dac3016bd06e54b50f2891104f698cd237f8d5409ccccc6bda736bc"}
Sep 10 22:05:25.547648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:25.547615    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:25.548149 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:25.547754    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:25.764561 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:25.764352    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal" event={"ID":"81e835015ef18fd79319f1af18d7d65f","Type":"ContainerStarted","Data":"b6b9cdeddb37103631658a378176c19843d883b569bf1320e99f09b548819c38"}
Sep 10 22:05:25.789317 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:25.789246    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-165.ec2.internal" podStartSLOduration=3.789225529 podStartE2EDuration="3.789225529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:24.624869102 +0000 UTC m=+4.507353471" watchObservedRunningTime="2026-09-10 22:05:25.789225529 +0000 UTC m=+5.671709900"
Sep 10 22:05:25.789673 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:25.789638    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-165.ec2.internal" podStartSLOduration=3.789622177 podStartE2EDuration="3.789622177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:25.789114207 +0000 UTC m=+5.671598578" watchObservedRunningTime="2026-09-10 22:05:25.789622177 +0000 UTC m=+5.672106541"
Sep 10 22:05:26.194873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:26.194558    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:26.194873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:26.194616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:26.194873 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.194769    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:26.194873 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.194852    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs podName:64bee373-8991-49bb-b2a6-a5dde5eac0f7 nodeName:}" failed. No retries permitted until 2026-09-10 22:05:30.19482979 +0000 UTC m=+10.077314153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs") pod "network-metrics-daemon-s2rmw" (UID: "64bee373-8991-49bb-b2a6-a5dde5eac0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:26.195246 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.194780    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:26.195246 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.194922    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret podName:16f500b5-5bb9-4835-aca8-27d68fbe830c nodeName:}" failed. No retries permitted until 2026-09-10 22:05:30.194908655 +0000 UTC m=+10.077393022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret") pod "global-pull-secret-syncer-svkw5" (UID: "16f500b5-5bb9-4835-aca8-27d68fbe830c") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:26.295637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:26.295584    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:26.295883 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.295844    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:05:26.295883 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.295872    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:05:26.295883 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.295885    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4qrmn for pod openshift-network-diagnostics/network-check-target-8m9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:26.296079 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.295976    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn podName:aaede5a8-c1da-4f53-bebb-173bd3b9770b nodeName:}" failed. No retries permitted until 2026-09-10 22:05:30.295956709 +0000 UTC m=+10.178441059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qrmn" (UniqueName: "kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn") pod "network-check-target-8m9nm" (UID: "aaede5a8-c1da-4f53-bebb-173bd3b9770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:26.547843 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:26.547013    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:26.547843 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:26.547117    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:26.547843 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.547368    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:26.547843 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:26.547487    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:27.547027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:27.546991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:27.547227 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:27.547132    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:28.548457 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:28.547513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:28.548457 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:28.547532    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:28.548457 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:28.547651    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:28.548457 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:28.547751    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:29.547028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:29.546901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:29.547191 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:29.547051    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:30.229212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:30.229159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:30.229712 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:30.229225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:30.229712 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.229370    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:30.229712 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.229429    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret podName:16f500b5-5bb9-4835-aca8-27d68fbe830c nodeName:}" failed. No retries permitted until 2026-09-10 22:05:38.229409792 +0000 UTC m=+18.111894143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret") pod "global-pull-secret-syncer-svkw5" (UID: "16f500b5-5bb9-4835-aca8-27d68fbe830c") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:30.229924 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.229739    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:30.229924 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.229809    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs podName:64bee373-8991-49bb-b2a6-a5dde5eac0f7 nodeName:}" failed. No retries permitted until 2026-09-10 22:05:38.229790174 +0000 UTC m=+18.112274527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs") pod "network-metrics-daemon-s2rmw" (UID: "64bee373-8991-49bb-b2a6-a5dde5eac0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:30.330343 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:30.330297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:30.330541 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.330501    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:05:30.330541 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.330525    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:05:30.330541 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.330539    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4qrmn for pod openshift-network-diagnostics/network-check-target-8m9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:30.330714 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.330596    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn podName:aaede5a8-c1da-4f53-bebb-173bd3b9770b nodeName:}" failed. No retries permitted until 2026-09-10 22:05:38.330582357 +0000 UTC m=+18.213066720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qrmn" (UniqueName: "kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn") pod "network-check-target-8m9nm" (UID: "aaede5a8-c1da-4f53-bebb-173bd3b9770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:30.547714 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:30.547604    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:30.547888 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.547721    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:30.548137 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:30.547946    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:30.548137 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:30.548090    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:31.546956 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:31.546921    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:31.547346 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:31.547049    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:32.547444 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:32.547351    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:32.547444 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:32.547305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:32.547996 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:32.547525    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:32.547996 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:32.547779    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:33.546905 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:33.546866    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:33.547101 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:33.546997    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:34.547537 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:34.547507    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:34.547948 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:34.547507    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:34.547948 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:34.547613    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:34.547948 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:34.547703    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:35.546996 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:35.546964    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:35.547180 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:35.547084    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:36.547461 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:36.547427    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:36.547937 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:36.547432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:36.547937 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:36.547561    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:36.547937 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:36.547627    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:37.546666 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:37.546629    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:37.546941 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:37.546761    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:38.290561 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:38.290525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:38.290976 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:38.290585    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:38.290976 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.290623    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:38.290976 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.290696    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs podName:64bee373-8991-49bb-b2a6-a5dde5eac0f7 nodeName:}" failed. No retries permitted until 2026-09-10 22:05:54.290676327 +0000 UTC m=+34.173160678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs") pod "network-metrics-daemon-s2rmw" (UID: "64bee373-8991-49bb-b2a6-a5dde5eac0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:38.290976 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.290719    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:38.290976 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.290772    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret podName:16f500b5-5bb9-4835-aca8-27d68fbe830c nodeName:}" failed. No retries permitted until 2026-09-10 22:05:54.290757156 +0000 UTC m=+34.173241516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret") pod "global-pull-secret-syncer-svkw5" (UID: "16f500b5-5bb9-4835-aca8-27d68fbe830c") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:38.391794 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:38.391760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:38.391965 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.391926    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:05:38.391965 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.391953    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:05:38.391965 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.391964    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4qrmn for pod openshift-network-diagnostics/network-check-target-8m9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:38.392123 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.392029    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn podName:aaede5a8-c1da-4f53-bebb-173bd3b9770b nodeName:}" failed. No retries permitted until 2026-09-10 22:05:54.392010691 +0000 UTC m=+34.274495036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qrmn" (UniqueName: "kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn") pod "network-check-target-8m9nm" (UID: "aaede5a8-c1da-4f53-bebb-173bd3b9770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:38.546791 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:38.546729    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:38.546935 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.546826    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:38.546935 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:38.546887    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:38.547055 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:38.546969    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:39.546725 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:39.546693    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:39.547131 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:39.546796    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:40.547718 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:40.547682    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:40.548147 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:40.547782    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:40.548147 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:40.547873    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:40.548147 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:40.547974    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:41.547222 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:41.547190    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:41.547376 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:41.547289    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:42.547151 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.547115    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:42.547992 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:42.547221    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:42.547992 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.547250    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:42.547992 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:42.547373    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:42.805750 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.805462    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" event={"ID":"e2860e2d-36c3-4495-b40d-45c6fbaa3540","Type":"ContainerStarted","Data":"bfe6b4e2ce429083fd61fcf317146e09e99fd729776a2f5c78ba274c1c693201"}
Sep 10 22:05:42.805750 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.805538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" event={"ID":"e2860e2d-36c3-4495-b40d-45c6fbaa3540","Type":"ContainerStarted","Data":"e483c8708470972dbea4d680b22819e796b42d7de93a66972df4b1eb11c1535f"}
Sep 10 22:05:42.805750 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.805582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" event={"ID":"e2860e2d-36c3-4495-b40d-45c6fbaa3540","Type":"ContainerStarted","Data":"699eadff2e3832e3142a02f3d1da08b3909408e8c07f2f5d984810ba212556c5"}
Sep 10 22:05:42.805750 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.805618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" event={"ID":"e2860e2d-36c3-4495-b40d-45c6fbaa3540","Type":"ContainerStarted","Data":"3c4131f50baf846942d42f4433dbcdd44228dd93e4ed82cb87ebd2ee537195e7"}
Sep 10 22:05:42.805750 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.805655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" event={"ID":"e2860e2d-36c3-4495-b40d-45c6fbaa3540","Type":"ContainerStarted","Data":"c6bec3f82467d14bbe628df6cc89b182d0516b7ee20a453c7aa24b07eec38c8a"}
Sep 10 22:05:42.805750 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.805697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" event={"ID":"e2860e2d-36c3-4495-b40d-45c6fbaa3540","Type":"ContainerStarted","Data":"f28053369fca610a29af8ada13c12f1c79788b36a43787f98dec4ab9e39f202c"}
Sep 10 22:05:42.807196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.807165    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xw8nk" event={"ID":"5bc27de9-d3ad-4a51-bdf3-f80311f6c129","Type":"ContainerStarted","Data":"8a282228cbf01d975c71704546a306b77f1699b8fc276ca99219d54f59f460f8"}
Sep 10 22:05:42.808692 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.808669    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c47x8" event={"ID":"4b00e522-ca7d-42f2-8ad1-cdc860c83856","Type":"ContainerStarted","Data":"bf2467ed1cb1604b573902386219b477b78361c390a106a070535b9d49dec1a1"}
Sep 10 22:05:42.810628 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.810401    2573 generic.go:356] "Generic (PLEG): container finished" podID="0cb56703-ab5b-459e-a153-0fce5bfea7af" containerID="e070937405eabbbb5297af0296195336bf1a828e94f4f14779a9649c29d2e099" exitCode=0
Sep 10 22:05:42.810628 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.810434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwthv" event={"ID":"0cb56703-ab5b-459e-a153-0fce5bfea7af","Type":"ContainerDied","Data":"e070937405eabbbb5297af0296195336bf1a828e94f4f14779a9649c29d2e099"}
Sep 10 22:05:42.812164 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.812137    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87" event={"ID":"60de261a-eaae-4b6c-bbab-99b171d21c35","Type":"ContainerStarted","Data":"85058fd27339a11380a45c15b07dc379507c2d37b61b543adbb1f9907be5857b"}
Sep 10 22:05:42.813827 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.813799    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9pbfz" event={"ID":"0f87f3df-f63b-4b04-a948-e35c11230537","Type":"ContainerStarted","Data":"f8d84fcd77a7eafb90581c553e66d9e483dcb7d80b9a6e331a8e46919ed8264b"}
Sep 10 22:05:42.815395 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.815372    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4zcsl" event={"ID":"3e4a241f-3d98-46de-a331-337365b84c14","Type":"ContainerStarted","Data":"8e27469f8ea58a824e87d7df2ff7d9c0d171070279d0c7ff8ee37732d7f01395"}
Sep 10 22:05:42.819641 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.819617    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zgbcm" event={"ID":"401a84c5-0ae9-4eb7-80c1-f1b782c022ad","Type":"ContainerStarted","Data":"7b6214fe50ec9fd3bf023b17cafa2c7dd0ee8b87a1e3ac8cc7bb4eeea528a575"}
Sep 10 22:05:42.828255 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.828215    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xw8nk" podStartSLOduration=3.46588803 podStartE2EDuration="21.828204129s" totalImagesPullingTime="18.362316099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:42.828104476 +0000 UTC m=+22.710588842" watchObservedRunningTime="2026-09-10 22:05:42.828204129 +0000 UTC m=+22.710688494"
Sep 10 22:05:42.844545 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.844504    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9pbfz" podStartSLOduration=3.519982707 podStartE2EDuration="21.844493493s" totalImagesPullingTime="18.324510786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:42.844175067 +0000 UTC m=+22.726659427" watchObservedRunningTime="2026-09-10 22:05:42.844493493 +0000 UTC m=+22.726977860"
Sep 10 22:05:42.862779 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.862705    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4zcsl" podStartSLOduration=7.129268731 podStartE2EDuration="21.862693702s" totalImagesPullingTime="14.733424971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:42.861881289 +0000 UTC m=+22.744365652" watchObservedRunningTime="2026-09-10 22:05:42.862693702 +0000 UTC m=+22.745178067"
Sep 10 22:05:42.881072 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.881018    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zgbcm" podStartSLOduration=3.569142329 podStartE2EDuration="21.881001475s" totalImagesPullingTime="18.311859146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:42.880544464 +0000 UTC m=+22.763028830" watchObservedRunningTime="2026-09-10 22:05:42.881001475 +0000 UTC m=+22.763485842"
Sep 10 22:05:42.934942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.934889    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c47x8" podStartSLOduration=3.609318353 podStartE2EDuration="21.934873514s" totalImagesPullingTime="18.325555161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:42.934751856 +0000 UTC m=+22.817236226" watchObservedRunningTime="2026-09-10 22:05:42.934873514 +0000 UTC m=+22.817357900"
Sep 10 22:05:42.994955 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:42.994925    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:43.063371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:43.063317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:43.547063 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:43.547044    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:43.547163 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:43.547128    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:43.666231 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:43.666206    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 22:05:43.824092 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:43.824002    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87" event={"ID":"60de261a-eaae-4b6c-bbab-99b171d21c35","Type":"ContainerStarted","Data":"8b6f5f271bfdecd9267ae5cf4133bf9af710137263613a17c716d17b94b27c48"}
Sep 10 22:05:43.825537 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:43.825511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nd62s" event={"ID":"a8eb0b2e-0a48-4cc3-ae1a-560ff5289233","Type":"ContainerStarted","Data":"3816cafa522648a61cda2b70d0921dfeef19d8efe1fc2e64151194d31fec1366"}
Sep 10 22:05:43.841814 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:43.841768    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nd62s" podStartSLOduration=4.528055848 podStartE2EDuration="22.841753176s" totalImagesPullingTime="18.313697328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:43.841383018 +0000 UTC m=+23.723867384" watchObservedRunningTime="2026-09-10 22:05:43.841753176 +0000 UTC m=+23.724237541"
Sep 10 22:05:43.986317 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:43.986280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:44.052593 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.052535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:44.520293 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.520141    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T22:05:43.666226985Z","UUID":"c41470fe-df81-4f03-b1f3-cae248023575","Handler":null,"Name":"","Endpoint":""}
Sep 10 22:05:44.522011 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.521990    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 22:05:44.522137 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.522037    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 22:05:44.546895 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.546827    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:44.547031 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:44.546953    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:44.547323 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.547164    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:44.547323 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:44.547284    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:44.559973 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.559945    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:44.560488 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.560469    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:44.828515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.828492    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:44.829030 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.829009    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4zcsl"
Sep 10 22:05:44.896542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:44.895703    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:45.547178 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:45.547144    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:45.547351 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:45.547253    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:45.833453 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:45.833373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87" event={"ID":"60de261a-eaae-4b6c-bbab-99b171d21c35","Type":"ContainerStarted","Data":"1bd153bfcfef7ab81a58f4a154adcc47420a2fdfb5ece6f44499897cdbc57536"}
Sep 10 22:05:45.837578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:45.837553    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" event={"ID":"e2860e2d-36c3-4495-b40d-45c6fbaa3540","Type":"ContainerStarted","Data":"4ed8dc3ce1152aa21620dea2580078ba09ea1f927dd0ef92881d632bedbf4d57"}
Sep 10 22:05:45.851991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:45.851942    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sv87" podStartSLOduration=4.222069155 podStartE2EDuration="24.851927418s" totalImagesPullingTime="20.629858263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:45.851283304 +0000 UTC m=+25.733767683" watchObservedRunningTime="2026-09-10 22:05:45.851927418 +0000 UTC m=+25.734411795"
Sep 10 22:05:46.546673 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:46.546637    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:46.546880 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:46.546685    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:46.546880 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:46.546775    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:46.546970 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:46.546940    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:47.281989 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:47.281873    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:47.348447 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:47.348389    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:47.547538 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:47.547460    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:47.547698 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:47.547580    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:48.547601 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.547383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:48.548252 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.547445    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:48.548252 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:48.547624    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:48.548252 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:48.547694    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:48.846470 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.846382    2573 generic.go:356] "Generic (PLEG): container finished" podID="0cb56703-ab5b-459e-a153-0fce5bfea7af" containerID="326f8ca470a75fe91863059e560e15775d1ea7bfd66309ac7336242e45e1ffaf" exitCode=0
Sep 10 22:05:48.846610 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.846478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwthv" event={"ID":"0cb56703-ab5b-459e-a153-0fce5bfea7af","Type":"ContainerDied","Data":"326f8ca470a75fe91863059e560e15775d1ea7bfd66309ac7336242e45e1ffaf"}
Sep 10 22:05:48.851702 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.851677    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" event={"ID":"e2860e2d-36c3-4495-b40d-45c6fbaa3540","Type":"ContainerStarted","Data":"a4b7d98c1877370c759f4997cdae030df17cf8b641c6a42f8dda3057bf3d7d20"}
Sep 10 22:05:48.851956 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.851938    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:48.852058 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.852011    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:48.852117 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.852062    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:48.867106 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.867086    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:48.867197 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.867179    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:05:48.893813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:48.893772    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr" podStartSLOduration=9.5152381 podStartE2EDuration="27.893757714s" totalImagesPullingTime="18.378519614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:48.89249455 +0000 UTC m=+28.774978927" watchObservedRunningTime="2026-09-10 22:05:48.893757714 +0000 UTC m=+28.776242080"
Sep 10 22:05:49.547264 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:49.546958    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:49.547528 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:49.547332    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:49.855557 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:49.855479    2573 generic.go:356] "Generic (PLEG): container finished" podID="0cb56703-ab5b-459e-a153-0fce5bfea7af" containerID="d8796ff895df16f1ebd679579147f849482c9e8dc93c173f34414fa1f075e6aa" exitCode=0
Sep 10 22:05:49.855912 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:49.855566    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwthv" event={"ID":"0cb56703-ab5b-459e-a153-0fce5bfea7af","Type":"ContainerDied","Data":"d8796ff895df16f1ebd679579147f849482c9e8dc93c173f34414fa1f075e6aa"}
Sep 10 22:05:49.887299 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:49.886883    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s2rmw"]
Sep 10 22:05:49.887299 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:49.887068    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:49.887299 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:49.887211    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:49.889027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:49.889001    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8m9nm"]
Sep 10 22:05:49.889261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:49.889241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:49.889563 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:49.889339    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:49.889642 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:49.889624    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-svkw5"]
Sep 10 22:05:49.889705 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:49.889692    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:49.889780 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:49.889761    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:50.860377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:50.860297    2573 generic.go:356] "Generic (PLEG): container finished" podID="0cb56703-ab5b-459e-a153-0fce5bfea7af" containerID="e415aba4eef4785abed9b3deba8e3b2575baeeca28bede0aa6eb3cb92d97d612" exitCode=0
Sep 10 22:05:50.860377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:50.860337    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwthv" event={"ID":"0cb56703-ab5b-459e-a153-0fce5bfea7af","Type":"ContainerDied","Data":"e415aba4eef4785abed9b3deba8e3b2575baeeca28bede0aa6eb3cb92d97d612"}
Sep 10 22:05:51.546965 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:51.546936    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:51.546965 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:51.546956    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:51.547140 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:51.547051    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:51.547140 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:51.547086    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:51.547209 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:51.547181    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:51.547244 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:51.547230    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:53.444156 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:53.444103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:53.516383 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:53.516352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:53.546818 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:53.546773    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:53.546818 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:53.546794    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:53.547079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:53.546894    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:53.547079 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:53.546900    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2rmw" podUID="64bee373-8991-49bb-b2a6-a5dde5eac0f7"
Sep 10 22:05:53.547079 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:53.546967    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-svkw5" podUID="16f500b5-5bb9-4835-aca8-27d68fbe830c"
Sep 10 22:05:53.547079 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:53.547046    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m9nm" podUID="aaede5a8-c1da-4f53-bebb-173bd3b9770b"
Sep 10 22:05:53.906037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:53.905963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:54.007657 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:54.007624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:54.296694 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:54.296658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:54.297007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:54.296742    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:54.297007 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:54.296820    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:54.297007 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:54.296889    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret podName:16f500b5-5bb9-4835-aca8-27d68fbe830c nodeName:}" failed. No retries permitted until 2026-09-10 22:06:26.296876487 +0000 UTC m=+66.179360835 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret") pod "global-pull-secret-syncer-svkw5" (UID: "16f500b5-5bb9-4835-aca8-27d68fbe830c") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:05:54.297007 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:54.296820    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:54.297007 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:54.297004    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs podName:64bee373-8991-49bb-b2a6-a5dde5eac0f7 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:26.29697846 +0000 UTC m=+66.179462823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs") pod "network-metrics-daemon-s2rmw" (UID: "64bee373-8991-49bb-b2a6-a5dde5eac0f7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:05:54.397701 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:54.397671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:54.397870 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:54.397827    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:05:54.397870 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:54.397861    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:05:54.397947 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:54.397874    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4qrmn for pod openshift-network-diagnostics/network-check-target-8m9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:54.397984 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:54.397944    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn podName:aaede5a8-c1da-4f53-bebb-173bd3b9770b nodeName:}" failed. No retries permitted until 2026-09-10 22:06:26.397916626 +0000 UTC m=+66.280400975 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4qrmn" (UniqueName: "kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn") pod "network-check-target-8m9nm" (UID: "aaede5a8-c1da-4f53-bebb-173bd3b9770b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:05:54.497955 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:54.497913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:54.554233 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:54.554166    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:54.934541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:54.934265    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-165.ec2.internal" event="NodeReady"
Sep 10 22:05:54.934694 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:54.934624    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 22:05:54.980816 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:54.980788    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-64wxb"]
Sep 10 22:05:55.014142 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.014117    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xw587"]
Sep 10 22:05:55.014310 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.014259    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.016480 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.016460    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 22:05:55.016605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.016493    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mb5j2\""
Sep 10 22:05:55.016605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.016523    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 22:05:55.028035 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.028017    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xw587"]
Sep 10 22:05:55.028128 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.028044    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64wxb"]
Sep 10 22:05:55.028128 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.028121    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xw587"
Sep 10 22:05:55.030560 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.030543    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 22:05:55.030693 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.030678    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 22:05:55.030957 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.030939    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 22:05:55.031070 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.030945    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wxdc9\""
Sep 10 22:05:55.102187 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.102159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f84xc\" (UniqueName: \"kubernetes.io/projected/365134e3-4e3d-47e5-b6f2-43cfa412d5b6-kube-api-access-f84xc\") pod \"ingress-canary-xw587\" (UID: \"365134e3-4e3d-47e5-b6f2-43cfa412d5b6\") " pod="openshift-ingress-canary/ingress-canary-xw587"
Sep 10 22:05:55.102355 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.102208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/365134e3-4e3d-47e5-b6f2-43cfa412d5b6-cert\") pod \"ingress-canary-xw587\" (UID: \"365134e3-4e3d-47e5-b6f2-43cfa412d5b6\") " pod="openshift-ingress-canary/ingress-canary-xw587"
Sep 10 22:05:55.102355 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.102270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whlns\" (UniqueName: \"kubernetes.io/projected/84494055-3279-435f-b7c7-e85cb4753c2f-kube-api-access-whlns\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.102355 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.102309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.102515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.102384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/84494055-3279-435f-b7c7-e85cb4753c2f-config-volume\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.102515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.102409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84494055-3279-435f-b7c7-e85cb4753c2f-tmp-dir\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.203206 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.203123    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f84xc\" (UniqueName: \"kubernetes.io/projected/365134e3-4e3d-47e5-b6f2-43cfa412d5b6-kube-api-access-f84xc\") pod \"ingress-canary-xw587\" (UID: \"365134e3-4e3d-47e5-b6f2-43cfa412d5b6\") " pod="openshift-ingress-canary/ingress-canary-xw587"
Sep 10 22:05:55.203206 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.203183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/365134e3-4e3d-47e5-b6f2-43cfa412d5b6-cert\") pod \"ingress-canary-xw587\" (UID: \"365134e3-4e3d-47e5-b6f2-43cfa412d5b6\") " pod="openshift-ingress-canary/ingress-canary-xw587"
Sep 10 22:05:55.203206 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.203208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whlns\" (UniqueName: \"kubernetes.io/projected/84494055-3279-435f-b7c7-e85cb4753c2f-kube-api-access-whlns\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.203467 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.203229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.203467 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.203305    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/84494055-3279-435f-b7c7-e85cb4753c2f-config-volume\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.203467 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.203332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84494055-3279-435f-b7c7-e85cb4753c2f-tmp-dir\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.203587 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:55.203471    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:05:55.203587 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:55.203549    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls podName:84494055-3279-435f-b7c7-e85cb4753c2f nodeName:}" failed. No retries permitted until 2026-09-10 22:05:55.703529997 +0000 UTC m=+35.586014348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls") pod "dns-default-64wxb" (UID: "84494055-3279-435f-b7c7-e85cb4753c2f") : secret "dns-default-metrics-tls" not found
Sep 10 22:05:55.203940 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.203917    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84494055-3279-435f-b7c7-e85cb4753c2f-tmp-dir\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.204107 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.204090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/84494055-3279-435f-b7c7-e85cb4753c2f-config-volume\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.207990 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.207965    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/365134e3-4e3d-47e5-b6f2-43cfa412d5b6-cert\") pod \"ingress-canary-xw587\" (UID: \"365134e3-4e3d-47e5-b6f2-43cfa412d5b6\") " pod="openshift-ingress-canary/ingress-canary-xw587"
Sep 10 22:05:55.211678 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.211659    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whlns\" (UniqueName: \"kubernetes.io/projected/84494055-3279-435f-b7c7-e85cb4753c2f-kube-api-access-whlns\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.212378 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.212331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f84xc\" (UniqueName: \"kubernetes.io/projected/365134e3-4e3d-47e5-b6f2-43cfa412d5b6-kube-api-access-f84xc\") pod \"ingress-canary-xw587\" (UID: \"365134e3-4e3d-47e5-b6f2-43cfa412d5b6\") " pod="openshift-ingress-canary/ingress-canary-xw587"
Sep 10 22:05:55.338097 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.338057    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xw587"
Sep 10 22:05:55.547513 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.547482    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:05:55.547947 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.547528    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:05:55.547947 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.547486    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:05:55.550532 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.550503    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:05:55.550669 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.550640    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:05:55.551006 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.550983    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:05:55.551180 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.551165    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8m774\""
Sep 10 22:05:55.551933 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.551915    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:05:55.551992 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.551955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dmqhm\""
Sep 10 22:05:55.706760 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:55.706723    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:55.706947 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:55.706836    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:05:55.706947 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:55.706921    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls podName:84494055-3279-435f-b7c7-e85cb4753c2f nodeName:}" failed. No retries permitted until 2026-09-10 22:05:56.706903766 +0000 UTC m=+36.589388113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls") pod "dns-default-64wxb" (UID: "84494055-3279-435f-b7c7-e85cb4753c2f") : secret "dns-default-metrics-tls" not found
Sep 10 22:05:56.452958 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:56.452893    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xw587"]
Sep 10 22:05:56.461739 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:05:56.461713    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365134e3_4e3d_47e5_b6f2_43cfa412d5b6.slice/crio-6fc7be4106c4ad9558133438c43750103ce6762c62ec21b2868420a6dee69d5e WatchSource:0}: Error finding container 6fc7be4106c4ad9558133438c43750103ce6762c62ec21b2868420a6dee69d5e: Status 404 returned error can't find the container with id 6fc7be4106c4ad9558133438c43750103ce6762c62ec21b2868420a6dee69d5e
Sep 10 22:05:56.472397 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:56.472379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:56.714056 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:56.713863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:56.714589 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:56.714001    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:05:56.714589 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:56.714148    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls podName:84494055-3279-435f-b7c7-e85cb4753c2f nodeName:}" failed. No retries permitted until 2026-09-10 22:05:58.714132466 +0000 UTC m=+38.596616824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls") pod "dns-default-64wxb" (UID: "84494055-3279-435f-b7c7-e85cb4753c2f") : secret "dns-default-metrics-tls" not found
Sep 10 22:05:56.874856 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:56.874808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xw587" event={"ID":"365134e3-4e3d-47e5-b6f2-43cfa412d5b6","Type":"ContainerStarted","Data":"6fc7be4106c4ad9558133438c43750103ce6762c62ec21b2868420a6dee69d5e"}
Sep 10 22:05:56.877354 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:56.877326    2573 generic.go:356] "Generic (PLEG): container finished" podID="0cb56703-ab5b-459e-a153-0fce5bfea7af" containerID="23d2e19e2366e992282137b6ca5e4af3c9a8af312cf55ab6038e31a03cb4b44a" exitCode=0
Sep 10 22:05:56.877472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:56.877366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwthv" event={"ID":"0cb56703-ab5b-459e-a153-0fce5bfea7af","Type":"ContainerDied","Data":"23d2e19e2366e992282137b6ca5e4af3c9a8af312cf55ab6038e31a03cb4b44a"}
Sep 10 22:05:57.883616 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:57.883583    2573 generic.go:356] "Generic (PLEG): container finished" podID="0cb56703-ab5b-459e-a153-0fce5bfea7af" containerID="568a369b0d7f812080a07bca9e9bc768b2a75661b064f1ccd391c8ab7fda4b05" exitCode=0
Sep 10 22:05:57.884027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:57.883643    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwthv" event={"ID":"0cb56703-ab5b-459e-a153-0fce5bfea7af","Type":"ContainerDied","Data":"568a369b0d7f812080a07bca9e9bc768b2a75661b064f1ccd391c8ab7fda4b05"}
Sep 10 22:05:58.727158 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:58.727120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:05:58.727340 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:58.727256    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:05:58.727340 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:05:58.727335    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls podName:84494055-3279-435f-b7c7-e85cb4753c2f nodeName:}" failed. No retries permitted until 2026-09-10 22:06:02.72731402 +0000 UTC m=+42.609798378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls") pod "dns-default-64wxb" (UID: "84494055-3279-435f-b7c7-e85cb4753c2f") : secret "dns-default-metrics-tls" not found
Sep 10 22:05:58.894472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:58.894435    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwthv" event={"ID":"0cb56703-ab5b-459e-a153-0fce5bfea7af","Type":"ContainerStarted","Data":"85c25cf868d67884a6a9996377b141b2dce1f6e1580c3326d6bcb1b8e4cc601b"}
Sep 10 22:05:58.916470 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:58.915986    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mwthv" podStartSLOduration=7.169462954 podStartE2EDuration="37.915968368s" totalImagesPullingTime="30.746505414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:58.915315505 +0000 UTC m=+38.797799896" watchObservedRunningTime="2026-09-10 22:05:58.915968368 +0000 UTC m=+38.798452739"
Sep 10 22:05:59.036890 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:59.036799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:59.092918 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:59.092889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:05:59.898044 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:59.898008    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xw587" event={"ID":"365134e3-4e3d-47e5-b6f2-43cfa412d5b6","Type":"ContainerStarted","Data":"2dad0d3e27de3dd0814cfabe21dd790f4faf7c56a473788cb5e60b4608ea85a9"}
Sep 10 22:05:59.912177 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:05:59.912130    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xw587" podStartSLOduration=2.866701881 podStartE2EDuration="5.91211508s" totalImagesPullingTime="3.045413199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:05:59.911763465 +0000 UTC m=+39.794247831" watchObservedRunningTime="2026-09-10 22:05:59.91211508 +0000 UTC m=+39.794599445"
Sep 10 22:06:00.204530 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:00.204463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:00.294999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:00.294968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:00.396985 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:00.396954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:01.819060 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:01.819025    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:02.760185 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:02.760130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:06:02.760368 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:02.760275    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:06:02.760368 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:02.760337    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls podName:84494055-3279-435f-b7c7-e85cb4753c2f nodeName:}" failed. No retries permitted until 2026-09-10 22:06:10.760322648 +0000 UTC m=+50.642806997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls") pod "dns-default-64wxb" (UID: "84494055-3279-435f-b7c7-e85cb4753c2f") : secret "dns-default-metrics-tls" not found
Sep 10 22:06:03.434515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.434477    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"]
Sep 10 22:06:03.467269 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.467244    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr"]
Sep 10 22:06:03.467399 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.467345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:03.471924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.471897    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:06:03.472132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.471922    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 22:06:03.472961 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.472939    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2nr5t\""
Sep 10 22:06:03.473064 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.472945    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 22:06:03.491350 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.491332    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"]
Sep 10 22:06:03.491458 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.491441    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr"
Sep 10 22:06:03.493755 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.493738    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:06:03.493863 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.493769    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 22:06:03.494398 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.494380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-485zw\""
Sep 10 22:06:03.515395 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.515373    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-667fd765fd-m6pm2"]
Sep 10 22:06:03.515493 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.515478    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.517979 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.517962    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9d2mr\""
Sep 10 22:06:03.518173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.518158    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 22:06:03.518328 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.518310    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:06:03.518614 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.518600    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 22:06:03.518802 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.518790    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 22:06:03.535464 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.535445    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"]
Sep 10 22:06:03.535542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.535473    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr"]
Sep 10 22:06:03.535542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.535486    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"]
Sep 10 22:06:03.535542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.535505    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-667fd765fd-m6pm2"]
Sep 10 22:06:03.535631 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.535578    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.540051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.540024    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 22:06:03.540051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.540040    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 22:06:03.540552 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.540533    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 22:06:03.540650 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.540570    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 22:06:03.540971 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.540950    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 22:06:03.541190 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.541171    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m7src\""
Sep 10 22:06:03.541305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.541262    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 22:06:03.542567 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.542547    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-dp2pn"]
Sep 10 22:06:03.557529 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.557515    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.560193 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.560176    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 22:06:03.560393 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.560370    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 22:06:03.560476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.560403    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 22:06:03.560476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.560437    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mtjt9\""
Sep 10 22:06:03.564578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.564562    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:06:03.565497 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.565481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h69f\" (UniqueName: \"kubernetes.io/projected/517b2cfa-087e-4345-a598-da3802941602-kube-api-access-7h69f\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:03.565565 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.565505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt988\" (UniqueName: \"kubernetes.io/projected/34efec45-a4c2-4a2f-b496-337e64ae46f3-kube-api-access-vt988\") pod \"volume-data-source-validator-86695b7cc7-ts2dr\" (UID: \"34efec45-a4c2-4a2f-b496-337e64ae46f3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr"
Sep 10 22:06:03.565565 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.565526    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:03.571288 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.571269    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 22:06:03.574767 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.574729    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-dp2pn"]
Sep 10 22:06:03.647767 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.647739    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"]
Sep 10 22:06:03.666336 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666308    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655ef482-45b1-4d0d-9912-25381723f2f5-serving-cert\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.666336 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcnnt\" (UniqueName: \"kubernetes.io/projected/655ef482-45b1-4d0d-9912-25381723f2f5-kube-api-access-zcnnt\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.666527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655ef482-45b1-4d0d-9912-25381723f2f5-config\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.666527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-stats-auth\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.666527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.666527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-default-certificate\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.666733 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.666733 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3dad17d-e969-4018-a4e2-972bb16cd582-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8c78r\" (UID: \"b3dad17d-e969-4018-a4e2-972bb16cd582\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.666733 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3dad17d-e969-4018-a4e2-972bb16cd582-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8c78r\" (UID: \"b3dad17d-e969-4018-a4e2-972bb16cd582\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.666733 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvzxk\" (UniqueName: \"kubernetes.io/projected/b3dad17d-e969-4018-a4e2-972bb16cd582-kube-api-access-nvzxk\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8c78r\" (UID: \"b3dad17d-e969-4018-a4e2-972bb16cd582\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.666733 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h69f\" (UniqueName: \"kubernetes.io/projected/517b2cfa-087e-4345-a598-da3802941602-kube-api-access-7h69f\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:03.666733 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt988\" (UniqueName: \"kubernetes.io/projected/34efec45-a4c2-4a2f-b496-337e64ae46f3-kube-api-access-vt988\") pod \"volume-data-source-validator-86695b7cc7-ts2dr\" (UID: \"34efec45-a4c2-4a2f-b496-337e64ae46f3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr"
Sep 10 22:06:03.667024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/655ef482-45b1-4d0d-9912-25381723f2f5-trusted-ca\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.667024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:03.667024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.666799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmflz\" (UniqueName: \"kubernetes.io/projected/105f8943-255b-46e5-8c62-fcf108093fd6-kube-api-access-bmflz\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.667024 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:03.666880    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 22:06:03.667024 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:03.666949    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls podName:517b2cfa-087e-4345-a598-da3802941602 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:04.166934339 +0000 UTC m=+44.049418682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-g5zdk" (UID: "517b2cfa-087e-4345-a598-da3802941602") : secret "samples-operator-tls" not found
Sep 10 22:06:03.669541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.669524    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.672904 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.672828    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 22:06:03.672904 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.672827    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 22:06:03.673152 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.673134    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"]
Sep 10 22:06:03.673327 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.673315    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 22:06:03.673746 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.673728    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7vdxb\""
Sep 10 22:06:03.688361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.688315    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h69f\" (UniqueName: \"kubernetes.io/projected/517b2cfa-087e-4345-a598-da3802941602-kube-api-access-7h69f\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:03.690192 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.690176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt988\" (UniqueName: \"kubernetes.io/projected/34efec45-a4c2-4a2f-b496-337e64ae46f3-kube-api-access-vt988\") pod \"volume-data-source-validator-86695b7cc7-ts2dr\" (UID: \"34efec45-a4c2-4a2f-b496-337e64ae46f3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr"
Sep 10 22:06:03.691469 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.691451    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 22:06:03.718752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.718725    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:03.767942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.767916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-trusted-ca\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.768014 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.767949    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-installation-pull-secrets\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.768014 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.767970    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.768014 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.767988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-default-certificate\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.768108 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.768108 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768073    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/655ef482-45b1-4d0d-9912-25381723f2f5-trusted-ca\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.768108 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:03.768099    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:04.268080441 +0000 UTC m=+44.150564800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : configmap references non-existent config key: service-ca.crt
Sep 10 22:06:03.768216 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:03.768143    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:06:03.768259 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:03.768217    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:04.268203853 +0000 UTC m=+44.150688201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : secret "router-metrics-certs-default" not found
Sep 10 22:06:03.768259 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768138    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4x6\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-kube-api-access-5s4x6\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.768332 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmflz\" (UniqueName: \"kubernetes.io/projected/105f8943-255b-46e5-8c62-fcf108093fd6-kube-api-access-bmflz\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.768332 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768295    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.768332 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-certificates\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.768442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-bound-sa-token\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.768442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768369    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655ef482-45b1-4d0d-9912-25381723f2f5-config\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.768442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768395    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655ef482-45b1-4d0d-9912-25381723f2f5-serving-cert\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.768442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768423    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-stats-auth\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.768627 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583fc1-12f7-43a9-8461-b39135514e3e-ca-trust-extracted\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.768627 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3dad17d-e969-4018-a4e2-972bb16cd582-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8c78r\" (UID: \"b3dad17d-e969-4018-a4e2-972bb16cd582\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.768627 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3dad17d-e969-4018-a4e2-972bb16cd582-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8c78r\" (UID: \"b3dad17d-e969-4018-a4e2-972bb16cd582\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.768627 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvzxk\" (UniqueName: \"kubernetes.io/projected/b3dad17d-e969-4018-a4e2-972bb16cd582-kube-api-access-nvzxk\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8c78r\" (UID: \"b3dad17d-e969-4018-a4e2-972bb16cd582\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.768822 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-image-registry-private-configuration\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.768913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcnnt\" (UniqueName: \"kubernetes.io/projected/655ef482-45b1-4d0d-9912-25381723f2f5-kube-api-access-zcnnt\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.769020 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.768999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/655ef482-45b1-4d0d-9912-25381723f2f5-trusted-ca\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.769100 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.769081    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/655ef482-45b1-4d0d-9912-25381723f2f5-config\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.770642 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.770622    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/655ef482-45b1-4d0d-9912-25381723f2f5-serving-cert\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.770959 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.770941    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-default-certificate\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.771022 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.770980    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-stats-auth\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.778006 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.777988    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3dad17d-e969-4018-a4e2-972bb16cd582-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8c78r\" (UID: \"b3dad17d-e969-4018-a4e2-972bb16cd582\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.779690 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.779666    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3dad17d-e969-4018-a4e2-972bb16cd582-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8c78r\" (UID: \"b3dad17d-e969-4018-a4e2-972bb16cd582\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.780521 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.780499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvzxk\" (UniqueName: \"kubernetes.io/projected/b3dad17d-e969-4018-a4e2-972bb16cd582-kube-api-access-nvzxk\") pod \"kube-storage-version-migrator-operator-6c8f84f897-8c78r\" (UID: \"b3dad17d-e969-4018-a4e2-972bb16cd582\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.780521 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.780515    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcnnt\" (UniqueName: \"kubernetes.io/projected/655ef482-45b1-4d0d-9912-25381723f2f5-kube-api-access-zcnnt\") pod \"console-operator-696884fb9c-dp2pn\" (UID: \"655ef482-45b1-4d0d-9912-25381723f2f5\") " pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.781240 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.781220    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmflz\" (UniqueName: \"kubernetes.io/projected/105f8943-255b-46e5-8c62-fcf108093fd6-kube-api-access-bmflz\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:03.791110 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.791090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:03.798952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.798937    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr"
Sep 10 22:06:03.822886 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.822869    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"
Sep 10 22:06:03.866166 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.865880    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:03.869600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.869568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4x6\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-kube-api-access-5s4x6\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.869689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.869630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.869689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.869659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-certificates\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.869689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.869681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-bound-sa-token\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.870494 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.869715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583fc1-12f7-43a9-8461-b39135514e3e-ca-trust-extracted\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.870494 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.869792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-image-registry-private-configuration\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.870494 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.869865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-trusted-ca\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.870494 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.869889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-installation-pull-secrets\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.870963 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:03.870512    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:06:03.870963 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:03.870552    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5cc65b5b-8sjsv: secret "image-registry-tls" not found
Sep 10 22:06:03.870963 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:03.870635    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls podName:d6583fc1-12f7-43a9-8461-b39135514e3e nodeName:}" failed. No retries permitted until 2026-09-10 22:06:04.370594274 +0000 UTC m=+44.253078617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls") pod "image-registry-7c5cc65b5b-8sjsv" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e") : secret "image-registry-tls" not found
Sep 10 22:06:03.871147 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.871123    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-certificates\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.872051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.871994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-trusted-ca\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.872327 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.872280    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583fc1-12f7-43a9-8461-b39135514e3e-ca-trust-extracted\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.873361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.873335    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-installation-pull-secrets\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.873965 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.873917    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-image-registry-private-configuration\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.879202 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.879182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4x6\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-kube-api-access-5s4x6\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:03.879315 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:03.879290    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-bound-sa-token\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:04.088347 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.088319    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr"]
Sep 10 22:06:04.091398 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:04.091371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34efec45_a4c2_4a2f_b496_337e64ae46f3.slice/crio-b8a4ff5893cc29bb2b8f1721b967b0f91364cac730ad4f469db2c69fe1bd6469 WatchSource:0}: Error finding container b8a4ff5893cc29bb2b8f1721b967b0f91364cac730ad4f469db2c69fe1bd6469: Status 404 returned error can't find the container with id b8a4ff5893cc29bb2b8f1721b967b0f91364cac730ad4f469db2c69fe1bd6469
Sep 10 22:06:04.112051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.112028    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r"]
Sep 10 22:06:04.114531 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:04.114510    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3dad17d_e969_4018_a4e2_972bb16cd582.slice/crio-857aabf97543cf7677c118fe9bf6370e5c264b4c15408ccfed5442d40d96af48 WatchSource:0}: Error finding container 857aabf97543cf7677c118fe9bf6370e5c264b4c15408ccfed5442d40d96af48: Status 404 returned error can't find the container with id 857aabf97543cf7677c118fe9bf6370e5c264b4c15408ccfed5442d40d96af48
Sep 10 22:06:04.156240 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.156212    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-dp2pn"]
Sep 10 22:06:04.159169 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:04.159147    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655ef482_45b1_4d0d_9912_25381723f2f5.slice/crio-f8845a07818ff8aa7bc64a6d802bcac362e34ac90dd66a576ffc903a3b883ee6 WatchSource:0}: Error finding container f8845a07818ff8aa7bc64a6d802bcac362e34ac90dd66a576ffc903a3b883ee6: Status 404 returned error can't find the container with id f8845a07818ff8aa7bc64a6d802bcac362e34ac90dd66a576ffc903a3b883ee6
Sep 10 22:06:04.172210 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.172188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:04.172353 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:04.172337    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 22:06:04.172425 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:04.172403    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls podName:517b2cfa-087e-4345-a598-da3802941602 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:05.172383445 +0000 UTC m=+45.054867812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-g5zdk" (UID: "517b2cfa-087e-4345-a598-da3802941602") : secret "samples-operator-tls" not found
Sep 10 22:06:04.272776 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.272745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:04.272956 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.272789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:04.272956 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:04.272943    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:05.27292538 +0000 UTC m=+45.155409729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : configmap references non-existent config key: service-ca.crt
Sep 10 22:06:04.273045 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:04.272964    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:06:04.273045 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:04.273024    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:05.273007806 +0000 UTC m=+45.155492158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : secret "router-metrics-certs-default" not found
Sep 10 22:06:04.373551 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.373477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:04.373670 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:04.373594    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:06:04.373670 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:04.373605    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5cc65b5b-8sjsv: secret "image-registry-tls" not found
Sep 10 22:06:04.373734 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:04.373672    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls podName:d6583fc1-12f7-43a9-8461-b39135514e3e nodeName:}" failed. No retries permitted until 2026-09-10 22:06:05.3736585 +0000 UTC m=+45.256142847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls") pod "image-registry-7c5cc65b5b-8sjsv" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e") : secret "image-registry-tls" not found
Sep 10 22:06:04.912042 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.912001    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r" event={"ID":"b3dad17d-e969-4018-a4e2-972bb16cd582","Type":"ContainerStarted","Data":"857aabf97543cf7677c118fe9bf6370e5c264b4c15408ccfed5442d40d96af48"}
Sep 10 22:06:04.913424 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.913391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr" event={"ID":"34efec45-a4c2-4a2f-b496-337e64ae46f3","Type":"ContainerStarted","Data":"b8a4ff5893cc29bb2b8f1721b967b0f91364cac730ad4f469db2c69fe1bd6469"}
Sep 10 22:06:04.914794 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:04.914762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn" event={"ID":"655ef482-45b1-4d0d-9912-25381723f2f5","Type":"ContainerStarted","Data":"f8845a07818ff8aa7bc64a6d802bcac362e34ac90dd66a576ffc903a3b883ee6"}
Sep 10 22:06:05.125227 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:05.125126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:05.179030 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:05.178918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:05.179198 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:05.179102    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 22:06:05.179198 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:05.179170    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls podName:517b2cfa-087e-4345-a598-da3802941602 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:07.179151729 +0000 UTC m=+47.061636081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-g5zdk" (UID: "517b2cfa-087e-4345-a598-da3802941602") : secret "samples-operator-tls" not found
Sep 10 22:06:05.226783 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:05.226744    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:05.280293 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:05.280094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:05.280293 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:05.280149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:05.280529 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:05.280320    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:06:05.280529 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:05.280382    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:07.280362978 +0000 UTC m=+47.162847346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : secret "router-metrics-certs-default" not found
Sep 10 22:06:05.280643 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:05.280602    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:07.280587948 +0000 UTC m=+47.163072296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : configmap references non-existent config key: service-ca.crt
Sep 10 22:06:05.380685 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:05.380643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:05.380897 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:05.380800    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:06:05.380897 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:05.380822    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5cc65b5b-8sjsv: secret "image-registry-tls" not found
Sep 10 22:06:05.380897 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:05.380892    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls podName:d6583fc1-12f7-43a9-8461-b39135514e3e nodeName:}" failed. No retries permitted until 2026-09-10 22:06:07.380877676 +0000 UTC m=+47.263362024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls") pod "image-registry-7c5cc65b5b-8sjsv" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e") : secret "image-registry-tls" not found
Sep 10 22:06:05.918973 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:05.918881    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr" event={"ID":"34efec45-a4c2-4a2f-b496-337e64ae46f3","Type":"ContainerStarted","Data":"0f2e7a4981d6a724b4653f1184827c899826ae8c76ad934d47756f32d1cf8aea"}
Sep 10 22:06:05.933540 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:05.933482    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ts2dr" podStartSLOduration=1.362469605 podStartE2EDuration="2.933463017s" totalImagesPullingTime="1.570993412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:05.93328272 +0000 UTC m=+45.815767086" watchObservedRunningTime="2026-09-10 22:06:05.933463017 +0000 UTC m=+45.815947383"
Sep 10 22:06:06.021753 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:06.021717    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:07.196532 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.196494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:07.196915 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:07.196630    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 22:06:07.196915 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:07.196695    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls podName:517b2cfa-087e-4345-a598-da3802941602 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:11.196680042 +0000 UTC m=+51.079164390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-g5zdk" (UID: "517b2cfa-087e-4345-a598-da3802941602") : secret "samples-operator-tls" not found
Sep 10 22:06:07.297347 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.297325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:07.297419 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.297357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:07.297494 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:07.297481    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:06:07.297529 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:07.297484    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:11.297467136 +0000 UTC m=+51.179951484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : configmap references non-existent config key: service-ca.crt
Sep 10 22:06:07.297569 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:07.297534    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:11.297520663 +0000 UTC m=+51.180005011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : secret "router-metrics-certs-default" not found
Sep 10 22:06:07.397720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.397693    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:07.397913 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:07.397891    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:06:07.397962 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:07.397918    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5cc65b5b-8sjsv: secret "image-registry-tls" not found
Sep 10 22:06:07.398013 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:07.398002    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls podName:d6583fc1-12f7-43a9-8461-b39135514e3e nodeName:}" failed. No retries permitted until 2026-09-10 22:06:11.397980656 +0000 UTC m=+51.280465003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls") pod "image-registry-7c5cc65b5b-8sjsv" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e") : secret "image-registry-tls" not found
Sep 10 22:06:07.925861 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.925815    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/0.log"
Sep 10 22:06:07.926044 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.925876    2573 generic.go:356] "Generic (PLEG): container finished" podID="655ef482-45b1-4d0d-9912-25381723f2f5" containerID="6c24ba8f0549bb2514a8381bd66e874ae62621b274434b22b1eabff577c767b9" exitCode=255
Sep 10 22:06:07.926044 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.925972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn" event={"ID":"655ef482-45b1-4d0d-9912-25381723f2f5","Type":"ContainerDied","Data":"6c24ba8f0549bb2514a8381bd66e874ae62621b274434b22b1eabff577c767b9"}
Sep 10 22:06:07.926186 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.926167    2573 scope.go:117] "RemoveContainer" containerID="6c24ba8f0549bb2514a8381bd66e874ae62621b274434b22b1eabff577c767b9"
Sep 10 22:06:07.927571 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.927550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r" event={"ID":"b3dad17d-e969-4018-a4e2-972bb16cd582","Type":"ContainerStarted","Data":"ec0d09ff77e0b1c2f9dc54c2c04ef2022e20832b3c4333c0cbf1d4da9aceca85"}
Sep 10 22:06:07.953912 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:07.953870    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r" podStartSLOduration=1.7466248530000001 podStartE2EDuration="4.953855381s" totalImagesPullingTime="3.207230528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:07.952952115 +0000 UTC m=+47.835436482" watchObservedRunningTime="2026-09-10 22:06:07.953855381 +0000 UTC m=+47.836339778"
Sep 10 22:06:08.931605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:08.931580    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:06:08.932045 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:08.932029    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/0.log"
Sep 10 22:06:08.932101 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:08.932065    2573 generic.go:356] "Generic (PLEG): container finished" podID="655ef482-45b1-4d0d-9912-25381723f2f5" containerID="1bfc2b25b02750c20112b006add182ae3845dfd6f4d1a133ad5339987d20a648" exitCode=255
Sep 10 22:06:08.932146 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:08.932091    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn" event={"ID":"655ef482-45b1-4d0d-9912-25381723f2f5","Type":"ContainerDied","Data":"1bfc2b25b02750c20112b006add182ae3845dfd6f4d1a133ad5339987d20a648"}
Sep 10 22:06:08.932146 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:08.932143    2573 scope.go:117] "RemoveContainer" containerID="6c24ba8f0549bb2514a8381bd66e874ae62621b274434b22b1eabff577c767b9"
Sep 10 22:06:08.932411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:08.932393    2573 scope.go:117] "RemoveContainer" containerID="1bfc2b25b02750c20112b006add182ae3845dfd6f4d1a133ad5339987d20a648"
Sep 10 22:06:08.932595 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:08.932576    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-dp2pn_openshift-console-operator(655ef482-45b1-4d0d-9912-25381723f2f5)\"" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn" podUID="655ef482-45b1-4d0d-9912-25381723f2f5"
Sep 10 22:06:09.573077 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:09.573046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:09.673076 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:09.673047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:09.936128 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:09.936046    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:06:09.936529 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:09.936400    2573 scope.go:117] "RemoveContainer" containerID="1bfc2b25b02750c20112b006add182ae3845dfd6f4d1a133ad5339987d20a648"
Sep 10 22:06:09.936609 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:09.936591    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-dp2pn_openshift-console-operator(655ef482-45b1-4d0d-9912-25381723f2f5)\"" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn" podUID="655ef482-45b1-4d0d-9912-25381723f2f5"
Sep 10 22:06:10.103569 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:10.103524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:10.173916 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:10.173885    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:10.570713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:10.570678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:10.629363 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:10.629330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:10.826973 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:10.826893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:06:10.827116 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:10.827040    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:06:10.827116 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:10.827112    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls podName:84494055-3279-435f-b7c7-e85cb4753c2f nodeName:}" failed. No retries permitted until 2026-09-10 22:06:26.827096681 +0000 UTC m=+66.709581025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls") pod "dns-default-64wxb" (UID: "84494055-3279-435f-b7c7-e85cb4753c2f") : secret "dns-default-metrics-tls" not found
Sep 10 22:06:11.230960 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.230928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:11.231320 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.231058    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 22:06:11.231320 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.231116    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls podName:517b2cfa-087e-4345-a598-da3802941602 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:19.231102838 +0000 UTC m=+59.113587187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-g5zdk" (UID: "517b2cfa-087e-4345-a598-da3802941602") : secret "samples-operator-tls" not found
Sep 10 22:06:11.331474 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.331439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:11.331638 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.331479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:11.331638 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.331588    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:06:11.331638 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.331639    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:19.331621211 +0000 UTC m=+59.214105572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : secret "router-metrics-certs-default" not found
Sep 10 22:06:11.331778 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.331656    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:19.331647142 +0000 UTC m=+59.214131487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : configmap references non-existent config key: service-ca.crt
Sep 10 22:06:11.432114 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.432075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:11.432271 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.432227    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:06:11.432271 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.432244    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5cc65b5b-8sjsv: secret "image-registry-tls" not found
Sep 10 22:06:11.432334 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.432298    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls podName:d6583fc1-12f7-43a9-8461-b39135514e3e nodeName:}" failed. No retries permitted until 2026-09-10 22:06:19.43228338 +0000 UTC m=+59.314767728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls") pod "image-registry-7c5cc65b5b-8sjsv" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e") : secret "image-registry-tls" not found
Sep 10 22:06:11.437374 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.437344    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-crgrg"]
Sep 10 22:06:11.448784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.448763    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.452031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.452006    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 22:06:11.452147 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.452040    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 22:06:11.452147 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.452062    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bjqmf\""
Sep 10 22:06:11.452262 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.452143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:11.452322 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.452021    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 22:06:11.452497 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.452480    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 22:06:11.453311 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.453290    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-crgrg"]
Sep 10 22:06:11.523241 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.523153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:11.634724 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.634697    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-crio-socket\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.634885 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.634731    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.634885 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.634750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7ndw\" (UniqueName: \"kubernetes.io/projected/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-api-access-l7ndw\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.634885 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.634859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-data-volume\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.635031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.634902    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.639817 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.639795    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:11.696055 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.696013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:11.736145 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.736122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-data-volume\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.736235 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.736152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.736235 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.736230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-crio-socket\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.736319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.736250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.736319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.736266    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7ndw\" (UniqueName: \"kubernetes.io/projected/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-api-access-l7ndw\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.736388 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.736319    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:06:11.736388 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.736383    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:12.236364097 +0000 UTC m=+52.118848448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : configmap "kube-rbac-proxy" not found
Sep 10 22:06:11.736474 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.736409    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:11.736474 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:11.736461    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:12.236445998 +0000 UTC m=+52.118930367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:11.736474 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.736465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-crio-socket\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.736622 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.736524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-data-volume\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:11.744573 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:11.744546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7ndw\" (UniqueName: \"kubernetes.io/projected/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-api-access-l7ndw\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:12.098426 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:12.098392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:12.198233 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:12.198208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:12.240358 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:12.240329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:12.240667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:12.240393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:12.240667 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:12.240463    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:12.240667 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:12.240511    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:06:12.240667 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:12.240518    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:13.240503686 +0000 UTC m=+53.122988029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:12.240667 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:12.240555    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:13.240542698 +0000 UTC m=+53.123027048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : configmap "kube-rbac-proxy" not found
Sep 10 22:06:12.361926 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:12.361813    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:12.456084 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:12.456048    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:13.249788 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:13.249745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:13.250196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:13.249874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:13.250196 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:13.249893    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:06:13.250196 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:13.249988    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:15.249971806 +0000 UTC m=+55.132456154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : configmap "kube-rbac-proxy" not found
Sep 10 22:06:13.250196 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:13.250032    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:13.250196 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:13.250102    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:15.250088678 +0000 UTC m=+55.132573023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:13.532202 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:13.532128    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:13.866578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:13.866487    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:13.866578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:13.866580    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:13.866986 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:13.866967    2573 scope.go:117] "RemoveContainer" containerID="1bfc2b25b02750c20112b006add182ae3845dfd6f4d1a133ad5339987d20a648"
Sep 10 22:06:13.867170 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:13.867149    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-dp2pn_openshift-console-operator(655ef482-45b1-4d0d-9912-25381723f2f5)\"" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn" podUID="655ef482-45b1-4d0d-9912-25381723f2f5"
Sep 10 22:06:13.983408 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:13.983372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:14.046940 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:14.046908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:14.196822 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:14.196752    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c47x8_4b00e522-ca7d-42f2-8ad1-cdc860c83856/dns-node-resolver/0.log"
Sep 10 22:06:14.930902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:14.930865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:15.265398 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:15.265368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:15.265555 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:15.265482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:15.265555 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:15.265508    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:06:15.265625 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:15.265576    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:19.265560182 +0000 UTC m=+59.148044532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : configmap "kube-rbac-proxy" not found
Sep 10 22:06:15.265625 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:15.265589    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:15.265693 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:15.265644    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:19.265629682 +0000 UTC m=+59.148114031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:15.395609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:15.395581    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zgbcm_401a84c5-0ae9-4eb7-80c1-f1b782c022ad/node-ca/0.log"
Sep 10 22:06:16.196103 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:16.196075    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xw587_365134e3-4e3d-47e5-b6f2-43cfa412d5b6/serve-healthcheck-canary/0.log"
Sep 10 22:06:16.796745 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:16.796720    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-8c78r_b3dad17d-e969-4018-a4e2-972bb16cd582/kube-storage-version-migrator-operator/0.log"
Sep 10 22:06:18.267979 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:18.267912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:18.494731 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:18.494699    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:18.594433 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:18.594356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:18.660990 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:18.660959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:18.835406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:18.835376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:18.931641 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:18.931562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:19.031832 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.031798    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:19.299164 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.299129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:19.299164 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.299166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:19.299574 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.299288    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:19.299574 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.299303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:19.299574 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.299361    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:27.299342148 +0000 UTC m=+67.181826516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:19.299574 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.299381    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:06:19.299574 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.299416    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:27.299405483 +0000 UTC m=+67.181889827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : configmap "kube-rbac-proxy" not found
Sep 10 22:06:19.301578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.301554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/517b2cfa-087e-4345-a598-da3802941602-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-g5zdk\" (UID: \"517b2cfa-087e-4345-a598-da3802941602\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:19.377810 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.377770    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"
Sep 10 22:06:19.400434 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.400406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:19.400559 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.400442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:19.400594 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.400581    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:35.40056198 +0000 UTC m=+75.283046329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : configmap references non-existent config key: service-ca.crt
Sep 10 22:06:19.400634 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.400599    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:06:19.400671 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.400654    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs podName:105f8943-255b-46e5-8c62-fcf108093fd6 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:35.400639434 +0000 UTC m=+75.283123777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs") pod "router-default-667fd765fd-m6pm2" (UID: "105f8943-255b-46e5-8c62-fcf108093fd6") : secret "router-metrics-certs-default" not found
Sep 10 22:06:19.501469 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.501434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:19.501608 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.501588    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:06:19.501649 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.501609    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5cc65b5b-8sjsv: secret "image-registry-tls" not found
Sep 10 22:06:19.501683 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:19.501663    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls podName:d6583fc1-12f7-43a9-8461-b39135514e3e nodeName:}" failed. No retries permitted until 2026-09-10 22:06:35.501647399 +0000 UTC m=+75.384131746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls") pod "image-registry-7c5cc65b5b-8sjsv" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e") : secret "image-registry-tls" not found
Sep 10 22:06:19.671063 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.670989    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk"]
Sep 10 22:06:19.760510 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.760478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:19.962260 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:19.962176    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk" event={"ID":"517b2cfa-087e-4345-a598-da3802941602","Type":"ContainerStarted","Data":"1fc273686f4d480e6daa69038a7bb7972c36fe72e0a960c2873d860bd21ce00d"}
Sep 10 22:06:20.371383 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:20.371329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:20.570713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:20.570682    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:20.870928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:20.870898    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g94rr"
Sep 10 22:06:20.971002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:20.970975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:21.165630 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:21.165539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:21.573507 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:21.573470    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:21.960950 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:21.960917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:21.971622 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:21.971594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk" event={"ID":"517b2cfa-087e-4345-a598-da3802941602","Type":"ContainerStarted","Data":"ba5b7b696a93c5d89e5096d47df8a7806deedd1ca8ecb21988585e431cc572b5"}
Sep 10 22:06:21.971755 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:21.971669    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk" event={"ID":"517b2cfa-087e-4345-a598-da3802941602","Type":"ContainerStarted","Data":"4b17a7f7a6ce10b0ca8c8dac1c366a98f3a9fe1216ef2b06e1d839ef62033f1d"}
Sep 10 22:06:21.988887 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:21.988826    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-g5zdk" podStartSLOduration=17.288009841 podStartE2EDuration="18.98881002s" totalImagesPullingTime="1.700800179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:21.987916587 +0000 UTC m=+61.870400954" watchObservedRunningTime="2026-09-10 22:06:21.98881002 +0000 UTC m=+61.871294407"
Sep 10 22:06:22.163447 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:22.163416    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:22.216238 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:22.216176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:22.660760 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:22.660718    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:22.763516 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:22.763466    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:22.818195 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:22.818144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:22.969123 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:22.969029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:23.164560 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:23.164513    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:23.366911 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:23.366880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:24.379893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:24.379861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:24.571139 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:24.571100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:24.641412 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:24.641320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:24.768870 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:24.768823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:24.968885 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:24.968752    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:26.069033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.068993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:26.170171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.170145    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:26.354547 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.354446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:06:26.354547 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.354502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:06:26.356914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.356896    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:06:26.356974 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.356898    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:06:26.367833 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.367808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64bee373-8991-49bb-b2a6-a5dde5eac0f7-metrics-certs\") pod \"network-metrics-daemon-s2rmw\" (UID: \"64bee373-8991-49bb-b2a6-a5dde5eac0f7\") " pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:06:26.367957 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.367810    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16f500b5-5bb9-4835-aca8-27d68fbe830c-original-pull-secret\") pod \"global-pull-secret-syncer-svkw5\" (UID: \"16f500b5-5bb9-4835-aca8-27d68fbe830c\") " pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:06:26.369600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.369578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:26.455772 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.455721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:06:26.458265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.458242    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:06:26.463243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.463226    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8m774\""
Sep 10 22:06:26.468933 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.468917    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:06:26.471553 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.471541    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2rmw"
Sep 10 22:06:26.472711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.472695    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svkw5"
Sep 10 22:06:26.479389 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.479369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qrmn\" (UniqueName: \"kubernetes.io/projected/aaede5a8-c1da-4f53-bebb-173bd3b9770b-kube-api-access-4qrmn\") pod \"network-check-target-8m9nm\" (UID: \"aaede5a8-c1da-4f53-bebb-173bd3b9770b\") " pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:06:26.575672 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.575643    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:26.747766 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.747743    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s2rmw"]
Sep 10 22:06:26.750601 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:26.750575    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bee373_8991_49bb_b2a6_a5dde5eac0f7.slice/crio-b85ccf26126d928b78a5a0cd5b5b4aac59957a0b81cdd281e705bde276083b8b WatchSource:0}: Error finding container b85ccf26126d928b78a5a0cd5b5b4aac59957a0b81cdd281e705bde276083b8b: Status 404 returned error can't find the container with id b85ccf26126d928b78a5a0cd5b5b4aac59957a0b81cdd281e705bde276083b8b
Sep 10 22:06:26.750902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.750885    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-svkw5"]
Sep 10 22:06:26.753619 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:26.753597    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f500b5_5bb9_4835_aca8_27d68fbe830c.slice/crio-92e0c87e6a3d7063c99359542e0780f5cdd0367f1cadcc8e18f2f6f329e5dc80 WatchSource:0}: Error finding container 92e0c87e6a3d7063c99359542e0780f5cdd0367f1cadcc8e18f2f6f329e5dc80: Status 404 returned error can't find the container with id 92e0c87e6a3d7063c99359542e0780f5cdd0367f1cadcc8e18f2f6f329e5dc80
Sep 10 22:06:26.772944 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.772911    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:26.779855 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.779821    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dmqhm\""
Sep 10 22:06:26.788520 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.788497    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:06:26.860959 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.860925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:06:26.862969 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.862952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/84494055-3279-435f-b7c7-e85cb4753c2f-metrics-tls\") pod \"dns-default-64wxb\" (UID: \"84494055-3279-435f-b7c7-e85cb4753c2f\") " pod="openshift-dns/dns-default-64wxb"
Sep 10 22:06:26.970997 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.970964    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:26.990874 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.990830    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s2rmw" event={"ID":"64bee373-8991-49bb-b2a6-a5dde5eac0f7","Type":"ContainerStarted","Data":"b85ccf26126d928b78a5a0cd5b5b4aac59957a0b81cdd281e705bde276083b8b"}
Sep 10 22:06:26.991898 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:26.991874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-svkw5" event={"ID":"16f500b5-5bb9-4835-aca8-27d68fbe830c","Type":"ContainerStarted","Data":"92e0c87e6a3d7063c99359542e0780f5cdd0367f1cadcc8e18f2f6f329e5dc80"}
Sep 10 22:06:27.056588 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.056533    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8m9nm"]
Sep 10 22:06:27.059880 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:27.059858    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaede5a8_c1da_4f53_bebb_173bd3b9770b.slice/crio-58290caaba5b5014729fdc5fec15a744d3996c943685388e58364b0d0d6cc5e8 WatchSource:0}: Error finding container 58290caaba5b5014729fdc5fec15a744d3996c943685388e58364b0d0d6cc5e8: Status 404 returned error can't find the container with id 58290caaba5b5014729fdc5fec15a744d3996c943685388e58364b0d0d6cc5e8
Sep 10 22:06:27.127305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.127279    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mb5j2\""
Sep 10 22:06:27.136017 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.135993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64wxb"
Sep 10 22:06:27.364997 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.364914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:27.365162 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.365016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:27.365162 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:27.365134    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:27.365311 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:27.365208    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls podName:3b26f5bb-0f72-47e9-88a4-6ed90846e8d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:43.365188976 +0000 UTC m=+83.247673337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-crgrg" (UID: "3b26f5bb-0f72-47e9-88a4-6ed90846e8d8") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:06:27.365756 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.365726    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:27.409866 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.409820    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64wxb"]
Sep 10 22:06:27.412971 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:27.412940    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84494055_3279_435f_b7c7_e85cb4753c2f.slice/crio-1c1a7bcb7ae43b52b5e56cccc62b271722b57761eac5ff2384b056da8f1ff630 WatchSource:0}: Error finding container 1c1a7bcb7ae43b52b5e56cccc62b271722b57761eac5ff2384b056da8f1ff630: Status 404 returned error can't find the container with id 1c1a7bcb7ae43b52b5e56cccc62b271722b57761eac5ff2384b056da8f1ff630
Sep 10 22:06:27.965012 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.964955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:27.996900 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.996864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8m9nm" event={"ID":"aaede5a8-c1da-4f53-bebb-173bd3b9770b","Type":"ContainerStarted","Data":"58290caaba5b5014729fdc5fec15a744d3996c943685388e58364b0d0d6cc5e8"}
Sep 10 22:06:28.002953 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:27.998424    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64wxb" event={"ID":"84494055-3279-435f-b7c7-e85cb4753c2f","Type":"ContainerStarted","Data":"1c1a7bcb7ae43b52b5e56cccc62b271722b57761eac5ff2384b056da8f1ff630"}
Sep 10 22:06:28.162590 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:28.162541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:28.548158 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:28.548126    2573 scope.go:117] "RemoveContainer" containerID="1bfc2b25b02750c20112b006add182ae3845dfd6f4d1a133ad5339987d20a648"
Sep 10 22:06:28.565510 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:28.565479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:28.760590 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:28.760521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:28.964537 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:28.964437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:29.004919 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:29.004850    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s2rmw" event={"ID":"64bee373-8991-49bb-b2a6-a5dde5eac0f7","Type":"ContainerStarted","Data":"2eead344924c17de98b6b3ab9aa86a9cf62c79ba7b90078a80d9ef2e9943beb5"}
Sep 10 22:06:29.004919 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:29.004910    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s2rmw" event={"ID":"64bee373-8991-49bb-b2a6-a5dde5eac0f7","Type":"ContainerStarted","Data":"a850a84e9084146aeeecde5465242fff585be86bd56aaa2adf8f77511f0702ff"}
Sep 10 22:06:29.009902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:29.009879    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:06:29.010044 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:29.009926    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn" event={"ID":"655ef482-45b1-4d0d-9912-25381723f2f5","Type":"ContainerStarted","Data":"d072dd0a813db6464383a4855dd0e402f0b16b69dd6808cdf66cfdff2b74c952"}
Sep 10 22:06:29.010877 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:29.010792    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:29.020377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:29.020235    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s2rmw" podStartSLOduration=66.790343653 podStartE2EDuration="1m8.020217625s" totalImagesPullingTime="1.229873972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:29.019952847 +0000 UTC m=+68.902437215" watchObservedRunningTime="2026-09-10 22:06:29.020217625 +0000 UTC m=+68.902702006"
Sep 10 22:06:29.036275 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:29.036227    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn" podStartSLOduration=22.879262498 podStartE2EDuration="26.03620858s" totalImagesPullingTime="3.156946082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:29.035363055 +0000 UTC m=+68.917847434" watchObservedRunningTime="2026-09-10 22:06:29.03620858 +0000 UTC m=+68.918692947"
Sep 10 22:06:29.855481 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:29.855447    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-dp2pn"
Sep 10 22:06:30.045606 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:30.045570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:30.147190 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:30.147099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:30.247457 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:30.247415    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:30.353930 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:30.353895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:30.713610 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:30.713578    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:30.773642 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:30.773613    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:31.528214 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:31.528140    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:31.593487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:31.593447    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:31.921389 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:31.921309    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:32.307110 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:32.307083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:32.406553 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:32.406523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:32.512752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:32.512724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:33.027020 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:33.026986    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-svkw5" event={"ID":"16f500b5-5bb9-4835-aca8-27d68fbe830c","Type":"ContainerStarted","Data":"3b5703fd9e32ae35c031ed4c49613b5757f278fa1a6fcd3cb632fce827f523cd"}
Sep 10 22:06:33.028713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:33.028689    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8m9nm" event={"ID":"aaede5a8-c1da-4f53-bebb-173bd3b9770b","Type":"ContainerStarted","Data":"b1d4449f4a08dd1d7f68bfe8de9137ef8a1b3429d35230e7f6bf7266280bf6d5"}
Sep 10 22:06:33.028805 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:33.028734    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:06:33.030667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:33.030643    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64wxb" event={"ID":"84494055-3279-435f-b7c7-e85cb4753c2f","Type":"ContainerStarted","Data":"ef8c1d0521f47cb531060670a0c42e09377782b62b054dc915abab9db001aa77"}
Sep 10 22:06:33.030755 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:33.030699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64wxb" event={"ID":"84494055-3279-435f-b7c7-e85cb4753c2f","Type":"ContainerStarted","Data":"118c12d3ba4bef0b143e2936df5c11b0ecae6513c6ebc418ad5c5a97aef84daf"}
Sep 10 22:06:33.030814 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:33.030802    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-64wxb"
Sep 10 22:06:33.041791 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:33.041741    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-svkw5" podStartSLOduration=66.325160894 podStartE2EDuration="1m12.041725602s" totalImagesPullingTime="5.716564708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:33.041109815 +0000 UTC m=+72.923594172" watchObservedRunningTime="2026-09-10 22:06:33.041725602 +0000 UTC m=+72.924209961"
Sep 10 22:06:33.055612 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:33.055563    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8m9nm" podStartSLOduration=66.635684063 podStartE2EDuration="1m12.055550092s" totalImagesPullingTime="5.419866029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:33.053945204 +0000 UTC m=+72.936429568" watchObservedRunningTime="2026-09-10 22:06:33.055550092 +0000 UTC m=+72.938034452"
Sep 10 22:06:33.071976 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:33.069260    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-64wxb" podStartSLOduration=34.031246411 podStartE2EDuration="39.069191314s" totalImagesPullingTime="5.037944903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:33.067860746 +0000 UTC m=+72.950345110" watchObservedRunningTime="2026-09-10 22:06:33.069191314 +0000 UTC m=+72.951675689"
Sep 10 22:06:35.444795 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.444759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:35.444795 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.444802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:35.445441 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.445418    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105f8943-255b-46e5-8c62-fcf108093fd6-service-ca-bundle\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:35.447068 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.447049    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/105f8943-255b-46e5-8c62-fcf108093fd6-metrics-certs\") pod \"router-default-667fd765fd-m6pm2\" (UID: \"105f8943-255b-46e5-8c62-fcf108093fd6\") " pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:35.545192 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.545161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:35.547520 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.547501    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"image-registry-7c5cc65b5b-8sjsv\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") " pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:35.646743 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.646713    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m7src\""
Sep 10 22:06:35.654884 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.654864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:35.781048 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.781025    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7vdxb\""
Sep 10 22:06:35.788715 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.788701    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:35.928758 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:35.928727    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-667fd765fd-m6pm2"]
Sep 10 22:06:35.931417 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:35.931390    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105f8943_255b_46e5_8c62_fcf108093fd6.slice/crio-39f977d39dcdd2a7dd0f1d6d115d34e0be116d3fc4c78d8fed61bc0002fe2a69 WatchSource:0}: Error finding container 39f977d39dcdd2a7dd0f1d6d115d34e0be116d3fc4c78d8fed61bc0002fe2a69: Status 404 returned error can't find the container with id 39f977d39dcdd2a7dd0f1d6d115d34e0be116d3fc4c78d8fed61bc0002fe2a69
Sep 10 22:06:36.041910 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:36.041828    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-667fd765fd-m6pm2" event={"ID":"105f8943-255b-46e5-8c62-fcf108093fd6","Type":"ContainerStarted","Data":"d18379e82925d26107f2e86304ea77607ee520b5a2c88d821fd320aaeaa603d0"}
Sep 10 22:06:36.041910 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:36.041902    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-667fd765fd-m6pm2" event={"ID":"105f8943-255b-46e5-8c62-fcf108093fd6","Type":"ContainerStarted","Data":"39f977d39dcdd2a7dd0f1d6d115d34e0be116d3fc4c78d8fed61bc0002fe2a69"}
Sep 10 22:06:36.056184 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:36.056160    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"]
Sep 10 22:06:36.058396 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:36.058347    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-667fd765fd-m6pm2" podStartSLOduration=33.058327463 podStartE2EDuration="33.058327463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:36.057967426 +0000 UTC m=+75.940451792" watchObservedRunningTime="2026-09-10 22:06:36.058327463 +0000 UTC m=+75.940811827"
Sep 10 22:06:36.059820 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:36.059798    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6583fc1_12f7_43a9_8461_b39135514e3e.slice/crio-96270f2bcf4ebe2e634e9113cff77d384289d504861ce04c31485e7d7512eb82 WatchSource:0}: Error finding container 96270f2bcf4ebe2e634e9113cff77d384289d504861ce04c31485e7d7512eb82: Status 404 returned error can't find the container with id 96270f2bcf4ebe2e634e9113cff77d384289d504861ce04c31485e7d7512eb82
Sep 10 22:06:36.655549 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:36.655515    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:36.658078 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:36.658054    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:36.908763 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:36.908684    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"]
Sep 10 22:06:36.995208 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:36.995171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:37.011028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.010996    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d88f9f94c-bcq7n"]
Sep 10 22:06:37.014087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.014069    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.031178 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.031142    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d88f9f94c-bcq7n"]
Sep 10 22:06:37.046652 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.046622    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv" event={"ID":"d6583fc1-12f7-43a9-8461-b39135514e3e","Type":"ContainerStarted","Data":"ca4cf0282ca325521e3778210f192651a616e3637057556608167c23ae97b207"}
Sep 10 22:06:37.046781 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.046674    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv" event={"ID":"d6583fc1-12f7-43a9-8461-b39135514e3e","Type":"ContainerStarted","Data":"96270f2bcf4ebe2e634e9113cff77d384289d504861ce04c31485e7d7512eb82"}
Sep 10 22:06:37.046865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.046787    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:37.046865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.046835    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:37.047938 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.047919    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-667fd765fd-m6pm2"
Sep 10 22:06:37.094893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.094865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:37.158639 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.158613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/329b699d-4974-4555-995a-a28f6547dfa1-image-registry-private-configuration\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.158868 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.158670    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/329b699d-4974-4555-995a-a28f6547dfa1-bound-sa-token\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.158868 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.158802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/329b699d-4974-4555-995a-a28f6547dfa1-registry-tls\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.158985 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.158865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/329b699d-4974-4555-995a-a28f6547dfa1-trusted-ca\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.159069 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.159011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/329b699d-4974-4555-995a-a28f6547dfa1-installation-pull-secrets\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.159069 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.159055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/329b699d-4974-4555-995a-a28f6547dfa1-ca-trust-extracted\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.159427 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.159401    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/329b699d-4974-4555-995a-a28f6547dfa1-registry-certificates\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.159558 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.159497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps6kw\" (UniqueName: \"kubernetes.io/projected/329b699d-4974-4555-995a-a28f6547dfa1-kube-api-access-ps6kw\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.199996 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.199965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:37.260307 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.260278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/329b699d-4974-4555-995a-a28f6547dfa1-registry-certificates\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.260413 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.260321    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6kw\" (UniqueName: \"kubernetes.io/projected/329b699d-4974-4555-995a-a28f6547dfa1-kube-api-access-ps6kw\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.260413 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.260361    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/329b699d-4974-4555-995a-a28f6547dfa1-image-registry-private-configuration\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.260413 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.260402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/329b699d-4974-4555-995a-a28f6547dfa1-bound-sa-token\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.260572 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.260533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/329b699d-4974-4555-995a-a28f6547dfa1-registry-tls\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.260610 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.260575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/329b699d-4974-4555-995a-a28f6547dfa1-trusted-ca\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.260657 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.260610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/329b699d-4974-4555-995a-a28f6547dfa1-installation-pull-secrets\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.260657 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.260644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/329b699d-4974-4555-995a-a28f6547dfa1-ca-trust-extracted\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.261043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.261016    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/329b699d-4974-4555-995a-a28f6547dfa1-ca-trust-extracted\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.261196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.261172    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/329b699d-4974-4555-995a-a28f6547dfa1-registry-certificates\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.261555 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.261531    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/329b699d-4974-4555-995a-a28f6547dfa1-trusted-ca\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.262939 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.262909    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/329b699d-4974-4555-995a-a28f6547dfa1-installation-pull-secrets\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.263039 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.262998    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/329b699d-4974-4555-995a-a28f6547dfa1-registry-tls\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.263039 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.263002    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/329b699d-4974-4555-995a-a28f6547dfa1-image-registry-private-configuration\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.270687 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.270660    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps6kw\" (UniqueName: \"kubernetes.io/projected/329b699d-4974-4555-995a-a28f6547dfa1-kube-api-access-ps6kw\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.271432 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.271405    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/329b699d-4974-4555-995a-a28f6547dfa1-bound-sa-token\") pod \"image-registry-d88f9f94c-bcq7n\" (UID: \"329b699d-4974-4555-995a-a28f6547dfa1\") " pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.299680 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.299653    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:37.322908 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.322888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:37.589423 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.589337    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv" podStartSLOduration=34.589314253 podStartE2EDuration="34.589314253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:37.120606785 +0000 UTC m=+77.003091163" watchObservedRunningTime="2026-09-10 22:06:37.589314253 +0000 UTC m=+77.471798644"
Sep 10 22:06:37.590590 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:37.590568    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d88f9f94c-bcq7n"]
Sep 10 22:06:37.593408 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:37.593379    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329b699d_4974_4555_995a_a28f6547dfa1.slice/crio-88029621133e94298baa14ca3d0e7dc7bed14b8a64c8dd212e2c7dcd512eb1f6 WatchSource:0}: Error finding container 88029621133e94298baa14ca3d0e7dc7bed14b8a64c8dd212e2c7dcd512eb1f6: Status 404 returned error can't find the container with id 88029621133e94298baa14ca3d0e7dc7bed14b8a64c8dd212e2c7dcd512eb1f6
Sep 10 22:06:38.053589 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.053543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n" event={"ID":"329b699d-4974-4555-995a-a28f6547dfa1","Type":"ContainerStarted","Data":"e93a816cbfcc6e0ffe27e834ada15304b7b902b4e5b7b633dd5d56f7d883409a"}
Sep 10 22:06:38.054043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.053606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n" event={"ID":"329b699d-4974-4555-995a-a28f6547dfa1","Type":"ContainerStarted","Data":"88029621133e94298baa14ca3d0e7dc7bed14b8a64c8dd212e2c7dcd512eb1f6"}
Sep 10 22:06:38.054043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.053872    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:38.071889 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.071832    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n" podStartSLOduration=2.071818089 podStartE2EDuration="2.071818089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:38.070834029 +0000 UTC m=+77.953318395" watchObservedRunningTime="2026-09-10 22:06:38.071818089 +0000 UTC m=+77.954302454"
Sep 10 22:06:38.231186 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.231144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:38.330931 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.330863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:38.402959 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.402930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:38.544262 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.544227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:38.606599 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.606524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:38.703309 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.703277    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:38.803474 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:38.803446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:39.705625 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:39.705592    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:40.113831 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:40.113796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:40.190955 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:40.190924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:43.035428 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:43.035318    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-64wxb"
Sep 10 22:06:43.410209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:43.410093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:43.412448 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:43.412423    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b26f5bb-0f72-47e9-88a4-6ed90846e8d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-crgrg\" (UID: \"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8\") " pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:43.560553 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:43.560523    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bjqmf\""
Sep 10 22:06:43.568710 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:43.568675    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-crgrg"
Sep 10 22:06:43.740633 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:43.740600    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:43.799548 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:43.799492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:43.837662 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:43.837634    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-crgrg"]
Sep 10 22:06:43.840883 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:43.840858    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b26f5bb_0f72_47e9_88a4_6ed90846e8d8.slice/crio-ecaeda6b6e57586286293d4e833df78612f897944f3e3dc260aaa048acf5b45e WatchSource:0}: Error finding container ecaeda6b6e57586286293d4e833df78612f897944f3e3dc260aaa048acf5b45e: Status 404 returned error can't find the container with id ecaeda6b6e57586286293d4e833df78612f897944f3e3dc260aaa048acf5b45e
Sep 10 22:06:44.076670 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:44.076585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-crgrg" event={"ID":"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8","Type":"ContainerStarted","Data":"44cd103bc7a3841158eb9d78faa6c631423a3fcbf684b3880339673ba92f7c08"}
Sep 10 22:06:44.076670 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:44.076644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-crgrg" event={"ID":"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8","Type":"ContainerStarted","Data":"ecaeda6b6e57586286293d4e833df78612f897944f3e3dc260aaa048acf5b45e"}
Sep 10 22:06:45.081522 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.081485    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-crgrg" event={"ID":"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8","Type":"ContainerStarted","Data":"8d3f4618964ff0c6e19da946597db1bda01a78687d95a86a1bedd6cd1473044e"}
Sep 10 22:06:45.985636 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.985601    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cf546ffbb-42cwq"]
Sep 10 22:06:45.989109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.989087    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:45.991879 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.991825    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 22:06:45.992257 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.992232    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6f7mc\""
Sep 10 22:06:45.992257 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.992250    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 22:06:45.992395 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.992353    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 22:06:45.992629 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.992541    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 22:06:45.992863 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.992824    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 22:06:45.992970 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.992954    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 22:06:45.993865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:45.993830    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 22:06:46.001630 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.001609    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 22:06:46.005912 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.005891    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf546ffbb-42cwq"]
Sep 10 22:06:46.127403 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.127371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-oauth-serving-cert\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.127403 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.127409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-oauth-config\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.127927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.127488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-config\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.127927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.127544    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-service-ca\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.127927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.127571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-serving-cert\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.127927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.127594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwlf4\" (UniqueName: \"kubernetes.io/projected/f0acb9a8-f221-42fe-bfbf-2c05825f0042-kube-api-access-rwlf4\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.127927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.127617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-trusted-ca-bundle\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.228746 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.228721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-config\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.228860 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.228750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-service-ca\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.228860 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.228770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-serving-cert\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.228860 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.228790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwlf4\" (UniqueName: \"kubernetes.io/projected/f0acb9a8-f221-42fe-bfbf-2c05825f0042-kube-api-access-rwlf4\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.228860 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.228822    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-trusted-ca-bundle\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.229058 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.228873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-oauth-serving-cert\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.229058 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.228912    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-oauth-config\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.229558 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.229527    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-config\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.229652 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.229621    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-service-ca\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.229711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.229649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-oauth-serving-cert\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.229711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.229657    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-trusted-ca-bundle\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.231180 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.231156    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-serving-cert\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.231260 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.231167    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-oauth-config\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.237969 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.237923    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwlf4\" (UniqueName: \"kubernetes.io/projected/f0acb9a8-f221-42fe-bfbf-2c05825f0042-kube-api-access-rwlf4\") pod \"console-6cf546ffbb-42cwq\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") " pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.299852 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.299818    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:46.439524 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.439489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:46.484349 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.484322    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"]
Sep 10 22:06:46.487670 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.487653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.490152 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.490086    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 22:06:46.490753 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.490737    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 22:06:46.490863 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.490761    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 22:06:46.490863 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.490761    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gchmm\""
Sep 10 22:06:46.490863 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.490768    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 22:06:46.491009 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.490798    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 22:06:46.498974 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.498953    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"]
Sep 10 22:06:46.522093 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.522075    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:46.574417 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.574397    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf546ffbb-42cwq"]
Sep 10 22:06:46.576718 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:46.576694    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0acb9a8_f221_42fe_bfbf_2c05825f0042.slice/crio-7c852732c00d9d77612a53d3e6d58bad3f6ab9937066c79ffba7aa0a90e51a37 WatchSource:0}: Error finding container 7c852732c00d9d77612a53d3e6d58bad3f6ab9937066c79ffba7aa0a90e51a37: Status 404 returned error can't find the container with id 7c852732c00d9d77612a53d3e6d58bad3f6ab9937066c79ffba7aa0a90e51a37
Sep 10 22:06:46.632565 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.632542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c184ce-0577-4bad-a662-624ce62bb9b3-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.632664 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.632572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82c184ce-0577-4bad-a662-624ce62bb9b3-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.632717 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.632702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4skz\" (UniqueName: \"kubernetes.io/projected/82c184ce-0577-4bad-a662-624ce62bb9b3-kube-api-access-v4skz\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.632790 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.632771    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82c184ce-0577-4bad-a662-624ce62bb9b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.734030 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.733993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c184ce-0577-4bad-a662-624ce62bb9b3-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.734030 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.734037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82c184ce-0577-4bad-a662-624ce62bb9b3-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.734196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.734073    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4skz\" (UniqueName: \"kubernetes.io/projected/82c184ce-0577-4bad-a662-624ce62bb9b3-kube-api-access-v4skz\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.734196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.734092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82c184ce-0577-4bad-a662-624ce62bb9b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.734264 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:46.734201    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 10 22:06:46.734300 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:06:46.734264    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c184ce-0577-4bad-a662-624ce62bb9b3-prometheus-operator-tls podName:82c184ce-0577-4bad-a662-624ce62bb9b3 nodeName:}" failed. No retries permitted until 2026-09-10 22:06:47.234246234 +0000 UTC m=+87.116730578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/82c184ce-0577-4bad-a662-624ce62bb9b3-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-8xrsp" (UID: "82c184ce-0577-4bad-a662-624ce62bb9b3") : secret "prometheus-operator-tls" not found
Sep 10 22:06:46.734801 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.734782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82c184ce-0577-4bad-a662-624ce62bb9b3-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.736433 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.736411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82c184ce-0577-4bad-a662-624ce62bb9b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.742914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.742863    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4skz\" (UniqueName: \"kubernetes.io/projected/82c184ce-0577-4bad-a662-624ce62bb9b3-kube-api-access-v4skz\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:46.799953 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:46.799906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:47.091971 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:47.091880    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-crgrg" event={"ID":"3b26f5bb-0f72-47e9-88a4-6ed90846e8d8","Type":"ContainerStarted","Data":"ee018589c35b321368fe25545ba2cc5e87aebe2d12ee4a029898ddd246910d36"}
Sep 10 22:06:47.093442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:47.093405    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf546ffbb-42cwq" event={"ID":"f0acb9a8-f221-42fe-bfbf-2c05825f0042","Type":"ContainerStarted","Data":"7c852732c00d9d77612a53d3e6d58bad3f6ab9937066c79ffba7aa0a90e51a37"}
Sep 10 22:06:47.117518 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:47.117466    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-crgrg" podStartSLOduration=33.930454151 podStartE2EDuration="36.117446415s" totalImagesPullingTime="2.186992264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:06:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:47.117184908 +0000 UTC m=+86.999669279" watchObservedRunningTime="2026-09-10 22:06:47.117446415 +0000 UTC m=+86.999930765"
Sep 10 22:06:47.237531 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:47.237497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c184ce-0577-4bad-a662-624ce62bb9b3-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:47.240185 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:47.240158    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82c184ce-0577-4bad-a662-624ce62bb9b3-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-8xrsp\" (UID: \"82c184ce-0577-4bad-a662-624ce62bb9b3\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:47.396519 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:47.396439    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"
Sep 10 22:06:47.564501 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:47.564467    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:47.685036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:47.684956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:47.695420 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:47.693422    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp"]
Sep 10 22:06:47.697187 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:47.697157    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c184ce_0577_4bad_a662_624ce62bb9b3.slice/crio-e67666d1ad54976e96bc4f01a7be190307a59fe84d4d13d82bb73077e02f2ffd WatchSource:0}: Error finding container e67666d1ad54976e96bc4f01a7be190307a59fe84d4d13d82bb73077e02f2ffd: Status 404 returned error can't find the container with id e67666d1ad54976e96bc4f01a7be190307a59fe84d4d13d82bb73077e02f2ffd
Sep 10 22:06:48.099097 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:48.099054    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp" event={"ID":"82c184ce-0577-4bad-a662-624ce62bb9b3","Type":"ContainerStarted","Data":"e67666d1ad54976e96bc4f01a7be190307a59fe84d4d13d82bb73077e02f2ffd"}
Sep 10 22:06:49.911003 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:49.910920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:50.108124 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:50.108085    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf546ffbb-42cwq" event={"ID":"f0acb9a8-f221-42fe-bfbf-2c05825f0042","Type":"ContainerStarted","Data":"f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241"}
Sep 10 22:06:50.109796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:50.109768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp" event={"ID":"82c184ce-0577-4bad-a662-624ce62bb9b3","Type":"ContainerStarted","Data":"bf3bb3d43bd4735b7f88aa649ff2acc6ab10c58861e3553dac0b2d0bdbf77a73"}
Sep 10 22:06:50.109931 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:50.109814    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp" event={"ID":"82c184ce-0577-4bad-a662-624ce62bb9b3","Type":"ContainerStarted","Data":"5bf03f198949a8beeab03352631a2d4bbf11044bfb2d6d37a4ac3853d4987e91"}
Sep 10 22:06:50.127570 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:50.127441    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cf546ffbb-42cwq" podStartSLOduration=2.084506314 podStartE2EDuration="5.127423837s" totalImagesPullingTime="3.042917523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:50.12607091 +0000 UTC m=+90.008555288" watchObservedRunningTime="2026-09-10 22:06:50.127423837 +0000 UTC m=+90.009908204"
Sep 10 22:06:50.142826 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:50.142784    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-8xrsp" podStartSLOduration=2.222399347 podStartE2EDuration="4.142770749s" totalImagesPullingTime="1.920371402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:50.142354663 +0000 UTC m=+90.024839041" watchObservedRunningTime="2026-09-10 22:06:50.142770749 +0000 UTC m=+90.025255151"
Sep 10 22:06:50.750609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:50.750542    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:50.811093 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:50.811059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:51.656772 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:51.656739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:52.005386 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.005347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:52.083294 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.083261    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"]
Sep 10 22:06:52.087720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.087704    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.091910 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.091888    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hph4l\""
Sep 10 22:06:52.092036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.091996    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 22:06:52.105136 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.105109    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 22:06:52.105931 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.105915    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"]
Sep 10 22:06:52.119880 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.119832    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"]
Sep 10 22:06:52.123026 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.123006    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.130504 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.130489    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 22:06:52.130636 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.130621    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b99b5\""
Sep 10 22:06:52.130805 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.130792    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 22:06:52.131089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.131076    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 22:06:52.142578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.142543    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"]
Sep 10 22:06:52.168270 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.168250    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dbnnr"]
Sep 10 22:06:52.171470 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.171447    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.175525 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.175507    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 22:06:52.175624 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.175527    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x7rt7\""
Sep 10 22:06:52.175624 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.175527    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 22:06:52.176011 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.175997    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 22:06:52.178910 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.178889    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jkc2\" (UniqueName: \"kubernetes.io/projected/16db36dc-8ad1-4a35-a222-503aab7c70fe-kube-api-access-9jkc2\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.179001 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.178940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16db36dc-8ad1-4a35-a222-503aab7c70fe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.179063 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.179017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16db36dc-8ad1-4a35-a222-503aab7c70fe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.179063 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.179047    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16db36dc-8ad1-4a35-a222-503aab7c70fe-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.189050 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.189025    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:52.279511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-tls\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.279511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b4162eb-a042-44d4-b112-7079a47e0197-metrics-client-ca\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.279511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.279700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jkc2\" (UniqueName: \"kubernetes.io/projected/16db36dc-8ad1-4a35-a222-503aab7c70fe-kube-api-access-9jkc2\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.279700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/50433e03-796a-4b4d-bfc0-a0efcbd83db3-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.279700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-textfile\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.279700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p89k6\" (UniqueName: \"kubernetes.io/projected/3b4162eb-a042-44d4-b112-7079a47e0197-kube-api-access-p89k6\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.279700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279619    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-wtmp\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.279700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279640    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.279980 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16db36dc-8ad1-4a35-a222-503aab7c70fe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.279980 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghcvx\" (UniqueName: \"kubernetes.io/projected/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-api-access-ghcvx\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.279980 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279929    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50433e03-796a-4b4d-bfc0-a0efcbd83db3-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.279980 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.279970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-accelerators-collector-config\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.280167 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.280012    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b4162eb-a042-44d4-b112-7079a47e0197-root\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.280167 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.280054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.280167 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.280079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b4162eb-a042-44d4-b112-7079a47e0197-sys\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.280167 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.280107    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.280167 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.280153    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16db36dc-8ad1-4a35-a222-503aab7c70fe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.280342 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.280179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16db36dc-8ad1-4a35-a222-503aab7c70fe-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.280794 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.280775    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16db36dc-8ad1-4a35-a222-503aab7c70fe-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.282077 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.282061    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16db36dc-8ad1-4a35-a222-503aab7c70fe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.282408 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.282391    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16db36dc-8ad1-4a35-a222-503aab7c70fe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.292947 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.292920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:52.294618 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.294602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jkc2\" (UniqueName: \"kubernetes.io/projected/16db36dc-8ad1-4a35-a222-503aab7c70fe-kube-api-access-9jkc2\") pod \"openshift-state-metrics-67dcf8c979-5fgpq\" (UID: \"16db36dc-8ad1-4a35-a222-503aab7c70fe\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.380816 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.380789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.380964 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.380820    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b4162eb-a042-44d4-b112-7079a47e0197-sys\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.380964 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.380858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.380964 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.380890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-tls\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.380964 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.380906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b4162eb-a042-44d4-b112-7079a47e0197-metrics-client-ca\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.380964 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.380920    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b4162eb-a042-44d4-b112-7079a47e0197-sys\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.380964 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.380928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.381277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.380998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/50433e03-796a-4b4d-bfc0-a0efcbd83db3-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.381277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-textfile\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.381277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381050    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p89k6\" (UniqueName: \"kubernetes.io/projected/3b4162eb-a042-44d4-b112-7079a47e0197-kube-api-access-p89k6\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.381277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-wtmp\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.381277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.381277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghcvx\" (UniqueName: \"kubernetes.io/projected/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-api-access-ghcvx\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.381277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381177    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50433e03-796a-4b4d-bfc0-a0efcbd83db3-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.381277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-accelerators-collector-config\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.381277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381259    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b4162eb-a042-44d4-b112-7079a47e0197-root\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.381708 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381366    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b4162eb-a042-44d4-b112-7079a47e0197-root\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.381708 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381401    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/50433e03-796a-4b4d-bfc0-a0efcbd83db3-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.381708 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381542    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b4162eb-a042-44d4-b112-7079a47e0197-metrics-client-ca\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.381708 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381550    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-textfile\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.381708 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.381690    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-wtmp\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.382285 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.382255    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-accelerators-collector-config\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.382379 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.382309    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50433e03-796a-4b4d-bfc0-a0efcbd83db3-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.382379 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.382315    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.383480 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.383452    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.383563 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.383533    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.383674 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.383652    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.383713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.383693    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b4162eb-a042-44d4-b112-7079a47e0197-node-exporter-tls\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.395918 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.395901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"
Sep 10 22:06:52.396416 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.396397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p89k6\" (UniqueName: \"kubernetes.io/projected/3b4162eb-a042-44d4-b112-7079a47e0197-kube-api-access-p89k6\") pod \"node-exporter-dbnnr\" (UID: \"3b4162eb-a042-44d4-b112-7079a47e0197\") " pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.398409 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.398389    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghcvx\" (UniqueName: \"kubernetes.io/projected/50433e03-796a-4b4d-bfc0-a0efcbd83db3-kube-api-access-ghcvx\") pod \"kube-state-metrics-59fbdd77d-vqpml\" (UID: \"50433e03-796a-4b4d-bfc0-a0efcbd83db3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.428861 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.428812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:52.431811 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.431703    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"
Sep 10 22:06:52.480642 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.480367    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dbnnr"
Sep 10 22:06:52.494953 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:52.494921    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4162eb_a042_44d4_b112_7079a47e0197.slice/crio-29d75c911856a276dc07252274bcaa92a3ef151485fe98fb15bd58e791b152ab WatchSource:0}: Error finding container 29d75c911856a276dc07252274bcaa92a3ef151485fe98fb15bd58e791b152ab: Status 404 returned error can't find the container with id 29d75c911856a276dc07252274bcaa92a3ef151485fe98fb15bd58e791b152ab
Sep 10 22:06:52.546170 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.546106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:52.672003 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.671883    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq"]
Sep 10 22:06:52.674541 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:52.674513    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16db36dc_8ad1_4a35_a222_503aab7c70fe.slice/crio-8912ccadaf2bbfbfc342d605733d2c51950ce367e524defa0ae5ce7f5e148fb1 WatchSource:0}: Error finding container 8912ccadaf2bbfbfc342d605733d2c51950ce367e524defa0ae5ce7f5e148fb1: Status 404 returned error can't find the container with id 8912ccadaf2bbfbfc342d605733d2c51950ce367e524defa0ae5ce7f5e148fb1
Sep 10 22:06:52.715304 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.715272    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml"]
Sep 10 22:06:52.715579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:52.715556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:52.718520 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:52.718490    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50433e03_796a_4b4d_bfc0_a0efcbd83db3.slice/crio-7bc47c8598e1b77bb5ba81dcaca63f9d0c7111e72b69973860bec03368409e22 WatchSource:0}: Error finding container 7bc47c8598e1b77bb5ba81dcaca63f9d0c7111e72b69973860bec03368409e22: Status 404 returned error can't find the container with id 7bc47c8598e1b77bb5ba81dcaca63f9d0c7111e72b69973860bec03368409e22
Sep 10 22:06:53.077173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.077139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:53.131513 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.131451    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbnnr" event={"ID":"3b4162eb-a042-44d4-b112-7079a47e0197","Type":"ContainerStarted","Data":"29d75c911856a276dc07252274bcaa92a3ef151485fe98fb15bd58e791b152ab"}
Sep 10 22:06:53.133499 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.133469    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml" event={"ID":"50433e03-796a-4b4d-bfc0-a0efcbd83db3","Type":"ContainerStarted","Data":"7bc47c8598e1b77bb5ba81dcaca63f9d0c7111e72b69973860bec03368409e22"}
Sep 10 22:06:53.136437 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.135861    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq" event={"ID":"16db36dc-8ad1-4a35-a222-503aab7c70fe","Type":"ContainerStarted","Data":"a3ee330b5b9dacaca33ad2c5ebf4070e4ed3391d7f2979584dbff8d0f18273cc"}
Sep 10 22:06:53.136437 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.135922    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq" event={"ID":"16db36dc-8ad1-4a35-a222-503aab7c70fe","Type":"ContainerStarted","Data":"8cfe7846127e16a786d9aa1e12bd3d18c3652a7d748807c853414d1e23553e9a"}
Sep 10 22:06:53.136437 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.135949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq" event={"ID":"16db36dc-8ad1-4a35-a222-503aab7c70fe","Type":"ContainerStarted","Data":"8912ccadaf2bbfbfc342d605733d2c51950ce367e524defa0ae5ce7f5e148fb1"}
Sep 10 22:06:53.185692 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.185650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:53.297038 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.296990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:53.478996 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.478962    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:53.583828 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:53.583799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:54.909374 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:54.909339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:55.006263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.006226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:55.109426 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.109391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:55.145772 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.145734    2573 generic.go:356] "Generic (PLEG): container finished" podID="3b4162eb-a042-44d4-b112-7079a47e0197" containerID="790e280a074887aaa6530bb54359c83e95f02a2c47c31a9c99387bbdf90adf61" exitCode=0
Sep 10 22:06:55.145964 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.145831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbnnr" event={"ID":"3b4162eb-a042-44d4-b112-7079a47e0197","Type":"ContainerDied","Data":"790e280a074887aaa6530bb54359c83e95f02a2c47c31a9c99387bbdf90adf61"}
Sep 10 22:06:55.148267 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.148243    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml" event={"ID":"50433e03-796a-4b4d-bfc0-a0efcbd83db3","Type":"ContainerStarted","Data":"b3828b1c01cbbdcfdc8d244f683a823535e97b451be92ec3fef34a6da5a80bab"}
Sep 10 22:06:55.148357 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.148290    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml" event={"ID":"50433e03-796a-4b4d-bfc0-a0efcbd83db3","Type":"ContainerStarted","Data":"581501229f3cee66525c49bed8ee4c463b27c2af8c7b682e5441ab646b540c1a"}
Sep 10 22:06:55.148357 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.148313    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml" event={"ID":"50433e03-796a-4b4d-bfc0-a0efcbd83db3","Type":"ContainerStarted","Data":"7f38176a44cc63ca5034826b282973f1d99c2efc737385efa0fdcc922f8d0a85"}
Sep 10 22:06:55.150345 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.150323    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq" event={"ID":"16db36dc-8ad1-4a35-a222-503aab7c70fe","Type":"ContainerStarted","Data":"8beed82ac44895951cbfae262d71286a7fa732a927141b87489288ad2056cb0e"}
Sep 10 22:06:55.186816 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.186767    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5fgpq" podStartSLOduration=1.7890207519999999 podStartE2EDuration="3.186750621s" totalImagesPullingTime="1.397729869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:55.184983548 +0000 UTC m=+95.067467915" watchObservedRunningTime="2026-09-10 22:06:55.186750621 +0000 UTC m=+95.069234987"
Sep 10 22:06:55.209374 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.209332    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vqpml" podStartSLOduration=1.69797895 podStartE2EDuration="3.209317875s" totalImagesPullingTime="1.511338925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:55.207949439 +0000 UTC m=+95.090433805" watchObservedRunningTime="2026-09-10 22:06:55.209317875 +0000 UTC m=+95.091802241"
Sep 10 22:06:55.414183 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:55.414153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:56.156027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:56.155983    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbnnr" event={"ID":"3b4162eb-a042-44d4-b112-7079a47e0197","Type":"ContainerStarted","Data":"c551adca678f0f1ffce56cec894c77d1efd03c143a0028b33eb4ff01e73769ae"}
Sep 10 22:06:56.156396 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:56.156048    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbnnr" event={"ID":"3b4162eb-a042-44d4-b112-7079a47e0197","Type":"ContainerStarted","Data":"a5114887d69fc79f8e41b8dd06400e3c431f1667d5fa3ed16be7c93b9ba13276"}
Sep 10 22:06:56.175548 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:56.175501    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dbnnr" podStartSLOduration=2.721083111 podStartE2EDuration="4.175485243s" totalImagesPullingTime="1.378537598s" totalInitContainerRuntime="75.864534ms" isStatefulPod=true podCreationTimestamp="2026-09-10 22:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:56.174530699 +0000 UTC m=+96.057015067" watchObservedRunningTime="2026-09-10 22:06:56.175485243 +0000 UTC m=+96.057969609"
Sep 10 22:06:56.300583 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:56.300539    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:56.300750 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:56.300608    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:56.305673 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:56.305648    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:56.678613 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:56.678573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:56.756944 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:56.756906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:56.916226 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:56.916189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:57.162913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:57.162885    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:06:57.991692 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:57.991655    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57cdcfd56-27v6n"]
Sep 10 22:06:57.996060 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:57.996035    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.007446 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.007420    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cdcfd56-27v6n"]
Sep 10 22:06:58.059649 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.059619    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:06:58.129654 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.129622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-trusted-ca-bundle\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.129823 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.129674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wssdm\" (UniqueName: \"kubernetes.io/projected/53b32f02-5c79-4181-8a48-7e36c00361d8-kube-api-access-wssdm\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.129823 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.129730    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-oauth-config\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.129823 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.129757    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-oauth-serving-cert\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.130028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.129892    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-console-config\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.130028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.129923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-serving-cert\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.130028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.130016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-service-ca\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.190802 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.190754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:58.230823 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.230789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-service-ca\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.231028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.230830    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-trusted-ca-bundle\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.231028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.230901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wssdm\" (UniqueName: \"kubernetes.io/projected/53b32f02-5c79-4181-8a48-7e36c00361d8-kube-api-access-wssdm\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.231028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.230924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-oauth-config\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.231028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.230945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-oauth-serving-cert\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.231028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.230988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-console-config\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.231028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.231014    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-serving-cert\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.231686 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.231657    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-service-ca\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.231802 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.231657    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-console-config\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.231802 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.231711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-oauth-serving-cert\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.232103 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.232078    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-trusted-ca-bundle\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.233756 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.233671    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-oauth-config\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.234276 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.234253    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-serving-cert\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.240939 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.240917    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wssdm\" (UniqueName: \"kubernetes.io/projected/53b32f02-5c79-4181-8a48-7e36c00361d8-kube-api-access-wssdm\") pod \"console-57cdcfd56-27v6n\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") " pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.306280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.306205    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:06:58.586239 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:58.585834    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cdcfd56-27v6n"]
Sep 10 22:06:58.589259 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:06:58.589217    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b32f02_5c79_4181_8a48_7e36c00361d8.slice/crio-61f4a3900c4aef0e6fa659bf6e1195f6621303d165647a8de57ca46f79e07dc3 WatchSource:0}: Error finding container 61f4a3900c4aef0e6fa659bf6e1195f6621303d165647a8de57ca46f79e07dc3: Status 404 returned error can't find the container with id 61f4a3900c4aef0e6fa659bf6e1195f6621303d165647a8de57ca46f79e07dc3
Sep 10 22:06:59.061122 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:59.061094    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d88f9f94c-bcq7n"
Sep 10 22:06:59.169206 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:59.169173    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cdcfd56-27v6n" event={"ID":"53b32f02-5c79-4181-8a48-7e36c00361d8","Type":"ContainerStarted","Data":"c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337"}
Sep 10 22:06:59.169361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:59.169220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cdcfd56-27v6n" event={"ID":"53b32f02-5c79-4181-8a48-7e36c00361d8","Type":"ContainerStarted","Data":"61f4a3900c4aef0e6fa659bf6e1195f6621303d165647a8de57ca46f79e07dc3"}
Sep 10 22:06:59.194902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:59.194818    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57cdcfd56-27v6n" podStartSLOduration=2.194797047 podStartE2EDuration="2.194797047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:06:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:06:59.194143222 +0000 UTC m=+99.076627588" watchObservedRunningTime="2026-09-10 22:06:59.194797047 +0000 UTC m=+99.077281415"
Sep 10 22:06:59.213705 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:59.213676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:06:59.313863 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:06:59.313768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:02.289226 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:02.289197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:02.390215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:02.390151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:03.071555 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.071510    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv" podUID="d6583fc1-12f7-43a9-8461-b39135514e3e" containerName="registry" containerID="cri-o://ca4cf0282ca325521e3778210f192651a616e3637057556608167c23ae97b207" gracePeriod=30
Sep 10 22:07:03.187023 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.186991    2573 generic.go:356] "Generic (PLEG): container finished" podID="d6583fc1-12f7-43a9-8461-b39135514e3e" containerID="ca4cf0282ca325521e3778210f192651a616e3637057556608167c23ae97b207" exitCode=0
Sep 10 22:07:03.187165 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.187064    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv" event={"ID":"d6583fc1-12f7-43a9-8461-b39135514e3e","Type":"ContainerDied","Data":"ca4cf0282ca325521e3778210f192651a616e3637057556608167c23ae97b207"}
Sep 10 22:07:03.352949 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.352876    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:07:03.377139 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.377106    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-trusted-ca\") pod \"d6583fc1-12f7-43a9-8461-b39135514e3e\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") "
Sep 10 22:07:03.377139 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.377139    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") pod \"d6583fc1-12f7-43a9-8461-b39135514e3e\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") "
Sep 10 22:07:03.377334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.377171    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s4x6\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-kube-api-access-5s4x6\") pod \"d6583fc1-12f7-43a9-8461-b39135514e3e\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") "
Sep 10 22:07:03.377334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.377202    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-bound-sa-token\") pod \"d6583fc1-12f7-43a9-8461-b39135514e3e\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") "
Sep 10 22:07:03.377334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.377225    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-certificates\") pod \"d6583fc1-12f7-43a9-8461-b39135514e3e\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") "
Sep 10 22:07:03.377334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.377254    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-installation-pull-secrets\") pod \"d6583fc1-12f7-43a9-8461-b39135514e3e\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") "
Sep 10 22:07:03.377334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.377282    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-image-registry-private-configuration\") pod \"d6583fc1-12f7-43a9-8461-b39135514e3e\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") "
Sep 10 22:07:03.377576 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.377354    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583fc1-12f7-43a9-8461-b39135514e3e-ca-trust-extracted\") pod \"d6583fc1-12f7-43a9-8461-b39135514e3e\" (UID: \"d6583fc1-12f7-43a9-8461-b39135514e3e\") "
Sep 10 22:07:03.377704 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.377657    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d6583fc1-12f7-43a9-8461-b39135514e3e" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:07:03.378077 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.378035    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d6583fc1-12f7-43a9-8461-b39135514e3e" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:07:03.380187 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.380157    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d6583fc1-12f7-43a9-8461-b39135514e3e" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:07:03.380543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.380515    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d6583fc1-12f7-43a9-8461-b39135514e3e" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:07:03.380647 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.380431    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-kube-api-access-5s4x6" (OuterVolumeSpecName: "kube-api-access-5s4x6") pod "d6583fc1-12f7-43a9-8461-b39135514e3e" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e"). InnerVolumeSpecName "kube-api-access-5s4x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:07:03.381214 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.381180    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d6583fc1-12f7-43a9-8461-b39135514e3e" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:07:03.381543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.381517    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d6583fc1-12f7-43a9-8461-b39135514e3e" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:07:03.386867 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.386825    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6583fc1-12f7-43a9-8461-b39135514e3e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d6583fc1-12f7-43a9-8461-b39135514e3e" (UID: "d6583fc1-12f7-43a9-8461-b39135514e3e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:07:03.478230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.478198    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-bound-sa-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:03.478230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.478228    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-certificates\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:03.478401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.478242    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-installation-pull-secrets\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:03.478401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.478256    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583fc1-12f7-43a9-8461-b39135514e3e-image-registry-private-configuration\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:03.478401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.478269    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583fc1-12f7-43a9-8461-b39135514e3e-ca-trust-extracted\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:03.478401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.478281    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583fc1-12f7-43a9-8461-b39135514e3e-trusted-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:03.478401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.478292    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-registry-tls\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:03.478401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:03.478303    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s4x6\" (UniqueName: \"kubernetes.io/projected/d6583fc1-12f7-43a9-8461-b39135514e3e-kube-api-access-5s4x6\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:04.036385 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.036354    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8m9nm"
Sep 10 22:07:04.192599 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.192571    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"
Sep 10 22:07:04.192779 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.192571    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5cc65b5b-8sjsv" event={"ID":"d6583fc1-12f7-43a9-8461-b39135514e3e","Type":"ContainerDied","Data":"96270f2bcf4ebe2e634e9113cff77d384289d504861ce04c31485e7d7512eb82"}
Sep 10 22:07:04.192779 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.192693    2573 scope.go:117] "RemoveContainer" containerID="ca4cf0282ca325521e3778210f192651a616e3637057556608167c23ae97b207"
Sep 10 22:07:04.213496 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.213472    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"]
Sep 10 22:07:04.218258 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.218239    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c5cc65b5b-8sjsv"]
Sep 10 22:07:04.551504 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.551468    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6583fc1-12f7-43a9-8461-b39135514e3e" path="/var/lib/kubelet/pods/d6583fc1-12f7-43a9-8461-b39135514e3e/volumes"
Sep 10 22:07:04.680524 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.680493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:04.781063 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.781032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:04.882181 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:04.882112    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:07.138107 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:07.138062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:07.210103 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:07.210074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:08.306958 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:08.306925    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:07:08.307423 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:08.307011    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:07:08.312746 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:08.312712    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:07:09.221643 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:09.221610    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:07:09.314459 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:09.314430    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf546ffbb-42cwq"]
Sep 10 22:07:09.594307 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:09.594229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:09.689176 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:09.689149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:10.794994 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:10.794967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:10.898183 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:10.898157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:13.876776 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:13.876741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:13.976171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:13.976140    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:17.283268 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:17.283239    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:17.350156 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:17.350129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:24.951710 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:24.951680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:25.051953 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:25.051922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:25.153808 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:25.153778    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:25.219077 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:25.219014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:29.289226 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:29.289190    2573 generic.go:356] "Generic (PLEG): container finished" podID="b3dad17d-e969-4018-a4e2-972bb16cd582" containerID="ec0d09ff77e0b1c2f9dc54c2c04ef2022e20832b3c4333c0cbf1d4da9aceca85" exitCode=0
Sep 10 22:07:29.289659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:29.289260    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r" event={"ID":"b3dad17d-e969-4018-a4e2-972bb16cd582","Type":"ContainerDied","Data":"ec0d09ff77e0b1c2f9dc54c2c04ef2022e20832b3c4333c0cbf1d4da9aceca85"}
Sep 10 22:07:29.289659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:29.289539    2573 scope.go:117] "RemoveContainer" containerID="ec0d09ff77e0b1c2f9dc54c2c04ef2022e20832b3c4333c0cbf1d4da9aceca85"
Sep 10 22:07:30.294942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:30.294907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-8c78r" event={"ID":"b3dad17d-e969-4018-a4e2-972bb16cd582","Type":"ContainerStarted","Data":"c5e5e6c0f0cc5e5176a656c9446117d917787ef9a87cb9f0c41fcdc1fc3fc670"}
Sep 10 22:07:32.284796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:32.284762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:32.385802 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:32.385764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:07:34.333821 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.333783    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cf546ffbb-42cwq" podUID="f0acb9a8-f221-42fe-bfbf-2c05825f0042" containerName="console" containerID="cri-o://f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241" gracePeriod=15
Sep 10 22:07:34.585950 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.585897    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:07:34.724541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.724507    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-oauth-config\") pod \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") "
Sep 10 22:07:34.724541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.724543    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-serving-cert\") pod \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") "
Sep 10 22:07:34.724774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.724569    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-config\") pod \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") "
Sep 10 22:07:34.724774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.724592    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-oauth-serving-cert\") pod \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") "
Sep 10 22:07:34.724774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.724616    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-trusted-ca-bundle\") pod \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") "
Sep 10 22:07:34.724774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.724662    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwlf4\" (UniqueName: \"kubernetes.io/projected/f0acb9a8-f221-42fe-bfbf-2c05825f0042-kube-api-access-rwlf4\") pod \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") "
Sep 10 22:07:34.724774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.724692    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-service-ca\") pod \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\" (UID: \"f0acb9a8-f221-42fe-bfbf-2c05825f0042\") "
Sep 10 22:07:34.725141 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.725100    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f0acb9a8-f221-42fe-bfbf-2c05825f0042" (UID: "f0acb9a8-f221-42fe-bfbf-2c05825f0042"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:07:34.725257 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.725130    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-config" (OuterVolumeSpecName: "console-config") pod "f0acb9a8-f221-42fe-bfbf-2c05825f0042" (UID: "f0acb9a8-f221-42fe-bfbf-2c05825f0042"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:07:34.725257 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.725138    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f0acb9a8-f221-42fe-bfbf-2c05825f0042" (UID: "f0acb9a8-f221-42fe-bfbf-2c05825f0042"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:07:34.725356 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.725258    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-service-ca" (OuterVolumeSpecName: "service-ca") pod "f0acb9a8-f221-42fe-bfbf-2c05825f0042" (UID: "f0acb9a8-f221-42fe-bfbf-2c05825f0042"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:07:34.726834 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.726809    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f0acb9a8-f221-42fe-bfbf-2c05825f0042" (UID: "f0acb9a8-f221-42fe-bfbf-2c05825f0042"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:07:34.726924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.726879    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f0acb9a8-f221-42fe-bfbf-2c05825f0042" (UID: "f0acb9a8-f221-42fe-bfbf-2c05825f0042"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:07:34.726924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.726872    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0acb9a8-f221-42fe-bfbf-2c05825f0042-kube-api-access-rwlf4" (OuterVolumeSpecName: "kube-api-access-rwlf4") pod "f0acb9a8-f221-42fe-bfbf-2c05825f0042" (UID: "f0acb9a8-f221-42fe-bfbf-2c05825f0042"). InnerVolumeSpecName "kube-api-access-rwlf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:07:34.825372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.825332    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwlf4\" (UniqueName: \"kubernetes.io/projected/f0acb9a8-f221-42fe-bfbf-2c05825f0042-kube-api-access-rwlf4\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:34.825372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.825369    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:34.825372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.825378    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-oauth-config\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:34.825571 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.825387    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-serving-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:34.825571 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.825396    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-console-config\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:34.825571 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.825404    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-oauth-serving-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:34.825571 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:34.825412    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0acb9a8-f221-42fe-bfbf-2c05825f0042-trusted-ca-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:07:35.313822 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:35.313792    2573 generic.go:356] "Generic (PLEG): container finished" podID="f0acb9a8-f221-42fe-bfbf-2c05825f0042" containerID="f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241" exitCode=0
Sep 10 22:07:35.314021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:35.313858    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf546ffbb-42cwq"
Sep 10 22:07:35.314021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:35.313878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf546ffbb-42cwq" event={"ID":"f0acb9a8-f221-42fe-bfbf-2c05825f0042","Type":"ContainerDied","Data":"f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241"}
Sep 10 22:07:35.314021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:35.313928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf546ffbb-42cwq" event={"ID":"f0acb9a8-f221-42fe-bfbf-2c05825f0042","Type":"ContainerDied","Data":"7c852732c00d9d77612a53d3e6d58bad3f6ab9937066c79ffba7aa0a90e51a37"}
Sep 10 22:07:35.314021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:35.313948    2573 scope.go:117] "RemoveContainer" containerID="f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241"
Sep 10 22:07:35.322424 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:35.322408    2573 scope.go:117] "RemoveContainer" containerID="f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241"
Sep 10 22:07:35.322702 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:07:35.322680    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241\": container with ID starting with f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241 not found: ID does not exist" containerID="f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241"
Sep 10 22:07:35.322770 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:35.322714    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241"} err="failed to get container status \"f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241\": rpc error: code = NotFound desc = could not find container \"f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241\": container with ID starting with f1184c36f0f253e75aa72a299a22a84ecdf97086382a4210948b8dee1bdee241 not found: ID does not exist"
Sep 10 22:07:35.335291 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:35.335268    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf546ffbb-42cwq"]
Sep 10 22:07:35.344162 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:35.344139    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cf546ffbb-42cwq"]
Sep 10 22:07:36.551306 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:07:36.551271    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0acb9a8-f221-42fe-bfbf-2c05825f0042" path="/var/lib/kubelet/pods/f0acb9a8-f221-42fe-bfbf-2c05825f0042/volumes"
Sep 10 22:08:11.219278 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:11.219244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:11.700011 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:11.699961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:20.092979 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.092882    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b64f74489-87r7d"]
Sep 10 22:08:20.093457 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.093434    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6583fc1-12f7-43a9-8461-b39135514e3e" containerName="registry"
Sep 10 22:08:20.093542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.093461    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6583fc1-12f7-43a9-8461-b39135514e3e" containerName="registry"
Sep 10 22:08:20.093542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.093478    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0acb9a8-f221-42fe-bfbf-2c05825f0042" containerName="console"
Sep 10 22:08:20.093542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.093487    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0acb9a8-f221-42fe-bfbf-2c05825f0042" containerName="console"
Sep 10 22:08:20.093691 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.093558    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6583fc1-12f7-43a9-8461-b39135514e3e" containerName="registry"
Sep 10 22:08:20.093691 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.093572    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0acb9a8-f221-42fe-bfbf-2c05825f0042" containerName="console"
Sep 10 22:08:20.096817 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.096792    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.108936 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.108911    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b64f74489-87r7d"]
Sep 10 22:08:20.164140 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.164116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-service-ca\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.164280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.164145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6cls\" (UniqueName: \"kubernetes.io/projected/056266e0-f4ea-428b-9d88-3eb809c9dd39-kube-api-access-f6cls\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.164280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.164168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-config\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.164280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.164197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-oauth-config\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.164280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.164214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-oauth-serving-cert\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.164280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.164246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-trusted-ca-bundle\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.164486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.164338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-serving-cert\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.169384 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.169363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:20.265394 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.265372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-trusted-ca-bundle\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.265542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.265410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-serving-cert\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.265542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.265439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-service-ca\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.265542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.265457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cls\" (UniqueName: \"kubernetes.io/projected/056266e0-f4ea-428b-9d88-3eb809c9dd39-kube-api-access-f6cls\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.265542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.265484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-config\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.265542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.265514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-oauth-config\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.265542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.265534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-oauth-serving-cert\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.266284 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.266257    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-config\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.266406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.266291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-service-ca\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.266406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.266291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-oauth-serving-cert\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.266524 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.266511    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-trusted-ca-bundle\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.268001 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.267973    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-oauth-config\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.268091 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.268072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-serving-cert\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.273874 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.273833    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cls\" (UniqueName: \"kubernetes.io/projected/056266e0-f4ea-428b-9d88-3eb809c9dd39-kube-api-access-f6cls\") pod \"console-7b64f74489-87r7d\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") " pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.277495 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.277468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:20.406431 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.406354    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:20.680875 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:20.680682    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b64f74489-87r7d"]
Sep 10 22:08:20.683582 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:08:20.683553    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056266e0_f4ea_428b_9d88_3eb809c9dd39.slice/crio-9e4efaa5b94251bdf97a7f59f2b46814354c84f5bb660c0baea098a05179ccd3 WatchSource:0}: Error finding container 9e4efaa5b94251bdf97a7f59f2b46814354c84f5bb660c0baea098a05179ccd3: Status 404 returned error can't find the container with id 9e4efaa5b94251bdf97a7f59f2b46814354c84f5bb660c0baea098a05179ccd3
Sep 10 22:08:21.493201 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:21.493161    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b64f74489-87r7d" event={"ID":"056266e0-f4ea-428b-9d88-3eb809c9dd39","Type":"ContainerStarted","Data":"ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6"}
Sep 10 22:08:21.493563 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:21.493219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b64f74489-87r7d" event={"ID":"056266e0-f4ea-428b-9d88-3eb809c9dd39","Type":"ContainerStarted","Data":"9e4efaa5b94251bdf97a7f59f2b46814354c84f5bb660c0baea098a05179ccd3"}
Sep 10 22:08:21.514654 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:21.514611    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b64f74489-87r7d" podStartSLOduration=1.514597416 podStartE2EDuration="1.514597416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:08:21.512963567 +0000 UTC m=+181.395447949" watchObservedRunningTime="2026-09-10 22:08:21.514597416 +0000 UTC m=+181.397081850"
Sep 10 22:08:30.407341 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:30.407294    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:30.407747 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:30.407375    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:30.412183 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:30.412160    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:30.530045 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:30.530017    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:08:30.582141 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:30.582108    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cdcfd56-27v6n"]
Sep 10 22:08:30.698395 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:30.698310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:30.798818 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:30.798788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:30.899179 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:30.899138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:42.106977 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:42.106945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:42.207130 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:42.207090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:45.008177 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:45.008144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:55.607633 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.607577    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57cdcfd56-27v6n" podUID="53b32f02-5c79-4181-8a48-7e36c00361d8" containerName="console" containerID="cri-o://c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337" gracePeriod=15
Sep 10 22:08:55.848122 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.848099    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:08:55.956598 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.956525    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-oauth-config\") pod \"53b32f02-5c79-4181-8a48-7e36c00361d8\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") "
Sep 10 22:08:55.956598 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.956559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-trusted-ca-bundle\") pod \"53b32f02-5c79-4181-8a48-7e36c00361d8\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") "
Sep 10 22:08:55.956598 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.956585    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-serving-cert\") pod \"53b32f02-5c79-4181-8a48-7e36c00361d8\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") "
Sep 10 22:08:55.956909 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.956625    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-oauth-serving-cert\") pod \"53b32f02-5c79-4181-8a48-7e36c00361d8\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") "
Sep 10 22:08:55.956909 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.956766    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wssdm\" (UniqueName: \"kubernetes.io/projected/53b32f02-5c79-4181-8a48-7e36c00361d8-kube-api-access-wssdm\") pod \"53b32f02-5c79-4181-8a48-7e36c00361d8\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") "
Sep 10 22:08:55.956909 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.956865    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-console-config\") pod \"53b32f02-5c79-4181-8a48-7e36c00361d8\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") "
Sep 10 22:08:55.957068 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.956929    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-service-ca\") pod \"53b32f02-5c79-4181-8a48-7e36c00361d8\" (UID: \"53b32f02-5c79-4181-8a48-7e36c00361d8\") "
Sep 10 22:08:55.957068 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.957042    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53b32f02-5c79-4181-8a48-7e36c00361d8" (UID: "53b32f02-5c79-4181-8a48-7e36c00361d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:08:55.957166 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.957081    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53b32f02-5c79-4181-8a48-7e36c00361d8" (UID: "53b32f02-5c79-4181-8a48-7e36c00361d8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:08:55.957364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.957303    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-oauth-serving-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:08:55.957364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.957321    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-trusted-ca-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:08:55.957364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.957341    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-console-config" (OuterVolumeSpecName: "console-config") pod "53b32f02-5c79-4181-8a48-7e36c00361d8" (UID: "53b32f02-5c79-4181-8a48-7e36c00361d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:08:55.957498 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.957347    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "53b32f02-5c79-4181-8a48-7e36c00361d8" (UID: "53b32f02-5c79-4181-8a48-7e36c00361d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:08:55.958814 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.958785    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53b32f02-5c79-4181-8a48-7e36c00361d8" (UID: "53b32f02-5c79-4181-8a48-7e36c00361d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:08:55.958944 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.958817    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53b32f02-5c79-4181-8a48-7e36c00361d8" (UID: "53b32f02-5c79-4181-8a48-7e36c00361d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:08:55.958944 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:55.958852    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b32f02-5c79-4181-8a48-7e36c00361d8-kube-api-access-wssdm" (OuterVolumeSpecName: "kube-api-access-wssdm") pod "53b32f02-5c79-4181-8a48-7e36c00361d8" (UID: "53b32f02-5c79-4181-8a48-7e36c00361d8"). InnerVolumeSpecName "kube-api-access-wssdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:08:56.058048 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.058012    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wssdm\" (UniqueName: \"kubernetes.io/projected/53b32f02-5c79-4181-8a48-7e36c00361d8-kube-api-access-wssdm\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:08:56.058048 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.058043    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-console-config\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:08:56.058048 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.058055    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b32f02-5c79-4181-8a48-7e36c00361d8-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:08:56.058253 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.058066    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-oauth-config\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:08:56.058253 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.058079    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b32f02-5c79-4181-8a48-7e36c00361d8-console-serving-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:08:56.618307 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.618273    2573 generic.go:356] "Generic (PLEG): container finished" podID="53b32f02-5c79-4181-8a48-7e36c00361d8" containerID="c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337" exitCode=0
Sep 10 22:08:56.618861 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.618323    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cdcfd56-27v6n"
Sep 10 22:08:56.618861 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.618352    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cdcfd56-27v6n" event={"ID":"53b32f02-5c79-4181-8a48-7e36c00361d8","Type":"ContainerDied","Data":"c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337"}
Sep 10 22:08:56.618861 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.618402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cdcfd56-27v6n" event={"ID":"53b32f02-5c79-4181-8a48-7e36c00361d8","Type":"ContainerDied","Data":"61f4a3900c4aef0e6fa659bf6e1195f6621303d165647a8de57ca46f79e07dc3"}
Sep 10 22:08:56.618861 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.618422    2573 scope.go:117] "RemoveContainer" containerID="c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337"
Sep 10 22:08:56.626350 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.626337    2573 scope.go:117] "RemoveContainer" containerID="c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337"
Sep 10 22:08:56.626577 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:08:56.626561    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337\": container with ID starting with c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337 not found: ID does not exist" containerID="c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337"
Sep 10 22:08:56.626627 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.626585    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337"} err="failed to get container status \"c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337\": rpc error: code = NotFound desc = could not find container \"c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337\": container with ID starting with c4e1cc380ac3932ec1d56df0b93eb2e8975ac024091ad9394230748da7381337 not found: ID does not exist"
Sep 10 22:08:56.641733 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.641708    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cdcfd56-27v6n"]
Sep 10 22:08:56.654446 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:56.654427    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57cdcfd56-27v6n"]
Sep 10 22:08:57.629754 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:57.629723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:57.710473 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:57.710436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:08:58.551831 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:08:58.551799    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b32f02-5c79-4181-8a48-7e36c00361d8" path="/var/lib/kubelet/pods/53b32f02-5c79-4181-8a48-7e36c00361d8/volumes"
Sep 10 22:09:26.522502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:26.522467    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:09:26.590262 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:26.590223    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:09:30.257349 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.257317    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c7dbb6785-npm9t"]
Sep 10 22:09:30.257784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.257672    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b32f02-5c79-4181-8a48-7e36c00361d8" containerName="console"
Sep 10 22:09:30.257784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.257685    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b32f02-5c79-4181-8a48-7e36c00361d8" containerName="console"
Sep 10 22:09:30.257784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.257747    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b32f02-5c79-4181-8a48-7e36c00361d8" containerName="console"
Sep 10 22:09:30.261949 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.261923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.278356 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.278326    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7dbb6785-npm9t"]
Sep 10 22:09:30.296676 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.296611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-oauth-config\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.296816 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.296687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-serving-cert\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.296816 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.296720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-trusted-ca-bundle\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.296816 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.296739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-oauth-serving-cert\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.297034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.296827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-service-ca\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.297034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.296886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-console-config\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.297034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.296911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnv8q\" (UniqueName: \"kubernetes.io/projected/5945c355-e397-46b3-96d7-f24d2f8c0391-kube-api-access-pnv8q\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.342724 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.342690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:09:30.398131 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.398102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-console-config\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.398131 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.398130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnv8q\" (UniqueName: \"kubernetes.io/projected/5945c355-e397-46b3-96d7-f24d2f8c0391-kube-api-access-pnv8q\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.398329 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.398156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-oauth-config\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.398407 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.398394    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-serving-cert\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.398461 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.398424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-trusted-ca-bundle\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.398461 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.398448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-oauth-serving-cert\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.398575 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.398509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-service-ca\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.398929 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.398894    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-console-config\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.399164 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.399142    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-service-ca\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.399297 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.399272    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-oauth-serving-cert\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.399378 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.399296    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-trusted-ca-bundle\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.400740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.400719    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-serving-cert\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.400827 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.400743    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-oauth-config\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.406111 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.406088    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnv8q\" (UniqueName: \"kubernetes.io/projected/5945c355-e397-46b3-96d7-f24d2f8c0391-kube-api-access-pnv8q\") pod \"console-5c7dbb6785-npm9t\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") " pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.417750 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.417730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:09:30.572129 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.572055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:30.845105 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:30.845019    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7dbb6785-npm9t"]
Sep 10 22:09:30.848458 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:09:30.848434    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5945c355_e397_46b3_96d7_f24d2f8c0391.slice/crio-302982a343d1b14da816c8b06d6c05be7fe82f9492ff7002b1555e9402df75aa WatchSource:0}: Error finding container 302982a343d1b14da816c8b06d6c05be7fe82f9492ff7002b1555e9402df75aa: Status 404 returned error can't find the container with id 302982a343d1b14da816c8b06d6c05be7fe82f9492ff7002b1555e9402df75aa
Sep 10 22:09:31.748881 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:31.748816    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7dbb6785-npm9t" event={"ID":"5945c355-e397-46b3-96d7-f24d2f8c0391","Type":"ContainerStarted","Data":"08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e"}
Sep 10 22:09:31.749271 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:31.748898    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7dbb6785-npm9t" event={"ID":"5945c355-e397-46b3-96d7-f24d2f8c0391","Type":"ContainerStarted","Data":"302982a343d1b14da816c8b06d6c05be7fe82f9492ff7002b1555e9402df75aa"}
Sep 10 22:09:31.768624 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:31.768578    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c7dbb6785-npm9t" podStartSLOduration=1.768564344 podStartE2EDuration="1.768564344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:09:31.766944546 +0000 UTC m=+251.649428913" watchObservedRunningTime="2026-09-10 22:09:31.768564344 +0000 UTC m=+251.651048709"
Sep 10 22:09:38.354430 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:38.354355    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:09:38.427097 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:38.427050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:09:40.572147 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:40.572118    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:40.572621 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:40.572200    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:40.577754 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:40.577725    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:40.785238 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:40.785212    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:09:40.834812 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:40.834741    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b64f74489-87r7d"]
Sep 10 22:09:40.957028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:40.956977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:09:41.057978 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:41.057946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:09:47.297641 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:47.297510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:09:47.399426 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:09:47.399364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:10:05.859509 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:05.859449    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b64f74489-87r7d" podUID="056266e0-f4ea-428b-9d88-3eb809c9dd39" containerName="console" containerID="cri-o://ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6" gracePeriod=15
Sep 10 22:10:06.089926 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.089905    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:10:06.162613 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.162545    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-config\") pod \"056266e0-f4ea-428b-9d88-3eb809c9dd39\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") "
Sep 10 22:10:06.162613 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.162579    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6cls\" (UniqueName: \"kubernetes.io/projected/056266e0-f4ea-428b-9d88-3eb809c9dd39-kube-api-access-f6cls\") pod \"056266e0-f4ea-428b-9d88-3eb809c9dd39\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") "
Sep 10 22:10:06.162804 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.162618    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-oauth-config\") pod \"056266e0-f4ea-428b-9d88-3eb809c9dd39\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") "
Sep 10 22:10:06.162804 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.162638    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-trusted-ca-bundle\") pod \"056266e0-f4ea-428b-9d88-3eb809c9dd39\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") "
Sep 10 22:10:06.162804 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.162668    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-serving-cert\") pod \"056266e0-f4ea-428b-9d88-3eb809c9dd39\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") "
Sep 10 22:10:06.162987 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.162822    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-oauth-serving-cert\") pod \"056266e0-f4ea-428b-9d88-3eb809c9dd39\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") "
Sep 10 22:10:06.162987 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.162885    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-service-ca\") pod \"056266e0-f4ea-428b-9d88-3eb809c9dd39\" (UID: \"056266e0-f4ea-428b-9d88-3eb809c9dd39\") "
Sep 10 22:10:06.162987 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.162972    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-config" (OuterVolumeSpecName: "console-config") pod "056266e0-f4ea-428b-9d88-3eb809c9dd39" (UID: "056266e0-f4ea-428b-9d88-3eb809c9dd39"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:10:06.163265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.163238    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "056266e0-f4ea-428b-9d88-3eb809c9dd39" (UID: "056266e0-f4ea-428b-9d88-3eb809c9dd39"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:10:06.163335 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.163251    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-config\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:06.163335 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.163258    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "056266e0-f4ea-428b-9d88-3eb809c9dd39" (UID: "056266e0-f4ea-428b-9d88-3eb809c9dd39"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:10:06.163423 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.163331    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-service-ca" (OuterVolumeSpecName: "service-ca") pod "056266e0-f4ea-428b-9d88-3eb809c9dd39" (UID: "056266e0-f4ea-428b-9d88-3eb809c9dd39"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:10:06.164774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.164752    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "056266e0-f4ea-428b-9d88-3eb809c9dd39" (UID: "056266e0-f4ea-428b-9d88-3eb809c9dd39"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:10:06.165296 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.165277    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "056266e0-f4ea-428b-9d88-3eb809c9dd39" (UID: "056266e0-f4ea-428b-9d88-3eb809c9dd39"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:10:06.165355 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.165288    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/056266e0-f4ea-428b-9d88-3eb809c9dd39-kube-api-access-f6cls" (OuterVolumeSpecName: "kube-api-access-f6cls") pod "056266e0-f4ea-428b-9d88-3eb809c9dd39" (UID: "056266e0-f4ea-428b-9d88-3eb809c9dd39"). InnerVolumeSpecName "kube-api-access-f6cls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:10:06.264393 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.264368    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-serving-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:06.264393 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.264391    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-oauth-serving-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:06.264541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.264400    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:06.264541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.264410    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6cls\" (UniqueName: \"kubernetes.io/projected/056266e0-f4ea-428b-9d88-3eb809c9dd39-kube-api-access-f6cls\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:06.264541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.264418    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056266e0-f4ea-428b-9d88-3eb809c9dd39-console-oauth-config\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:06.264541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.264426    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056266e0-f4ea-428b-9d88-3eb809c9dd39-trusted-ca-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:06.876687 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.876605    2573 generic.go:356] "Generic (PLEG): container finished" podID="056266e0-f4ea-428b-9d88-3eb809c9dd39" containerID="ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6" exitCode=0
Sep 10 22:10:06.876687 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.876655    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b64f74489-87r7d"
Sep 10 22:10:06.877131 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.876704    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b64f74489-87r7d" event={"ID":"056266e0-f4ea-428b-9d88-3eb809c9dd39","Type":"ContainerDied","Data":"ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6"}
Sep 10 22:10:06.877131 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.876756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b64f74489-87r7d" event={"ID":"056266e0-f4ea-428b-9d88-3eb809c9dd39","Type":"ContainerDied","Data":"9e4efaa5b94251bdf97a7f59f2b46814354c84f5bb660c0baea098a05179ccd3"}
Sep 10 22:10:06.877131 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.876777    2573 scope.go:117] "RemoveContainer" containerID="ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6"
Sep 10 22:10:06.884859 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.884818    2573 scope.go:117] "RemoveContainer" containerID="ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6"
Sep 10 22:10:06.885114 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:10:06.885096    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6\": container with ID starting with ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6 not found: ID does not exist" containerID="ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6"
Sep 10 22:10:06.885160 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.885122    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6"} err="failed to get container status \"ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6\": rpc error: code = NotFound desc = could not find container \"ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6\": container with ID starting with ce883d0e75b4822a5ffafdfa323aac8529a30f4d341154d4433d62816a21c1d6 not found: ID does not exist"
Sep 10 22:10:06.893048 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.893025    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b64f74489-87r7d"]
Sep 10 22:10:06.896675 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:06.896655    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b64f74489-87r7d"]
Sep 10 22:10:08.557922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:08.557888    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="056266e0-f4ea-428b-9d88-3eb809c9dd39" path="/var/lib/kubelet/pods/056266e0-f4ea-428b-9d88-3eb809c9dd39/volumes"
Sep 10 22:10:20.456378 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:20.456347    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:10:20.461033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:20.461013    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:10:20.467167 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:20.467146    2573 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 22:10:35.464209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:35.464175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:10:36.118291 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.118262    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"]
Sep 10 22:10:36.118545 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.118534    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="056266e0-f4ea-428b-9d88-3eb809c9dd39" containerName="console"
Sep 10 22:10:36.118594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.118546    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="056266e0-f4ea-428b-9d88-3eb809c9dd39" containerName="console"
Sep 10 22:10:36.118628 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.118596    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="056266e0-f4ea-428b-9d88-3eb809c9dd39" containerName="console"
Sep 10 22:10:36.121466 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.121449    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.123687 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.123664    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:10:36.124089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.124070    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dttnp\""
Sep 10 22:10:36.124178 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.124070    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:10:36.129027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.129004    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"]
Sep 10 22:10:36.186184 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.186157    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.186326 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.186205    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jslqn\" (UniqueName: \"kubernetes.io/projected/63b76531-f93a-4d07-a0af-677167bc6455-kube-api-access-jslqn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.186326 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.186247    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.287016 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.286990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.287153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.287042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jslqn\" (UniqueName: \"kubernetes.io/projected/63b76531-f93a-4d07-a0af-677167bc6455-kube-api-access-jslqn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.287153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.287071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.287441 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.287417    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.287513 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.287427    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.294749 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.294727    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jslqn\" (UniqueName: \"kubernetes.io/projected/63b76531-f93a-4d07-a0af-677167bc6455-kube-api-access-jslqn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.431306 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.431245    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:36.697994 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.697923    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"]
Sep 10 22:10:36.700977 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:10:36.700949    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b76531_f93a_4d07_a0af_677167bc6455.slice/crio-6958023b8c3a2aa7ba7aa261450d297d492e1fed08f447cc4d275a31c8c12718 WatchSource:0}: Error finding container 6958023b8c3a2aa7ba7aa261450d297d492e1fed08f447cc4d275a31c8c12718: Status 404 returned error can't find the container with id 6958023b8c3a2aa7ba7aa261450d297d492e1fed08f447cc4d275a31c8c12718
Sep 10 22:10:36.702828 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.702809    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:10:36.819416 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.819383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:10:36.986769 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:36.986738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh" event={"ID":"63b76531-f93a-4d07-a0af-677167bc6455","Type":"ContainerStarted","Data":"6958023b8c3a2aa7ba7aa261450d297d492e1fed08f447cc4d275a31c8c12718"}
Sep 10 22:10:43.013503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:43.013463    2573 generic.go:356] "Generic (PLEG): container finished" podID="63b76531-f93a-4d07-a0af-677167bc6455" containerID="20a77212bed34e43b0da6f9317f536c430a4feb8b80a3c49d62f45c03ac4cb16" exitCode=0
Sep 10 22:10:43.014084 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:43.013547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh" event={"ID":"63b76531-f93a-4d07-a0af-677167bc6455","Type":"ContainerDied","Data":"20a77212bed34e43b0da6f9317f536c430a4feb8b80a3c49d62f45c03ac4cb16"}
Sep 10 22:10:46.027807 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:46.027775    2573 generic.go:356] "Generic (PLEG): container finished" podID="63b76531-f93a-4d07-a0af-677167bc6455" containerID="c8c0829bd3ef2de861a811a3976d44f36919cf7ba44d672055cef8cb00ef568f" exitCode=0
Sep 10 22:10:46.028191 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:46.027870    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh" event={"ID":"63b76531-f93a-4d07-a0af-677167bc6455","Type":"ContainerDied","Data":"c8c0829bd3ef2de861a811a3976d44f36919cf7ba44d672055cef8cb00ef568f"}
Sep 10 22:10:53.057355 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:53.057319    2573 generic.go:356] "Generic (PLEG): container finished" podID="63b76531-f93a-4d07-a0af-677167bc6455" containerID="30f1b651ef098e6ec657f1f0478cd636b358aac057d23ba6e25742f6a0109647" exitCode=0
Sep 10 22:10:53.057717 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:53.057390    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh" event={"ID":"63b76531-f93a-4d07-a0af-677167bc6455","Type":"ContainerDied","Data":"30f1b651ef098e6ec657f1f0478cd636b358aac057d23ba6e25742f6a0109647"}
Sep 10 22:10:54.180388 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.180365    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:54.228769 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.228745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-bundle\") pod \"63b76531-f93a-4d07-a0af-677167bc6455\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") "
Sep 10 22:10:54.228919 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.228862    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jslqn\" (UniqueName: \"kubernetes.io/projected/63b76531-f93a-4d07-a0af-677167bc6455-kube-api-access-jslqn\") pod \"63b76531-f93a-4d07-a0af-677167bc6455\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") "
Sep 10 22:10:54.228919 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.228889    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-util\") pod \"63b76531-f93a-4d07-a0af-677167bc6455\" (UID: \"63b76531-f93a-4d07-a0af-677167bc6455\") "
Sep 10 22:10:54.229486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.229458    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-bundle" (OuterVolumeSpecName: "bundle") pod "63b76531-f93a-4d07-a0af-677167bc6455" (UID: "63b76531-f93a-4d07-a0af-677167bc6455"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:10:54.230987 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.230963    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b76531-f93a-4d07-a0af-677167bc6455-kube-api-access-jslqn" (OuterVolumeSpecName: "kube-api-access-jslqn") pod "63b76531-f93a-4d07-a0af-677167bc6455" (UID: "63b76531-f93a-4d07-a0af-677167bc6455"). InnerVolumeSpecName "kube-api-access-jslqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:10:54.233860 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.233816    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-util" (OuterVolumeSpecName: "util") pod "63b76531-f93a-4d07-a0af-677167bc6455" (UID: "63b76531-f93a-4d07-a0af-677167bc6455"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:10:54.329730 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.329646    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jslqn\" (UniqueName: \"kubernetes.io/projected/63b76531-f93a-4d07-a0af-677167bc6455-kube-api-access-jslqn\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:54.329730 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.329678    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-util\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:54.329730 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:54.329692    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63b76531-f93a-4d07-a0af-677167bc6455-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:10:55.066381 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:55.066342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh" event={"ID":"63b76531-f93a-4d07-a0af-677167bc6455","Type":"ContainerDied","Data":"6958023b8c3a2aa7ba7aa261450d297d492e1fed08f447cc4d275a31c8c12718"}
Sep 10 22:10:55.066577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:55.066398    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6958023b8c3a2aa7ba7aa261450d297d492e1fed08f447cc4d275a31c8c12718"
Sep 10 22:10:55.066577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:55.066355    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks6rh"
Sep 10 22:10:57.397986 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:57.397955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:10:58.913262 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:58.913233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:10:59.415866 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.415822    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"]
Sep 10 22:10:59.416132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.416120    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b76531-f93a-4d07-a0af-677167bc6455" containerName="util"
Sep 10 22:10:59.416173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.416134    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b76531-f93a-4d07-a0af-677167bc6455" containerName="util"
Sep 10 22:10:59.416173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.416148    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b76531-f93a-4d07-a0af-677167bc6455" containerName="pull"
Sep 10 22:10:59.416173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.416154    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b76531-f93a-4d07-a0af-677167bc6455" containerName="pull"
Sep 10 22:10:59.416173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.416172    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b76531-f93a-4d07-a0af-677167bc6455" containerName="extract"
Sep 10 22:10:59.416277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.416178    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b76531-f93a-4d07-a0af-677167bc6455" containerName="extract"
Sep 10 22:10:59.416277 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.416224    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b76531-f93a-4d07-a0af-677167bc6455" containerName="extract"
Sep 10 22:10:59.469956 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.469928    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"]
Sep 10 22:10:59.470099 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.470031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"
Sep 10 22:10:59.472157 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.472132    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:10:59.472275 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.472191    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 22:10:59.472275 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.472196    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-x5vzt\""
Sep 10 22:10:59.571012 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.570982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a2ccf3a-a889-4dea-b233-5d7ee5b259ab-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lftfb\" (UID: \"3a2ccf3a-a889-4dea-b233-5d7ee5b259ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"
Sep 10 22:10:59.571130 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.571030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfwn7\" (UniqueName: \"kubernetes.io/projected/3a2ccf3a-a889-4dea-b233-5d7ee5b259ab-kube-api-access-hfwn7\") pod \"cert-manager-operator-controller-manager-55c444bf86-lftfb\" (UID: \"3a2ccf3a-a889-4dea-b233-5d7ee5b259ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"
Sep 10 22:10:59.671947 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.671880    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a2ccf3a-a889-4dea-b233-5d7ee5b259ab-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lftfb\" (UID: \"3a2ccf3a-a889-4dea-b233-5d7ee5b259ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"
Sep 10 22:10:59.671947 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.671937    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfwn7\" (UniqueName: \"kubernetes.io/projected/3a2ccf3a-a889-4dea-b233-5d7ee5b259ab-kube-api-access-hfwn7\") pod \"cert-manager-operator-controller-manager-55c444bf86-lftfb\" (UID: \"3a2ccf3a-a889-4dea-b233-5d7ee5b259ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"
Sep 10 22:10:59.672290 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.672269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a2ccf3a-a889-4dea-b233-5d7ee5b259ab-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lftfb\" (UID: \"3a2ccf3a-a889-4dea-b233-5d7ee5b259ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"
Sep 10 22:10:59.680648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.680614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfwn7\" (UniqueName: \"kubernetes.io/projected/3a2ccf3a-a889-4dea-b233-5d7ee5b259ab-kube-api-access-hfwn7\") pod \"cert-manager-operator-controller-manager-55c444bf86-lftfb\" (UID: \"3a2ccf3a-a889-4dea-b233-5d7ee5b259ab\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"
Sep 10 22:10:59.778736 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:10:59.778706    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"
Sep 10 22:11:00.076525 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:00.076499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb"]
Sep 10 22:11:00.078593 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:11:00.078567    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2ccf3a_a889_4dea_b233_5d7ee5b259ab.slice/crio-c025c996b79fd77fbeaa9b07c966556182ca1847fa71c8087f3b35487d8e5acd WatchSource:0}: Error finding container c025c996b79fd77fbeaa9b07c966556182ca1847fa71c8087f3b35487d8e5acd: Status 404 returned error can't find the container with id c025c996b79fd77fbeaa9b07c966556182ca1847fa71c8087f3b35487d8e5acd
Sep 10 22:11:00.086227 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:00.086202    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb" event={"ID":"3a2ccf3a-a889-4dea-b233-5d7ee5b259ab","Type":"ContainerStarted","Data":"c025c996b79fd77fbeaa9b07c966556182ca1847fa71c8087f3b35487d8e5acd"}
Sep 10 22:11:01.035429 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:01.035394    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:01.135394 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:01.135356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:03.008416 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:03.008384    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:03.100377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:03.100343    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb" event={"ID":"3a2ccf3a-a889-4dea-b233-5d7ee5b259ab","Type":"ContainerStarted","Data":"5d18102a56ead06e38f3e463cc718818b64519d40ff0606882bd30ef441f84a7"}
Sep 10 22:11:03.124927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:03.124896    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:03.133355 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:03.133244    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lftfb" podStartSLOduration=1.953609069 podStartE2EDuration="4.133225931s" totalImagesPullingTime="2.179616862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:11:03.132321887 +0000 UTC m=+343.014806254" watchObservedRunningTime="2026-09-10 22:11:03.133225931 +0000 UTC m=+343.015710299"
Sep 10 22:11:03.485461 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:03.485431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:03.593051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:03.593018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:04.074606 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.074575    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"]
Sep 10 22:11:04.099064 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.099041    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"]
Sep 10 22:11:04.099207 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.099149    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.101555 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.101533    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dttnp\""
Sep 10 22:11:04.101555 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.101544    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:11:04.101755 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.101544    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:11:04.206967 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.206923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.206967 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.206957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.207184 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.207094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd9p5\" (UniqueName: \"kubernetes.io/projected/5587e2aa-ee8e-4b86-be67-f7277454308f-kube-api-access-zd9p5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.308196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.308163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.308196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.308198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.308417 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.308240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd9p5\" (UniqueName: \"kubernetes.io/projected/5587e2aa-ee8e-4b86-be67-f7277454308f-kube-api-access-zd9p5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.308557 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.308535    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.308625 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.308603    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.316344 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.316319    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd9p5\" (UniqueName: \"kubernetes.io/projected/5587e2aa-ee8e-4b86-be67-f7277454308f-kube-api-access-zd9p5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.409967 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.409899    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:04.697033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:04.696948    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"]
Sep 10 22:11:04.699648 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:11:04.699615    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5587e2aa_ee8e_4b86_be67_f7277454308f.slice/crio-8619c51f13920df522511e9894aa536885dcffc7752a7f6d787f39f5f8b8c59a WatchSource:0}: Error finding container 8619c51f13920df522511e9894aa536885dcffc7752a7f6d787f39f5f8b8c59a: Status 404 returned error can't find the container with id 8619c51f13920df522511e9894aa536885dcffc7752a7f6d787f39f5f8b8c59a
Sep 10 22:11:05.111608 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:05.111575    2573 generic.go:356] "Generic (PLEG): container finished" podID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerID="360d2283410aa49f0296506a3fd7cef5c6ec8305732f4dee8cdb9ded205c0417" exitCode=0
Sep 10 22:11:05.111991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:05.111661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx" event={"ID":"5587e2aa-ee8e-4b86-be67-f7277454308f","Type":"ContainerDied","Data":"360d2283410aa49f0296506a3fd7cef5c6ec8305732f4dee8cdb9ded205c0417"}
Sep 10 22:11:05.111991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:05.111708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx" event={"ID":"5587e2aa-ee8e-4b86-be67-f7277454308f","Type":"ContainerStarted","Data":"8619c51f13920df522511e9894aa536885dcffc7752a7f6d787f39f5f8b8c59a"}
Sep 10 22:11:05.219691 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:05.219659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:05.636225 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:05.636200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:07.122712 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:07.122682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx" event={"ID":"5587e2aa-ee8e-4b86-be67-f7277454308f","Type":"ContainerStarted","Data":"51464edc5d5c2c2bd2f28443beec74a4041a2d159725d575501140c3ecc76dc9"}
Sep 10 22:11:08.000443 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:08.000408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:08.063021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:08.062993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:08.128278 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:08.128242    2573 generic.go:356] "Generic (PLEG): container finished" podID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerID="51464edc5d5c2c2bd2f28443beec74a4041a2d159725d575501140c3ecc76dc9" exitCode=0
Sep 10 22:11:08.128663 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:08.128302    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx" event={"ID":"5587e2aa-ee8e-4b86-be67-f7277454308f","Type":"ContainerDied","Data":"51464edc5d5c2c2bd2f28443beec74a4041a2d159725d575501140c3ecc76dc9"}
Sep 10 22:11:09.135574 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:09.135544    2573 generic.go:356] "Generic (PLEG): container finished" podID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerID="8f59327f7533279bbe0e6ee33d005ddc303a7d033e239de7058f2bfbe3e78484" exitCode=0
Sep 10 22:11:09.135975 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:09.135581    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx" event={"ID":"5587e2aa-ee8e-4b86-be67-f7277454308f","Type":"ContainerDied","Data":"8f59327f7533279bbe0e6ee33d005ddc303a7d033e239de7058f2bfbe3e78484"}
Sep 10 22:11:10.259970 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.259949    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:10.360690 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.360660    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-bundle\") pod \"5587e2aa-ee8e-4b86-be67-f7277454308f\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") "
Sep 10 22:11:10.360873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.360752    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd9p5\" (UniqueName: \"kubernetes.io/projected/5587e2aa-ee8e-4b86-be67-f7277454308f-kube-api-access-zd9p5\") pod \"5587e2aa-ee8e-4b86-be67-f7277454308f\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") "
Sep 10 22:11:10.360873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.360803    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-util\") pod \"5587e2aa-ee8e-4b86-be67-f7277454308f\" (UID: \"5587e2aa-ee8e-4b86-be67-f7277454308f\") "
Sep 10 22:11:10.361164 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.361142    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-bundle" (OuterVolumeSpecName: "bundle") pod "5587e2aa-ee8e-4b86-be67-f7277454308f" (UID: "5587e2aa-ee8e-4b86-be67-f7277454308f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:11:10.362774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.362758    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5587e2aa-ee8e-4b86-be67-f7277454308f-kube-api-access-zd9p5" (OuterVolumeSpecName: "kube-api-access-zd9p5") pod "5587e2aa-ee8e-4b86-be67-f7277454308f" (UID: "5587e2aa-ee8e-4b86-be67-f7277454308f"). InnerVolumeSpecName "kube-api-access-zd9p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:11:10.366775 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.366751    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-util" (OuterVolumeSpecName: "util") pod "5587e2aa-ee8e-4b86-be67-f7277454308f" (UID: "5587e2aa-ee8e-4b86-be67-f7277454308f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:11:10.462360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.462299    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:11:10.462360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.462323    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd9p5\" (UniqueName: \"kubernetes.io/projected/5587e2aa-ee8e-4b86-be67-f7277454308f-kube-api-access-zd9p5\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:11:10.462360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:10.462334    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5587e2aa-ee8e-4b86-be67-f7277454308f-util\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:11:11.146047 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.146017    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx"
Sep 10 22:11:11.146210 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.146022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwj8nx" event={"ID":"5587e2aa-ee8e-4b86-be67-f7277454308f","Type":"ContainerDied","Data":"8619c51f13920df522511e9894aa536885dcffc7752a7f6d787f39f5f8b8c59a"}
Sep 10 22:11:11.146210 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.146158    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8619c51f13920df522511e9894aa536885dcffc7752a7f6d787f39f5f8b8c59a"
Sep 10 22:11:11.381687 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.381648    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"]
Sep 10 22:11:11.382171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.382060    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerName="pull"
Sep 10 22:11:11.382171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.382079    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerName="pull"
Sep 10 22:11:11.382171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.382091    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerName="extract"
Sep 10 22:11:11.382171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.382099    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerName="extract"
Sep 10 22:11:11.382171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.382126    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerName="util"
Sep 10 22:11:11.382171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.382134    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerName="util"
Sep 10 22:11:11.382468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.382202    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5587e2aa-ee8e-4b86-be67-f7277454308f" containerName="extract"
Sep 10 22:11:11.386584 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.386562    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"
Sep 10 22:11:11.395365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.395332    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 22:11:11.395490 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.395396    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bwh4s\""
Sep 10 22:11:11.395490 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.395457    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 22:11:11.398056 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.398003    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"]
Sep 10 22:11:11.470555 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.470523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0084a12-7a5b-4013-9aff-5ccb2c8ce237-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-njgb6\" (UID: \"a0084a12-7a5b-4013-9aff-5ccb2c8ce237\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"
Sep 10 22:11:11.470684 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.470571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hs6x\" (UniqueName: \"kubernetes.io/projected/a0084a12-7a5b-4013-9aff-5ccb2c8ce237-kube-api-access-6hs6x\") pod \"cert-manager-cainjector-559cdd8c87-njgb6\" (UID: \"a0084a12-7a5b-4013-9aff-5ccb2c8ce237\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"
Sep 10 22:11:11.570904 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.570871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0084a12-7a5b-4013-9aff-5ccb2c8ce237-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-njgb6\" (UID: \"a0084a12-7a5b-4013-9aff-5ccb2c8ce237\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"
Sep 10 22:11:11.571056 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.570922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hs6x\" (UniqueName: \"kubernetes.io/projected/a0084a12-7a5b-4013-9aff-5ccb2c8ce237-kube-api-access-6hs6x\") pod \"cert-manager-cainjector-559cdd8c87-njgb6\" (UID: \"a0084a12-7a5b-4013-9aff-5ccb2c8ce237\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"
Sep 10 22:11:11.586621 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.586594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0084a12-7a5b-4013-9aff-5ccb2c8ce237-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-njgb6\" (UID: \"a0084a12-7a5b-4013-9aff-5ccb2c8ce237\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"
Sep 10 22:11:11.588408 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.588383    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hs6x\" (UniqueName: \"kubernetes.io/projected/a0084a12-7a5b-4013-9aff-5ccb2c8ce237-kube-api-access-6hs6x\") pod \"cert-manager-cainjector-559cdd8c87-njgb6\" (UID: \"a0084a12-7a5b-4013-9aff-5ccb2c8ce237\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"
Sep 10 22:11:11.716912 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.716829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"
Sep 10 22:11:11.990159 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:11.990127    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-njgb6"]
Sep 10 22:11:11.993426 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:11:11.993400    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0084a12_7a5b_4013_9aff_5ccb2c8ce237.slice/crio-bdc41522e898a72a2333f618f5cf55dd18f83d22e74dd4f27f29111069df2a5b WatchSource:0}: Error finding container bdc41522e898a72a2333f618f5cf55dd18f83d22e74dd4f27f29111069df2a5b: Status 404 returned error can't find the container with id bdc41522e898a72a2333f618f5cf55dd18f83d22e74dd4f27f29111069df2a5b
Sep 10 22:11:12.151659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:12.151626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6" event={"ID":"a0084a12-7a5b-4013-9aff-5ccb2c8ce237","Type":"ContainerStarted","Data":"bdc41522e898a72a2333f618f5cf55dd18f83d22e74dd4f27f29111069df2a5b"}
Sep 10 22:11:13.237161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.237080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:13.470948 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.470919    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d95dx"]
Sep 10 22:11:13.474353 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.474325    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d95dx"
Sep 10 22:11:13.476437 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.476418    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mr6bj\""
Sep 10 22:11:13.483881 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.483858    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d95dx"]
Sep 10 22:11:13.587337 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.587259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktjtj\" (UniqueName: \"kubernetes.io/projected/628361d8-754d-4a7e-9125-5e22f14596d4-kube-api-access-ktjtj\") pod \"cert-manager-55b4d954d5-d95dx\" (UID: \"628361d8-754d-4a7e-9125-5e22f14596d4\") " pod="cert-manager/cert-manager-55b4d954d5-d95dx"
Sep 10 22:11:13.587337 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.587327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628361d8-754d-4a7e-9125-5e22f14596d4-bound-sa-token\") pod \"cert-manager-55b4d954d5-d95dx\" (UID: \"628361d8-754d-4a7e-9125-5e22f14596d4\") " pod="cert-manager/cert-manager-55b4d954d5-d95dx"
Sep 10 22:11:13.687856 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.687804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktjtj\" (UniqueName: \"kubernetes.io/projected/628361d8-754d-4a7e-9125-5e22f14596d4-kube-api-access-ktjtj\") pod \"cert-manager-55b4d954d5-d95dx\" (UID: \"628361d8-754d-4a7e-9125-5e22f14596d4\") " pod="cert-manager/cert-manager-55b4d954d5-d95dx"
Sep 10 22:11:13.688015 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.687885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628361d8-754d-4a7e-9125-5e22f14596d4-bound-sa-token\") pod \"cert-manager-55b4d954d5-d95dx\" (UID: \"628361d8-754d-4a7e-9125-5e22f14596d4\") " pod="cert-manager/cert-manager-55b4d954d5-d95dx"
Sep 10 22:11:13.697565 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.697539    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628361d8-754d-4a7e-9125-5e22f14596d4-bound-sa-token\") pod \"cert-manager-55b4d954d5-d95dx\" (UID: \"628361d8-754d-4a7e-9125-5e22f14596d4\") " pod="cert-manager/cert-manager-55b4d954d5-d95dx"
Sep 10 22:11:13.697782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.697762    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktjtj\" (UniqueName: \"kubernetes.io/projected/628361d8-754d-4a7e-9125-5e22f14596d4-kube-api-access-ktjtj\") pod \"cert-manager-55b4d954d5-d95dx\" (UID: \"628361d8-754d-4a7e-9125-5e22f14596d4\") " pod="cert-manager/cert-manager-55b4d954d5-d95dx"
Sep 10 22:11:13.785367 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:13.785331    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d95dx"
Sep 10 22:11:14.556970 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:14.556898    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d95dx"]
Sep 10 22:11:14.559470 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:11:14.559441    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod628361d8_754d_4a7e_9125_5e22f14596d4.slice/crio-cbe722c9353b7290655a425cc488aa9f4fa0c8e5c1702c3242ac36c08e4934d7 WatchSource:0}: Error finding container cbe722c9353b7290655a425cc488aa9f4fa0c8e5c1702c3242ac36c08e4934d7: Status 404 returned error can't find the container with id cbe722c9353b7290655a425cc488aa9f4fa0c8e5c1702c3242ac36c08e4934d7
Sep 10 22:11:15.123429 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:15.123388    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:15.167753 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:15.167715    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6" event={"ID":"a0084a12-7a5b-4013-9aff-5ccb2c8ce237","Type":"ContainerStarted","Data":"61d6b87d65c9d3a21a7f4ca13d04cdd988a3ad0940db42f8545779ccfcc31153"}
Sep 10 22:11:15.169590 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:15.169562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d95dx" event={"ID":"628361d8-754d-4a7e-9125-5e22f14596d4","Type":"ContainerStarted","Data":"db961a8f85d65cf01c35f0aeb99f42257776f54fb1b467ba243ab0e439f6f1af"}
Sep 10 22:11:15.169710 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:15.169596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d95dx" event={"ID":"628361d8-754d-4a7e-9125-5e22f14596d4","Type":"ContainerStarted","Data":"cbe722c9353b7290655a425cc488aa9f4fa0c8e5c1702c3242ac36c08e4934d7"}
Sep 10 22:11:15.182955 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:15.182909    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-njgb6" podStartSLOduration=1.8275746499999999 podStartE2EDuration="4.182893359s" totalImagesPullingTime="2.355318709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:11:15.18216809 +0000 UTC m=+355.064652458" watchObservedRunningTime="2026-09-10 22:11:15.182893359 +0000 UTC m=+355.065377745"
Sep 10 22:11:15.198047 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:15.198005    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-d95dx" podStartSLOduration=2.197992275 podStartE2EDuration="2.197992275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:11:15.196824968 +0000 UTC m=+355.079309335" watchObservedRunningTime="2026-09-10 22:11:15.197992275 +0000 UTC m=+355.080476653"
Sep 10 22:11:15.923084 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:15.923055    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:16.018974 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:16.018936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:21.195906 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:21.195871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:21.298983 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:21.298951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:23.049866 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.049822    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"]
Sep 10 22:11:23.053418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.053399    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.055675 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.055655    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:11:23.055780 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.055656    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:11:23.056189 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.056169    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dttnp\""
Sep 10 22:11:23.060497 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.060332    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"]
Sep 10 22:11:23.161116 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.161083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.161294 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.161120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp4f2\" (UniqueName: \"kubernetes.io/projected/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-kube-api-access-mp4f2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.161294 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.161157    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.262454 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.262419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.262600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.262459    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp4f2\" (UniqueName: \"kubernetes.io/projected/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-kube-api-access-mp4f2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.262600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.262506    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.262784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.262765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.262820 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.262799    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.271526 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.271500    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp4f2\" (UniqueName: \"kubernetes.io/projected/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-kube-api-access-mp4f2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.363340 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.363277    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:23.467475 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.467446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:23.635386 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:23.635231    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"]
Sep 10 22:11:23.637942 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:11:23.637912    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6510f0_563d_41b7_bb22_9a7e3ca5f81f.slice/crio-45bdfa684ba5bf5fdee42a92a10d6b143ed759178d5f0f857e6ad5039f81f712 WatchSource:0}: Error finding container 45bdfa684ba5bf5fdee42a92a10d6b143ed759178d5f0f857e6ad5039f81f712: Status 404 returned error can't find the container with id 45bdfa684ba5bf5fdee42a92a10d6b143ed759178d5f0f857e6ad5039f81f712
Sep 10 22:11:24.208620 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:24.208588    2573 generic.go:356] "Generic (PLEG): container finished" podID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerID="c9b2c3b7e0d6bb946f295b02cad1f0361a9e5c999dbe7a5fd9761d0f178cbb2e" exitCode=0
Sep 10 22:11:24.209040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:24.208675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh" event={"ID":"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f","Type":"ContainerDied","Data":"c9b2c3b7e0d6bb946f295b02cad1f0361a9e5c999dbe7a5fd9761d0f178cbb2e"}
Sep 10 22:11:24.209040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:24.208733    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh" event={"ID":"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f","Type":"ContainerStarted","Data":"45bdfa684ba5bf5fdee42a92a10d6b143ed759178d5f0f857e6ad5039f81f712"}
Sep 10 22:11:25.110357 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:25.110273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:25.210672 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:25.210642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:25.214686 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:25.214660    2573 generic.go:356] "Generic (PLEG): container finished" podID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerID="3ea53b92eda3f640cb06aa7e85d9b26ab25fc3a549fe41236bf7ae291bd3f9e5" exitCode=0
Sep 10 22:11:25.214824 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:25.214744    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh" event={"ID":"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f","Type":"ContainerDied","Data":"3ea53b92eda3f640cb06aa7e85d9b26ab25fc3a549fe41236bf7ae291bd3f9e5"}
Sep 10 22:11:26.220888 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:26.220849    2573 generic.go:356] "Generic (PLEG): container finished" podID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerID="2661d5ccb0bb714700515b3bb874968497ab627f93c8442e8f5b06b9ab689f88" exitCode=0
Sep 10 22:11:26.221264 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:26.220934    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh" event={"ID":"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f","Type":"ContainerDied","Data":"2661d5ccb0bb714700515b3bb874968497ab627f93c8442e8f5b06b9ab689f88"}
Sep 10 22:11:27.354746 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.354724    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:27.498086 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.497995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-util\") pod \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") "
Sep 10 22:11:27.498086 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.498070    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp4f2\" (UniqueName: \"kubernetes.io/projected/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-kube-api-access-mp4f2\") pod \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") "
Sep 10 22:11:27.498318 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.498110    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-bundle\") pod \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\" (UID: \"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f\") "
Sep 10 22:11:27.498936 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.498903    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-bundle" (OuterVolumeSpecName: "bundle") pod "3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" (UID: "3a6510f0-563d-41b7-bb22-9a7e3ca5f81f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:11:27.500272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.500245    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-kube-api-access-mp4f2" (OuterVolumeSpecName: "kube-api-access-mp4f2") pod "3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" (UID: "3a6510f0-563d-41b7-bb22-9a7e3ca5f81f"). InnerVolumeSpecName "kube-api-access-mp4f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:11:27.505224 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.505115    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-util" (OuterVolumeSpecName: "util") pod "3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" (UID: "3a6510f0-563d-41b7-bb22-9a7e3ca5f81f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:11:27.599358 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.599329    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-util\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:11:27.599358 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.599354    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp4f2\" (UniqueName: \"kubernetes.io/projected/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-kube-api-access-mp4f2\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:11:27.599502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:27.599364    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a6510f0-563d-41b7-bb22-9a7e3ca5f81f-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:11:28.232344 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:28.232318    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh"
Sep 10 22:11:28.232501 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:28.232349    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhlngh" event={"ID":"3a6510f0-563d-41b7-bb22-9a7e3ca5f81f","Type":"ContainerDied","Data":"45bdfa684ba5bf5fdee42a92a10d6b143ed759178d5f0f857e6ad5039f81f712"}
Sep 10 22:11:28.232501 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:28.232392    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45bdfa684ba5bf5fdee42a92a10d6b143ed759178d5f0f857e6ad5039f81f712"
Sep 10 22:11:34.262513 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.262480    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"]
Sep 10 22:11:34.262893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.262766    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerName="extract"
Sep 10 22:11:34.262893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.262779    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerName="extract"
Sep 10 22:11:34.262893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.262800    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerName="util"
Sep 10 22:11:34.262893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.262806    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerName="util"
Sep 10 22:11:34.262893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.262812    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerName="pull"
Sep 10 22:11:34.262893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.262817    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerName="pull"
Sep 10 22:11:34.262893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.262894    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a6510f0-563d-41b7-bb22-9a7e3ca5f81f" containerName="extract"
Sep 10 22:11:34.268696 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.268676    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.270827 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.270806    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:11:34.271296 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.271279    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:11:34.271384 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.271298    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dttnp\""
Sep 10 22:11:34.274032 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.274008    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"]
Sep 10 22:11:34.453910 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.453875    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.454067 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.453944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq2gk\" (UniqueName: \"kubernetes.io/projected/a324c94f-d98f-4bf3-91b3-90309627754b-kube-api-access-tq2gk\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.454067 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.454039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.554894 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.554817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.555029 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.554899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq2gk\" (UniqueName: \"kubernetes.io/projected/a324c94f-d98f-4bf3-91b3-90309627754b-kube-api-access-tq2gk\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.555029 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.554937    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.555187 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.555168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.555228 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.555202    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.567788 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.567768    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq2gk\" (UniqueName: \"kubernetes.io/projected/a324c94f-d98f-4bf3-91b3-90309627754b-kube-api-access-tq2gk\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.578589 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.578570    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:34.852115 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:34.852082    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"]
Sep 10 22:11:34.854618 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:11:34.854593    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda324c94f_d98f_4bf3_91b3_90309627754b.slice/crio-a1fb796aba1ad8f928fa8faa657a1cd16bf0416a81cbf516891202026a76d332 WatchSource:0}: Error finding container a1fb796aba1ad8f928fa8faa657a1cd16bf0416a81cbf516891202026a76d332: Status 404 returned error can't find the container with id a1fb796aba1ad8f928fa8faa657a1cd16bf0416a81cbf516891202026a76d332
Sep 10 22:11:35.078821 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:35.078789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:35.245329 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:35.245300    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:35.265491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:35.265461    2573 generic.go:356] "Generic (PLEG): container finished" podID="a324c94f-d98f-4bf3-91b3-90309627754b" containerID="6e5b7d6c6c9549f7eeb673c038fd7e4d67b015a09b47b6aca679583dcc5a6145" exitCode=0
Sep 10 22:11:35.265830 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:35.265526    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w" event={"ID":"a324c94f-d98f-4bf3-91b3-90309627754b","Type":"ContainerDied","Data":"6e5b7d6c6c9549f7eeb673c038fd7e4d67b015a09b47b6aca679583dcc5a6145"}
Sep 10 22:11:35.265830 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:35.265578    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w" event={"ID":"a324c94f-d98f-4bf3-91b3-90309627754b","Type":"ContainerStarted","Data":"a1fb796aba1ad8f928fa8faa657a1cd16bf0416a81cbf516891202026a76d332"}
Sep 10 22:11:35.614338 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:35.614310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:35.855080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:35.855056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:35.957383 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:35.957351    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:35.998846 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:35.998818    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"]
Sep 10 22:11:36.002134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.002115    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.004688 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.004669    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 22:11:36.004812 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.004791    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4v29l\""
Sep 10 22:11:36.004974 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.004957    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 22:11:36.005184 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.005167    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 22:11:36.005263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.005255    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 22:11:36.023431 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.023407    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"]
Sep 10 22:11:36.168362 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.168280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f55faeca-5a5f-4513-ac52-ef9bb299bb84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.168362 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.168318    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f55faeca-5a5f-4513-ac52-ef9bb299bb84-tmp\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.168362 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.168339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f55faeca-5a5f-4513-ac52-ef9bb299bb84-webhook-cert\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.168604 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.168414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sq2x\" (UniqueName: \"kubernetes.io/projected/f55faeca-5a5f-4513-ac52-ef9bb299bb84-kube-api-access-7sq2x\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.168604 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.168486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f55faeca-5a5f-4513-ac52-ef9bb299bb84-manifests\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.208040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.207999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:36.268871 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.268824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f55faeca-5a5f-4513-ac52-ef9bb299bb84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.268871 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.268873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f55faeca-5a5f-4513-ac52-ef9bb299bb84-tmp\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.269261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.268893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f55faeca-5a5f-4513-ac52-ef9bb299bb84-webhook-cert\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.269261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.268931    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sq2x\" (UniqueName: \"kubernetes.io/projected/f55faeca-5a5f-4513-ac52-ef9bb299bb84-kube-api-access-7sq2x\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.269261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.269044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f55faeca-5a5f-4513-ac52-ef9bb299bb84-manifests\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.269507 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.269485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f55faeca-5a5f-4513-ac52-ef9bb299bb84-manifests\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.271415 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.271388    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f55faeca-5a5f-4513-ac52-ef9bb299bb84-tmp\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.271597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.271580    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f55faeca-5a5f-4513-ac52-ef9bb299bb84-webhook-cert\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.271667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.271649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f55faeca-5a5f-4513-ac52-ef9bb299bb84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.272147 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.272126    2573 generic.go:356] "Generic (PLEG): container finished" podID="a324c94f-d98f-4bf3-91b3-90309627754b" containerID="910eb13b72c46cd82993856b7d7a476c2ea3e2fcb25804ef4ba40a8bce7b7fb0" exitCode=0
Sep 10 22:11:36.272228 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.272205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w" event={"ID":"a324c94f-d98f-4bf3-91b3-90309627754b","Type":"ContainerDied","Data":"910eb13b72c46cd82993856b7d7a476c2ea3e2fcb25804ef4ba40a8bce7b7fb0"}
Sep 10 22:11:36.278088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.278067    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sq2x\" (UniqueName: \"kubernetes.io/projected/f55faeca-5a5f-4513-ac52-ef9bb299bb84-kube-api-access-7sq2x\") pod \"opendatahub-operator-controller-manager-995c55587-gtrgf\" (UID: \"f55faeca-5a5f-4513-ac52-ef9bb299bb84\") " pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.292706 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.292686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:36.312391 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.312372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:36.360868 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.360794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:36.455593 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.455555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:36.555008 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.554976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:36.608693 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.608631    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"]
Sep 10 22:11:36.611451 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:11:36.611426    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55faeca_5a5f_4513_ac52_ef9bb299bb84.slice/crio-db7fae1792e1a24a2e2e912d15234550709779d6b8310bbe351d8b7a4273a6a6 WatchSource:0}: Error finding container db7fae1792e1a24a2e2e912d15234550709779d6b8310bbe351d8b7a4273a6a6: Status 404 returned error can't find the container with id db7fae1792e1a24a2e2e912d15234550709779d6b8310bbe351d8b7a4273a6a6
Sep 10 22:11:36.653434 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:36.653409    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:37.282231 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:37.282191    2573 generic.go:356] "Generic (PLEG): container finished" podID="a324c94f-d98f-4bf3-91b3-90309627754b" containerID="67b322a759bb3e9c47c86b5e26772474753a326ff2fced2dcf25cf9f32f924b1" exitCode=0
Sep 10 22:11:37.283368 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:37.282373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w" event={"ID":"a324c94f-d98f-4bf3-91b3-90309627754b","Type":"ContainerDied","Data":"67b322a759bb3e9c47c86b5e26772474753a326ff2fced2dcf25cf9f32f924b1"}
Sep 10 22:11:37.284644 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:37.284618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf" event={"ID":"f55faeca-5a5f-4513-ac52-ef9bb299bb84","Type":"ContainerStarted","Data":"db7fae1792e1a24a2e2e912d15234550709779d6b8310bbe351d8b7a4273a6a6"}
Sep 10 22:11:37.784108 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:37.784071    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:37.875551 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:37.875502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:38.578749 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.578709    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:38.592813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.592785    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-util\") pod \"a324c94f-d98f-4bf3-91b3-90309627754b\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") "
Sep 10 22:11:38.592972 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.592822    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq2gk\" (UniqueName: \"kubernetes.io/projected/a324c94f-d98f-4bf3-91b3-90309627754b-kube-api-access-tq2gk\") pod \"a324c94f-d98f-4bf3-91b3-90309627754b\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") "
Sep 10 22:11:38.592972 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.592903    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-bundle\") pod \"a324c94f-d98f-4bf3-91b3-90309627754b\" (UID: \"a324c94f-d98f-4bf3-91b3-90309627754b\") "
Sep 10 22:11:38.593780 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.593731    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-bundle" (OuterVolumeSpecName: "bundle") pod "a324c94f-d98f-4bf3-91b3-90309627754b" (UID: "a324c94f-d98f-4bf3-91b3-90309627754b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:11:38.596182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.596092    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a324c94f-d98f-4bf3-91b3-90309627754b-kube-api-access-tq2gk" (OuterVolumeSpecName: "kube-api-access-tq2gk") pod "a324c94f-d98f-4bf3-91b3-90309627754b" (UID: "a324c94f-d98f-4bf3-91b3-90309627754b"). InnerVolumeSpecName "kube-api-access-tq2gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:11:38.600863 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.600822    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-util" (OuterVolumeSpecName: "util") pod "a324c94f-d98f-4bf3-91b3-90309627754b" (UID: "a324c94f-d98f-4bf3-91b3-90309627754b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:11:38.693786 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.693752    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:11:38.693786 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.693783    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a324c94f-d98f-4bf3-91b3-90309627754b-util\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:11:38.693786 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:38.693795    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq2gk\" (UniqueName: \"kubernetes.io/projected/a324c94f-d98f-4bf3-91b3-90309627754b-kube-api-access-tq2gk\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:11:39.298099 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:39.298058    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w" event={"ID":"a324c94f-d98f-4bf3-91b3-90309627754b","Type":"ContainerDied","Data":"a1fb796aba1ad8f928fa8faa657a1cd16bf0416a81cbf516891202026a76d332"}
Sep 10 22:11:39.298099 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:39.298089    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b08cn6w"
Sep 10 22:11:39.298365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:39.298117    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1fb796aba1ad8f928fa8faa657a1cd16bf0416a81cbf516891202026a76d332"
Sep 10 22:11:40.305010 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:40.304973    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf" event={"ID":"f55faeca-5a5f-4513-ac52-ef9bb299bb84","Type":"ContainerStarted","Data":"8970cdddbcda5cd7e3af19e50d138c87e0f59f86e005766f85782f5344fbe432"}
Sep 10 22:11:41.310785 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:41.310748    2573 generic.go:356] "Generic (PLEG): container finished" podID="f55faeca-5a5f-4513-ac52-ef9bb299bb84" containerID="8970cdddbcda5cd7e3af19e50d138c87e0f59f86e005766f85782f5344fbe432" exitCode=0
Sep 10 22:11:41.311279 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:41.310801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf" event={"ID":"f55faeca-5a5f-4513-ac52-ef9bb299bb84","Type":"ContainerDied","Data":"8970cdddbcda5cd7e3af19e50d138c87e0f59f86e005766f85782f5344fbe432"}
Sep 10 22:11:42.317046 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:42.317012    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf" event={"ID":"f55faeca-5a5f-4513-ac52-ef9bb299bb84","Type":"ContainerStarted","Data":"574f2c8f8afddddc0ff464d31d4f34d2104e64686c9e7d057f2ca7836758d116"}
Sep 10 22:11:42.317440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:42.317105    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:42.342395 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:42.342351    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf" podStartSLOduration=2.848359076 podStartE2EDuration="7.34233827s" totalImagesPullingTime="3.40554292s" totalInitContainerRuntime="1.088436274s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:11:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:11:42.341450695 +0000 UTC m=+382.223935074" watchObservedRunningTime="2026-09-10 22:11:42.34233827 +0000 UTC m=+382.224822635"
Sep 10 22:11:50.392508 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.392473    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8d48d9f4-ssjwc"]
Sep 10 22:11:50.393002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.392798    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a324c94f-d98f-4bf3-91b3-90309627754b" containerName="pull"
Sep 10 22:11:50.393002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.392811    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a324c94f-d98f-4bf3-91b3-90309627754b" containerName="pull"
Sep 10 22:11:50.393002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.392823    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a324c94f-d98f-4bf3-91b3-90309627754b" containerName="util"
Sep 10 22:11:50.393002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.392828    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a324c94f-d98f-4bf3-91b3-90309627754b" containerName="util"
Sep 10 22:11:50.393002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.392854    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a324c94f-d98f-4bf3-91b3-90309627754b" containerName="extract"
Sep 10 22:11:50.393002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.392862    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a324c94f-d98f-4bf3-91b3-90309627754b" containerName="extract"
Sep 10 22:11:50.393002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.392951    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a324c94f-d98f-4bf3-91b3-90309627754b" containerName="extract"
Sep 10 22:11:50.398609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.398583    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.407442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.407421    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8d48d9f4-ssjwc"]
Sep 10 22:11:50.446989 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.446961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:50.485319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.485294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64205144-82ee-4d29-934c-a7d88785ff6a-console-oauth-config\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.485420 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.485335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-service-ca\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.485420 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.485359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-console-config\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.485487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.485429    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64205144-82ee-4d29-934c-a7d88785ff6a-console-serving-cert\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.485487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.485453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj85s\" (UniqueName: \"kubernetes.io/projected/64205144-82ee-4d29-934c-a7d88785ff6a-kube-api-access-vj85s\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.485553 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.485499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-trusted-ca-bundle\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.485553 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.485532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-oauth-serving-cert\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.506211 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.506188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:50.586043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-service-ca\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.586202 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-console-config\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.586202 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586079    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64205144-82ee-4d29-934c-a7d88785ff6a-console-serving-cert\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.586202 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj85s\" (UniqueName: \"kubernetes.io/projected/64205144-82ee-4d29-934c-a7d88785ff6a-kube-api-access-vj85s\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.586202 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-trusted-ca-bundle\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.586202 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-oauth-serving-cert\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.586455 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64205144-82ee-4d29-934c-a7d88785ff6a-console-oauth-config\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.586896 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-console-config\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.586896 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586884    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-oauth-serving-cert\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.587036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.586873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-service-ca\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.587138 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.587113    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64205144-82ee-4d29-934c-a7d88785ff6a-trusted-ca-bundle\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.588636 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.588617    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64205144-82ee-4d29-934c-a7d88785ff6a-console-serving-cert\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.588684 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.588637    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64205144-82ee-4d29-934c-a7d88785ff6a-console-oauth-config\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.594421 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.594393    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj85s\" (UniqueName: \"kubernetes.io/projected/64205144-82ee-4d29-934c-a7d88785ff6a-kube-api-access-vj85s\") pod \"console-7d8d48d9f4-ssjwc\" (UID: \"64205144-82ee-4d29-934c-a7d88785ff6a\") " pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.709296 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.709225    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:11:50.981758 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:50.981727    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8d48d9f4-ssjwc"]
Sep 10 22:11:50.985077 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:11:50.985053    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64205144_82ee_4d29_934c_a7d88785ff6a.slice/crio-637dc049243e68203030a1bab8d60486d30697807a0c14a0d538dacaa6e79420 WatchSource:0}: Error finding container 637dc049243e68203030a1bab8d60486d30697807a0c14a0d538dacaa6e79420: Status 404 returned error can't find the container with id 637dc049243e68203030a1bab8d60486d30697807a0c14a0d538dacaa6e79420
Sep 10 22:11:51.357633 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:51.357546    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8d48d9f4-ssjwc" event={"ID":"64205144-82ee-4d29-934c-a7d88785ff6a","Type":"ContainerStarted","Data":"169608ae54f64bc289b35571ac7fdeb771953bad0235dad93b7455f09d816bba"}
Sep 10 22:11:51.357633 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:51.357596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8d48d9f4-ssjwc" event={"ID":"64205144-82ee-4d29-934c-a7d88785ff6a","Type":"ContainerStarted","Data":"637dc049243e68203030a1bab8d60486d30697807a0c14a0d538dacaa6e79420"}
Sep 10 22:11:51.387346 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:51.387297    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d8d48d9f4-ssjwc" podStartSLOduration=1.387282519 podStartE2EDuration="1.387282519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:11:51.38537663 +0000 UTC m=+391.267861008" watchObservedRunningTime="2026-09-10 22:11:51.387282519 +0000 UTC m=+391.269766885"
Sep 10 22:11:52.760812 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:52.760778    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:52.828725 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:52.828692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:53.324253 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:53.324226    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-995c55587-gtrgf"
Sep 10 22:11:55.291133 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:55.291096    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:55.393747 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:55.393714    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:11:56.174751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.174718    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"]
Sep 10 22:11:56.178107 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.178091    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.180524 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.180506    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 22:11:56.181487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.181464    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 22:11:56.181487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.181464    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-52gnx\""
Sep 10 22:11:56.181630 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.181535    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 22:11:56.181630 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.181557    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:11:56.181630 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.181570    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 22:11:56.189419 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.189397    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"]
Sep 10 22:11:56.235061 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.235035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-metrics-cert\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.235170 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.235066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4p68\" (UniqueName: \"kubernetes.io/projected/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-kube-api-access-m4p68\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.235170 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.235086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-manager-config\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.235245 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.235192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-cert\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.335670 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.335644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-metrics-cert\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.336072 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.335678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4p68\" (UniqueName: \"kubernetes.io/projected/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-kube-api-access-m4p68\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.336072 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.335699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-manager-config\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.336072 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.335736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-cert\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.336512 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.336489    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-manager-config\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.338138 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.338117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-cert\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.338222 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.338179    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-metrics-cert\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.347071 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.347048    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4p68\" (UniqueName: \"kubernetes.io/projected/4b888925-3e16-4a7b-94bf-d1b98c5a2b17-kube-api-access-m4p68\") pod \"lws-controller-manager-578b4977d8-qvlq5\" (UID: \"4b888925-3e16-4a7b-94bf-d1b98c5a2b17\") " pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.487739 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.487710    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:56.756617 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:56.756595    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"]
Sep 10 22:11:56.759074 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:11:56.759047    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b888925_3e16_4a7b_94bf_d1b98c5a2b17.slice/crio-da7944c309c81f3d4ab49b3184418f843e8e70ea48442b3d66755ee7ae2f23a0 WatchSource:0}: Error finding container da7944c309c81f3d4ab49b3184418f843e8e70ea48442b3d66755ee7ae2f23a0: Status 404 returned error can't find the container with id da7944c309c81f3d4ab49b3184418f843e8e70ea48442b3d66755ee7ae2f23a0
Sep 10 22:11:57.390368 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:57.390332    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5" event={"ID":"4b888925-3e16-4a7b-94bf-d1b98c5a2b17","Type":"ContainerStarted","Data":"da7944c309c81f3d4ab49b3184418f843e8e70ea48442b3d66755ee7ae2f23a0"}
Sep 10 22:11:58.397371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:58.397280    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5" event={"ID":"4b888925-3e16-4a7b-94bf-d1b98c5a2b17","Type":"ContainerStarted","Data":"5cf46d697a301d6947f66f7cc9b4933f7da2fe1d15537f8acf4f116c8c41413e"}
Sep 10 22:11:58.397371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:58.397337    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:11:58.413034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:11:58.412987    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5" podStartSLOduration=1.195543437 podStartE2EDuration="2.412972909s" totalImagesPullingTime="1.217429472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:11:58.411398545 +0000 UTC m=+398.293882911" watchObservedRunningTime="2026-09-10 22:11:58.412972909 +0000 UTC m=+398.295457266"
Sep 10 22:12:00.710005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:00.709977    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:12:00.710411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:00.710028    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:12:00.715006 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:00.714986    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:12:01.415586 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:01.415555    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d8d48d9f4-ssjwc"
Sep 10 22:12:01.460016 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:01.459982    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7dbb6785-npm9t"]
Sep 10 22:12:01.566779 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:01.566750    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:01.619543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:01.619476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:01.674470 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:01.674401    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:06.060149 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:06.060072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:06.174038 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:06.173997    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:07.334599 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:07.334546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:07.399053 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:07.399018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:07.804163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:07.804124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:07.860967 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:07.860928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:08.264892 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:08.264824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:09.405280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:09.405247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-578b4977d8-qvlq5"
Sep 10 22:12:09.877802 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:09.877773    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:09.966196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:09.966158    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:11.267011 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:11.266978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:11.368272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:11.368237    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:12.156948 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.156912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:12.242726 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.242655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:12.408901 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.408810    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"]
Sep 10 22:12:12.418751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.418727    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.422476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.422450    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ljcws\""
Sep 10 22:12:12.422601 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.422496    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 22:12:12.431865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.431827    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"]
Sep 10 22:12:12.463248 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.463216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:12.574376 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.574348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bv6q\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-kube-api-access-7bv6q\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.574557 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.574392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.574557 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.574418    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65049cde-26b9-439b-81ef-9d2f45663043-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.574557 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.574468    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.574557 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.574535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.574731 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.574563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.574731 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.574595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.574731 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.574631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.574731 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.574646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65049cde-26b9-439b-81ef-9d2f45663043-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.644791 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.644758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:12.675924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.675827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.675924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.675903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.675924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.675920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65049cde-26b9-439b-81ef-9d2f45663043-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.675964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bv6q\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-kube-api-access-7bv6q\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.675995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.676021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65049cde-26b9-439b-81ef-9d2f45663043-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.676062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.676121    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.676151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676584 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.676555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676697 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.676635    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676697 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.676665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676778 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.676696    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.676922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.676901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65049cde-26b9-439b-81ef-9d2f45663043-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.678452 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.678428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.678572 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.678554    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65049cde-26b9-439b-81ef-9d2f45663043-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.685589 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.685565    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.686707 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.686687    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bv6q\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-kube-api-access-7bv6q\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.728720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.728697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:12.765359 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:12.765332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:13.008582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:13.008560    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"]
Sep 10 22:12:13.010578 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:12:13.010552    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65049cde_26b9_439b_81ef_9d2f45663043.slice/crio-124ed1fe96be53d30b8f8c10353d339cb6e6d3dc6a364a5e310b00ed25f529fd WatchSource:0}: Error finding container 124ed1fe96be53d30b8f8c10353d339cb6e6d3dc6a364a5e310b00ed25f529fd: Status 404 returned error can't find the container with id 124ed1fe96be53d30b8f8c10353d339cb6e6d3dc6a364a5e310b00ed25f529fd
Sep 10 22:12:13.471498 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:13.471468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf" event={"ID":"65049cde-26b9-439b-81ef-9d2f45663043","Type":"ContainerStarted","Data":"124ed1fe96be53d30b8f8c10353d339cb6e6d3dc6a364a5e310b00ed25f529fd"}
Sep 10 22:12:16.073835 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.073797    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:12:16.074101 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.073890    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:12:16.074101 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.073923    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:12:16.467402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.467326    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-krh5h"]
Sep 10 22:12:16.471243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.471217    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:16.473793 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.473576    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-m6g2b\""
Sep 10 22:12:16.473793 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.473658    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 22:12:16.483867 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.483820    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-krh5h"]
Sep 10 22:12:16.491542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.491514    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf" event={"ID":"65049cde-26b9-439b-81ef-9d2f45663043","Type":"ContainerStarted","Data":"42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5"}
Sep 10 22:12:16.495033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.494999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:16.514443 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.514387    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf" podStartSLOduration=1.453433814 podStartE2EDuration="4.514371916s" totalImagesPullingTime="3.060938102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:12:16.511907718 +0000 UTC m=+416.394392083" watchObservedRunningTime="2026-09-10 22:12:16.514371916 +0000 UTC m=+416.396856281"
Sep 10 22:12:16.592305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.592275    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:16.610796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.610767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bdce8c4-19ce-40a6-b655-4d553eb343f7-cert\") pod \"odh-model-controller-7998c67dc4-krh5h\" (UID: \"6bdce8c4-19ce-40a6-b655-4d553eb343f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:16.610949 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.610902    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26h88\" (UniqueName: \"kubernetes.io/projected/6bdce8c4-19ce-40a6-b655-4d553eb343f7-kube-api-access-26h88\") pod \"odh-model-controller-7998c67dc4-krh5h\" (UID: \"6bdce8c4-19ce-40a6-b655-4d553eb343f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:16.712196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.712160    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26h88\" (UniqueName: \"kubernetes.io/projected/6bdce8c4-19ce-40a6-b655-4d553eb343f7-kube-api-access-26h88\") pod \"odh-model-controller-7998c67dc4-krh5h\" (UID: \"6bdce8c4-19ce-40a6-b655-4d553eb343f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:16.712349 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.712268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bdce8c4-19ce-40a6-b655-4d553eb343f7-cert\") pod \"odh-model-controller-7998c67dc4-krh5h\" (UID: \"6bdce8c4-19ce-40a6-b655-4d553eb343f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:16.712438 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:12:16.712415    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 22:12:16.712520 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:12:16.712507    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bdce8c4-19ce-40a6-b655-4d553eb343f7-cert podName:6bdce8c4-19ce-40a6-b655-4d553eb343f7 nodeName:}" failed. No retries permitted until 2026-09-10 22:12:17.212484571 +0000 UTC m=+417.094968938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6bdce8c4-19ce-40a6-b655-4d553eb343f7-cert") pod "odh-model-controller-7998c67dc4-krh5h" (UID: "6bdce8c4-19ce-40a6-b655-4d553eb343f7") : secret "odh-model-controller-webhook-cert" not found
Sep 10 22:12:16.720199 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.720146    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26h88\" (UniqueName: \"kubernetes.io/projected/6bdce8c4-19ce-40a6-b655-4d553eb343f7-kube-api-access-26h88\") pod \"odh-model-controller-7998c67dc4-krh5h\" (UID: \"6bdce8c4-19ce-40a6-b655-4d553eb343f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:16.728803 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.728786    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:16.916527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.916495    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8x68v"]
Sep 10 22:12:16.919872 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.919854    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:16.921879 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.921861    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 22:12:16.930904 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.930883    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8x68v"]
Sep 10 22:12:16.936562 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:16.936536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:17.014229 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.014202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:17.015370 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.015352    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqzpr\" (UniqueName: \"kubernetes.io/projected/9bf6d489-fd48-4085-985a-1e5fe937a1e1-kube-api-access-bqzpr\") pod \"model-serving-api-54d89bd5fc-8x68v\" (UID: \"9bf6d489-fd48-4085-985a-1e5fe937a1e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:17.015432 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.015411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf6d489-fd48-4085-985a-1e5fe937a1e1-tls-certs\") pod \"model-serving-api-54d89bd5fc-8x68v\" (UID: \"9bf6d489-fd48-4085-985a-1e5fe937a1e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:17.087216 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.087191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:17.116391 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.116362    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzpr\" (UniqueName: \"kubernetes.io/projected/9bf6d489-fd48-4085-985a-1e5fe937a1e1-kube-api-access-bqzpr\") pod \"model-serving-api-54d89bd5fc-8x68v\" (UID: \"9bf6d489-fd48-4085-985a-1e5fe937a1e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:17.116498 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.116431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf6d489-fd48-4085-985a-1e5fe937a1e1-tls-certs\") pod \"model-serving-api-54d89bd5fc-8x68v\" (UID: \"9bf6d489-fd48-4085-985a-1e5fe937a1e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:17.118727 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.118706    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf6d489-fd48-4085-985a-1e5fe937a1e1-tls-certs\") pod \"model-serving-api-54d89bd5fc-8x68v\" (UID: \"9bf6d489-fd48-4085-985a-1e5fe937a1e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:17.124691 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.124661    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqzpr\" (UniqueName: \"kubernetes.io/projected/9bf6d489-fd48-4085-985a-1e5fe937a1e1-kube-api-access-bqzpr\") pod \"model-serving-api-54d89bd5fc-8x68v\" (UID: \"9bf6d489-fd48-4085-985a-1e5fe937a1e1\") " pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:17.216883 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.216853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bdce8c4-19ce-40a6-b655-4d553eb343f7-cert\") pod \"odh-model-controller-7998c67dc4-krh5h\" (UID: \"6bdce8c4-19ce-40a6-b655-4d553eb343f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:17.219113 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.219079    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bdce8c4-19ce-40a6-b655-4d553eb343f7-cert\") pod \"odh-model-controller-7998c67dc4-krh5h\" (UID: \"6bdce8c4-19ce-40a6-b655-4d553eb343f7\") " pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:17.230241 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.230220    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:17.386834 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.386794    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:17.500176 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.500020    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8x68v"]
Sep 10 22:12:17.502676 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:12:17.502653    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf6d489_fd48_4085_985a_1e5fe937a1e1.slice/crio-1de7efede7d9e85686cab187113ad87c1c9019023d95f1cfd30c8ecfb80b1b3d WatchSource:0}: Error finding container 1de7efede7d9e85686cab187113ad87c1c9019023d95f1cfd30c8ecfb80b1b3d: Status 404 returned error can't find the container with id 1de7efede7d9e85686cab187113ad87c1c9019023d95f1cfd30c8ecfb80b1b3d
Sep 10 22:12:17.656374 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.656350    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-krh5h"]
Sep 10 22:12:17.658687 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:12:17.658652    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bdce8c4_19ce_40a6_b655_4d553eb343f7.slice/crio-42ac872965407eedb01b49ff3d92f177ee006848a2e777b139a2d9a3f37ec73d WatchSource:0}: Error finding container 42ac872965407eedb01b49ff3d92f177ee006848a2e777b139a2d9a3f37ec73d: Status 404 returned error can't find the container with id 42ac872965407eedb01b49ff3d92f177ee006848a2e777b139a2d9a3f37ec73d
Sep 10 22:12:17.730197 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.730171    2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 10 22:12:17.730311 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.730216    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf" podUID="65049cde-26b9-439b-81ef-9d2f45663043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 10 22:12:17.772682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:17.772653    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"]
Sep 10 22:12:18.506547 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:18.506462    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-krh5h" event={"ID":"6bdce8c4-19ce-40a6-b655-4d553eb343f7","Type":"ContainerStarted","Data":"42ac872965407eedb01b49ff3d92f177ee006848a2e777b139a2d9a3f37ec73d"}
Sep 10 22:12:18.508866 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:18.508757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8x68v" event={"ID":"9bf6d489-fd48-4085-985a-1e5fe937a1e1","Type":"ContainerStarted","Data":"1de7efede7d9e85686cab187113ad87c1c9019023d95f1cfd30c8ecfb80b1b3d"}
Sep 10 22:12:18.730015 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:18.729921    2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 10 22:12:18.730015 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:18.729982    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf" podUID="65049cde-26b9-439b-81ef-9d2f45663043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 10 22:12:19.514220 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:19.514176    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf" podUID="65049cde-26b9-439b-81ef-9d2f45663043" containerName="istio-proxy" containerID="cri-o://42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5" gracePeriod=30
Sep 10 22:12:21.528595 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:21.528559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-krh5h" event={"ID":"6bdce8c4-19ce-40a6-b655-4d553eb343f7","Type":"ContainerStarted","Data":"463fa75cdbd6e20131be4f4ac8e4afe5e88f062f25e7701b48ec3eb02ce016c6"}
Sep 10 22:12:21.529086 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:21.528670    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:21.530140 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:21.530117    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8x68v" event={"ID":"9bf6d489-fd48-4085-985a-1e5fe937a1e1","Type":"ContainerStarted","Data":"fe5fdeb691a546b3e1cb99ac0de6fe43d43382ce7ff9d900daa6ed548a8cbf57"}
Sep 10 22:12:21.530260 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:21.530177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:21.558536 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:21.558485    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-krh5h" podStartSLOduration=1.806253664 podStartE2EDuration="5.558471066s" totalImagesPullingTime="3.752217402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:12:21.555751527 +0000 UTC m=+421.438235915" watchObservedRunningTime="2026-09-10 22:12:21.558471066 +0000 UTC m=+421.440955450"
Sep 10 22:12:21.575684 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:21.575636    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-8x68v" podStartSLOduration=1.717898202 podStartE2EDuration="5.575620344s" totalImagesPullingTime="3.857722142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:12:21.575372868 +0000 UTC m=+421.457857234" watchObservedRunningTime="2026-09-10 22:12:21.575620344 +0000 UTC m=+421.458104712"
Sep 10 22:12:23.908045 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:23.908012    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"]
Sep 10 22:12:23.911498 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:23.911477    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:23.913615 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:23.913586    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 22:12:23.913615 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:23.913599    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 22:12:23.913615 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:23.913586    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 22:12:23.914335 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:23.914314    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5548b\""
Sep 10 22:12:23.928479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:23.928461    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"]
Sep 10 22:12:24.079865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.079810    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.080031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.079878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5lcs\" (UniqueName: \"kubernetes.io/projected/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-kube-api-access-j5lcs\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.080031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.079929    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.080031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.079962    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.080031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.079993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.080031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.080017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.080220 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.080045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.180943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.180858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.180943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.180923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lcs\" (UniqueName: \"kubernetes.io/projected/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-kube-api-access-j5lcs\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.180943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.180946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.181198 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.180967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.181198 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.181005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.181198 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.181033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.181198 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.181072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.181914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.181880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.183348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.183316    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.183348 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.183344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.183486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.183384    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.183486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.183463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.190938 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.190911    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.191185 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.191165    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5lcs\" (UniqueName: \"kubernetes.io/projected/ea17a3f9-55d8-4052-aca0-14711fbe4fdd-kube-api-access-j5lcs\") pod \"istiod-openshift-gateway-5677ccb49b-vhvfq\" (UID: \"ea17a3f9-55d8-4052-aca0-14711fbe4fdd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.220980 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.220959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:24.521368 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.521325    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"]
Sep 10 22:12:24.529631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:12:24.529594    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea17a3f9_55d8_4052_aca0_14711fbe4fdd.slice/crio-4d2d7d50d7dbea462c07e4cdb1809710175716ccf8f1b34272df39f43380c65b WatchSource:0}: Error finding container 4d2d7d50d7dbea462c07e4cdb1809710175716ccf8f1b34272df39f43380c65b: Status 404 returned error can't find the container with id 4d2d7d50d7dbea462c07e4cdb1809710175716ccf8f1b34272df39f43380c65b
Sep 10 22:12:24.546500 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.546262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq" event={"ID":"ea17a3f9-55d8-4052-aca0-14711fbe4fdd","Type":"ContainerStarted","Data":"4d2d7d50d7dbea462c07e4cdb1809710175716ccf8f1b34272df39f43380c65b"}
Sep 10 22:12:24.763683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.763658    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:24.887963 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.887887    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-credential-socket\") pod \"65049cde-26b9-439b-81ef-9d2f45663043\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") "
Sep 10 22:12:24.887963 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.887931    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65049cde-26b9-439b-81ef-9d2f45663043-istiod-ca-cert\") pod \"65049cde-26b9-439b-81ef-9d2f45663043\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") "
Sep 10 22:12:24.888153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.887973    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65049cde-26b9-439b-81ef-9d2f45663043-istio-podinfo\") pod \"65049cde-26b9-439b-81ef-9d2f45663043\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") "
Sep 10 22:12:24.888153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.887992    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-certs\") pod \"65049cde-26b9-439b-81ef-9d2f45663043\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") "
Sep 10 22:12:24.888153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888016    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-data\") pod \"65049cde-26b9-439b-81ef-9d2f45663043\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") "
Sep 10 22:12:24.888153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888080    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-envoy\") pod \"65049cde-26b9-439b-81ef-9d2f45663043\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") "
Sep 10 22:12:24.888153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888109    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bv6q\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-kube-api-access-7bv6q\") pod \"65049cde-26b9-439b-81ef-9d2f45663043\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") "
Sep 10 22:12:24.888153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888134    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-socket\") pod \"65049cde-26b9-439b-81ef-9d2f45663043\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") "
Sep 10 22:12:24.888430 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888171    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-istio-token\") pod \"65049cde-26b9-439b-81ef-9d2f45663043\" (UID: \"65049cde-26b9-439b-81ef-9d2f45663043\") "
Sep 10 22:12:24.888430 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888192    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65049cde-26b9-439b-81ef-9d2f45663043" (UID: "65049cde-26b9-439b-81ef-9d2f45663043"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:12:24.888430 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888312    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65049cde-26b9-439b-81ef-9d2f45663043" (UID: "65049cde-26b9-439b-81ef-9d2f45663043"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:12:24.888430 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888326    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-data" (OuterVolumeSpecName: "istio-data") pod "65049cde-26b9-439b-81ef-9d2f45663043" (UID: "65049cde-26b9-439b-81ef-9d2f45663043"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:12:24.888634 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888456    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:24.888634 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888475    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:24.888634 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888493    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:24.888634 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888498    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65049cde-26b9-439b-81ef-9d2f45663043" (UID: "65049cde-26b9-439b-81ef-9d2f45663043"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:12:24.888634 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.888572    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65049cde-26b9-439b-81ef-9d2f45663043-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65049cde-26b9-439b-81ef-9d2f45663043" (UID: "65049cde-26b9-439b-81ef-9d2f45663043"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:12:24.890422 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.890390    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-istio-token" (OuterVolumeSpecName: "istio-token") pod "65049cde-26b9-439b-81ef-9d2f45663043" (UID: "65049cde-26b9-439b-81ef-9d2f45663043"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:12:24.890521 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.890421    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-kube-api-access-7bv6q" (OuterVolumeSpecName: "kube-api-access-7bv6q") pod "65049cde-26b9-439b-81ef-9d2f45663043" (UID: "65049cde-26b9-439b-81ef-9d2f45663043"). InnerVolumeSpecName "kube-api-access-7bv6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:12:24.890592 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.890570    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65049cde-26b9-439b-81ef-9d2f45663043" (UID: "65049cde-26b9-439b-81ef-9d2f45663043"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:12:24.890639 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.890585    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65049cde-26b9-439b-81ef-9d2f45663043-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65049cde-26b9-439b-81ef-9d2f45663043" (UID: "65049cde-26b9-439b-81ef-9d2f45663043"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:12:24.989910 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.989880    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65049cde-26b9-439b-81ef-9d2f45663043-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:24.989910 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.989904    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65049cde-26b9-439b-81ef-9d2f45663043-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:24.989910 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.989912    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:24.990302 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.989921    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bv6q\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-kube-api-access-7bv6q\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:24.990302 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.989931    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65049cde-26b9-439b-81ef-9d2f45663043-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:24.990302 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:24.989939    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65049cde-26b9-439b-81ef-9d2f45663043-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:25.553891 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:25.553830    2573 generic.go:356] "Generic (PLEG): container finished" podID="65049cde-26b9-439b-81ef-9d2f45663043" containerID="42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5" exitCode=0
Sep 10 22:12:25.553891 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:25.553886    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"
Sep 10 22:12:25.554126 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:25.553868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf" event={"ID":"65049cde-26b9-439b-81ef-9d2f45663043","Type":"ContainerDied","Data":"42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5"}
Sep 10 22:12:25.554126 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:25.553970    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf" event={"ID":"65049cde-26b9-439b-81ef-9d2f45663043","Type":"ContainerDied","Data":"124ed1fe96be53d30b8f8c10353d339cb6e6d3dc6a364a5e310b00ed25f529fd"}
Sep 10 22:12:25.554126 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:25.553995    2573 scope.go:117] "RemoveContainer" containerID="42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5"
Sep 10 22:12:25.564928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:25.564913    2573 scope.go:117] "RemoveContainer" containerID="42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5"
Sep 10 22:12:25.565195 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:12:25.565174    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5\": container with ID starting with 42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5 not found: ID does not exist" containerID="42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5"
Sep 10 22:12:25.565297 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:25.565202    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5"} err="failed to get container status \"42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5\": rpc error: code = NotFound desc = could not find container \"42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5\": container with ID starting with 42edf2410171f3903a6da5511cecb5d60cd509f643910b39d69da9089cdbe4d5 not found: ID does not exist"
Sep 10 22:12:25.589989 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:25.589967    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"]
Sep 10 22:12:25.601041 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:25.601020    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-svtpf"]
Sep 10 22:12:26.483306 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:26.483257    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c7dbb6785-npm9t" podUID="5945c355-e397-46b3-96d7-f24d2f8c0391" containerName="console" containerID="cri-o://08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e" gracePeriod=15
Sep 10 22:12:26.555326 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:26.555292    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65049cde-26b9-439b-81ef-9d2f45663043" path="/var/lib/kubelet/pods/65049cde-26b9-439b-81ef-9d2f45663043/volumes"
Sep 10 22:12:26.568272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:26.568237    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:26.691135 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:26.691095    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:26.795756 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:26.795680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:27.035724 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.035684    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:12:27.035826 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.035779    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:12:27.119609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.119582    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:12:27.313819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.313728    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-console-config\") pod \"5945c355-e397-46b3-96d7-f24d2f8c0391\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") "
Sep 10 22:12:27.313819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.313777    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-oauth-config\") pod \"5945c355-e397-46b3-96d7-f24d2f8c0391\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") "
Sep 10 22:12:27.313819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.313809    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnv8q\" (UniqueName: \"kubernetes.io/projected/5945c355-e397-46b3-96d7-f24d2f8c0391-kube-api-access-pnv8q\") pod \"5945c355-e397-46b3-96d7-f24d2f8c0391\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") "
Sep 10 22:12:27.314104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.313852    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-trusted-ca-bundle\") pod \"5945c355-e397-46b3-96d7-f24d2f8c0391\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") "
Sep 10 22:12:27.314104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.313890    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-serving-cert\") pod \"5945c355-e397-46b3-96d7-f24d2f8c0391\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") "
Sep 10 22:12:27.314104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.313938    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-oauth-serving-cert\") pod \"5945c355-e397-46b3-96d7-f24d2f8c0391\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") "
Sep 10 22:12:27.314104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.313975    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-service-ca\") pod \"5945c355-e397-46b3-96d7-f24d2f8c0391\" (UID: \"5945c355-e397-46b3-96d7-f24d2f8c0391\") "
Sep 10 22:12:27.314318 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.314167    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-console-config" (OuterVolumeSpecName: "console-config") pod "5945c355-e397-46b3-96d7-f24d2f8c0391" (UID: "5945c355-e397-46b3-96d7-f24d2f8c0391"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:12:27.314428 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.314393    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5945c355-e397-46b3-96d7-f24d2f8c0391" (UID: "5945c355-e397-46b3-96d7-f24d2f8c0391"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:12:27.314806 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.314476    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-service-ca" (OuterVolumeSpecName: "service-ca") pod "5945c355-e397-46b3-96d7-f24d2f8c0391" (UID: "5945c355-e397-46b3-96d7-f24d2f8c0391"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:12:27.314806 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.314482    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5945c355-e397-46b3-96d7-f24d2f8c0391" (UID: "5945c355-e397-46b3-96d7-f24d2f8c0391"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:12:27.316117 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.316089    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5945c355-e397-46b3-96d7-f24d2f8c0391" (UID: "5945c355-e397-46b3-96d7-f24d2f8c0391"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:12:27.316432 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.316405    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5945c355-e397-46b3-96d7-f24d2f8c0391-kube-api-access-pnv8q" (OuterVolumeSpecName: "kube-api-access-pnv8q") pod "5945c355-e397-46b3-96d7-f24d2f8c0391" (UID: "5945c355-e397-46b3-96d7-f24d2f8c0391"). InnerVolumeSpecName "kube-api-access-pnv8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:12:27.316487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.316452    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5945c355-e397-46b3-96d7-f24d2f8c0391" (UID: "5945c355-e397-46b3-96d7-f24d2f8c0391"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:12:27.414848 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.414801    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-trusted-ca-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:27.414848 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.414833    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-serving-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:27.414848 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.414855    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-oauth-serving-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:27.415088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.414864    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:27.415088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.414873    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5945c355-e397-46b3-96d7-f24d2f8c0391-console-config\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:27.415088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.414880    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5945c355-e397-46b3-96d7-f24d2f8c0391-console-oauth-config\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:27.415088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.414888    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnv8q\" (UniqueName: \"kubernetes.io/projected/5945c355-e397-46b3-96d7-f24d2f8c0391-kube-api-access-pnv8q\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:12:27.570548 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.570465    2573 generic.go:356] "Generic (PLEG): container finished" podID="5945c355-e397-46b3-96d7-f24d2f8c0391" containerID="08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e" exitCode=0
Sep 10 22:12:27.571139 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.571105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7dbb6785-npm9t" event={"ID":"5945c355-e397-46b3-96d7-f24d2f8c0391","Type":"ContainerDied","Data":"08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e"}
Sep 10 22:12:27.571275 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.571261    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7dbb6785-npm9t" event={"ID":"5945c355-e397-46b3-96d7-f24d2f8c0391","Type":"ContainerDied","Data":"302982a343d1b14da816c8b06d6c05be7fe82f9492ff7002b1555e9402df75aa"}
Sep 10 22:12:27.571366 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.571355    2573 scope.go:117] "RemoveContainer" containerID="08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e"
Sep 10 22:12:27.571619 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.571600    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7dbb6785-npm9t"
Sep 10 22:12:27.578592 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.578561    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq" event={"ID":"ea17a3f9-55d8-4052-aca0-14711fbe4fdd","Type":"ContainerStarted","Data":"974596e868263d5b5d4bfd03f243cafcbbd8b0c8816e39c2c94cd5cb5232ff37"}
Sep 10 22:12:27.578898 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.578819    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:27.588657 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.588632    2573 scope.go:117] "RemoveContainer" containerID="08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e"
Sep 10 22:12:27.589166 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:12:27.589111    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e\": container with ID starting with 08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e not found: ID does not exist" containerID="08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e"
Sep 10 22:12:27.589166 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.589145    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e"} err="failed to get container status \"08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e\": rpc error: code = NotFound desc = could not find container \"08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e\": container with ID starting with 08f72ef12b26fe84c65217a25ee18af4676ef48e19240ebdcd5887483c51f38e not found: ID does not exist"
Sep 10 22:12:27.614342 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.614292    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq" podStartSLOduration=2.11133985 podStartE2EDuration="4.614272385s" totalImagesPullingTime="2.502932535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:12:27.611436341 +0000 UTC m=+427.493920708" watchObservedRunningTime="2026-09-10 22:12:27.614272385 +0000 UTC m=+427.496756752"
Sep 10 22:12:27.628522 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.628490    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7dbb6785-npm9t"]
Sep 10 22:12:27.631408 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.631366    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c7dbb6785-npm9t"]
Sep 10 22:12:27.857809 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.857727    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:27.979609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:27.979580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:28.553516 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:28.553482    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5945c355-e397-46b3-96d7-f24d2f8c0391" path="/var/lib/kubelet/pods/5945c355-e397-46b3-96d7-f24d2f8c0391/volumes"
Sep 10 22:12:28.586026 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:28.586002    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vhvfq"
Sep 10 22:12:32.278293 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:32.278261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:32.378443 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:32.378381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:12:32.537502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:32.537423    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-krh5h"
Sep 10 22:12:32.539857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:32.539808    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-8x68v"
Sep 10 22:12:44.066727 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:12:44.066622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:17.638764 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:17.638701    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:17.747590 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:17.747561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:21.722190 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.722154    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"]
Sep 10 22:13:21.722550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.722465    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5945c355-e397-46b3-96d7-f24d2f8c0391" containerName="console"
Sep 10 22:13:21.722550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.722475    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5945c355-e397-46b3-96d7-f24d2f8c0391" containerName="console"
Sep 10 22:13:21.722550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.722484    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65049cde-26b9-439b-81ef-9d2f45663043" containerName="istio-proxy"
Sep 10 22:13:21.722550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.722490    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="65049cde-26b9-439b-81ef-9d2f45663043" containerName="istio-proxy"
Sep 10 22:13:21.722550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.722546    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="65049cde-26b9-439b-81ef-9d2f45663043" containerName="istio-proxy"
Sep 10 22:13:21.722550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.722554    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5945c355-e397-46b3-96d7-f24d2f8c0391" containerName="console"
Sep 10 22:13:21.732748 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.732720    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.734278 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.734251    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"]
Sep 10 22:13:21.735062 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.735041    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dttnp\""
Sep 10 22:13:21.735205 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.735062    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:13:21.735205 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.735062    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:13:21.824859 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.824815    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"]
Sep 10 22:13:21.828295 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.828271    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:21.836597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.836571    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"]
Sep 10 22:13:21.884488 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.884457    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.884621 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.884505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzzq\" (UniqueName: \"kubernetes.io/projected/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-kube-api-access-5tzzq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.884621 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.884561    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:21.884621 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.884583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:21.884790 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.884650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.884790 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.884673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xqtc\" (UniqueName: \"kubernetes.io/projected/91d8e04e-f758-44a1-85f3-b1eeef353455-kube-api-access-4xqtc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:21.920831 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.920802    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"]
Sep 10 22:13:21.924284 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.924268    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:21.932025 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.932007    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"]
Sep 10 22:13:21.985611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.985541    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.985611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.985572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xqtc\" (UniqueName: \"kubernetes.io/projected/91d8e04e-f758-44a1-85f3-b1eeef353455-kube-api-access-4xqtc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:21.985611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.985608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:21.985878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.985631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.985878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.985668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzzq\" (UniqueName: \"kubernetes.io/projected/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-kube-api-access-5tzzq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.985878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.985697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:21.985878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.985714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:21.985878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.985738    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfqkt\" (UniqueName: \"kubernetes.io/projected/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-kube-api-access-kfqkt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:21.985878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.985786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:21.986144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.986023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.986144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.986049    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.986144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.986072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:21.986144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.986085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:21.993306 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.993271    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzzq\" (UniqueName: \"kubernetes.io/projected/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-kube-api-access-5tzzq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:21.993306 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:21.993281    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xqtc\" (UniqueName: \"kubernetes.io/projected/91d8e04e-f758-44a1-85f3-b1eeef353455-kube-api-access-4xqtc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:22.021563 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.021534    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"]
Sep 10 22:13:22.025192 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.025174    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.033887 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.033865    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"]
Sep 10 22:13:22.042709 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.042690    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:22.086456 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.086423    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfqkt\" (UniqueName: \"kubernetes.io/projected/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-kube-api-access-kfqkt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:22.086627 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.086488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:22.086627 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.086562    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.086627 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.086600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:22.086794 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.086664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.086794 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.086701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv7hp\" (UniqueName: \"kubernetes.io/projected/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-kube-api-access-nv7hp\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.087286 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.087256    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:22.087389 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.087335    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:22.097281 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.097243    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfqkt\" (UniqueName: \"kubernetes.io/projected/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-kube-api-access-kfqkt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:22.137859 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.137824    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:22.187280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.187239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.187412 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.187320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv7hp\" (UniqueName: \"kubernetes.io/projected/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-kube-api-access-nv7hp\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.187472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.187415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.187696 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.187672    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.187791 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.187723    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.196036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.196016    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv7hp\" (UniqueName: \"kubernetes.io/projected/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-kube-api-access-nv7hp\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.233805 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.233780    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:22.314713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.314690    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"]
Sep 10 22:13:22.315958 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:13:22.315933    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e76f81_6d6c_4535_8488_ae6fb3aeb23d.slice/crio-1171343ddbd8cf90866ff21e5bb8919405ce93a834f45d9af43b00c9049af26e WatchSource:0}: Error finding container 1171343ddbd8cf90866ff21e5bb8919405ce93a834f45d9af43b00c9049af26e: Status 404 returned error can't find the container with id 1171343ddbd8cf90866ff21e5bb8919405ce93a834f45d9af43b00c9049af26e
Sep 10 22:13:22.335353 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.335332    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:22.411598 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.411528    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"]
Sep 10 22:13:22.412653 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:13:22.412616    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d8e04e_f758_44a1_85f3_b1eeef353455.slice/crio-e8d6ba5995108fc2124f491cd675988c4d7d33b284439345801d789be17423e3 WatchSource:0}: Error finding container e8d6ba5995108fc2124f491cd675988c4d7d33b284439345801d789be17423e3: Status 404 returned error can't find the container with id e8d6ba5995108fc2124f491cd675988c4d7d33b284439345801d789be17423e3
Sep 10 22:13:22.503261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.503222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"]
Sep 10 22:13:22.504721 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:13:22.504693    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8798d5b7_0818_4bd3_9d99_72e1a0bf3543.slice/crio-ea5c42cbcf951940ced7fe092a36b547b30a9484be9cb01a8ec2d0d1aceb00d8 WatchSource:0}: Error finding container ea5c42cbcf951940ced7fe092a36b547b30a9484be9cb01a8ec2d0d1aceb00d8: Status 404 returned error can't find the container with id ea5c42cbcf951940ced7fe092a36b547b30a9484be9cb01a8ec2d0d1aceb00d8
Sep 10 22:13:22.605502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.605481    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"]
Sep 10 22:13:22.661631 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:13:22.661605    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d79e39_f402_4f8f_a9f3_9b54a3eb9ffb.slice/crio-9f817df192506178229162c841c33fe83c85c8d8fd83906c6034bd10b9cb810c WatchSource:0}: Error finding container 9f817df192506178229162c841c33fe83c85c8d8fd83906c6034bd10b9cb810c: Status 404 returned error can't find the container with id 9f817df192506178229162c841c33fe83c85c8d8fd83906c6034bd10b9cb810c
Sep 10 22:13:22.836647 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.836614    2573 generic.go:356] "Generic (PLEG): container finished" podID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerID="e649fd672b279bf9f77e430f56147629e2137b0e257e9411d31db6a12fe2b2f3" exitCode=0
Sep 10 22:13:22.837100 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.836703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92" event={"ID":"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d","Type":"ContainerDied","Data":"e649fd672b279bf9f77e430f56147629e2137b0e257e9411d31db6a12fe2b2f3"}
Sep 10 22:13:22.837100 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.836766    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92" event={"ID":"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d","Type":"ContainerStarted","Data":"1171343ddbd8cf90866ff21e5bb8919405ce93a834f45d9af43b00c9049af26e"}
Sep 10 22:13:22.838307 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.838282    2573 generic.go:356] "Generic (PLEG): container finished" podID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerID="f119235e0bc573813c7b1354405d0cd9f647860a9635aea81743929e8e7b1e29" exitCode=0
Sep 10 22:13:22.838402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.838373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht" event={"ID":"91d8e04e-f758-44a1-85f3-b1eeef353455","Type":"ContainerDied","Data":"f119235e0bc573813c7b1354405d0cd9f647860a9635aea81743929e8e7b1e29"}
Sep 10 22:13:22.838466 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.838418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht" event={"ID":"91d8e04e-f758-44a1-85f3-b1eeef353455","Type":"ContainerStarted","Data":"e8d6ba5995108fc2124f491cd675988c4d7d33b284439345801d789be17423e3"}
Sep 10 22:13:22.840150 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.840131    2573 generic.go:356] "Generic (PLEG): container finished" podID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerID="c1de69e8ba9c355c28d50e05770f97240be8024c43d1befd5b6a9718dbcfd2a8" exitCode=0
Sep 10 22:13:22.840260 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.840205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr" event={"ID":"8798d5b7-0818-4bd3-9d99-72e1a0bf3543","Type":"ContainerDied","Data":"c1de69e8ba9c355c28d50e05770f97240be8024c43d1befd5b6a9718dbcfd2a8"}
Sep 10 22:13:22.840260 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.840250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr" event={"ID":"8798d5b7-0818-4bd3-9d99-72e1a0bf3543","Type":"ContainerStarted","Data":"ea5c42cbcf951940ced7fe092a36b547b30a9484be9cb01a8ec2d0d1aceb00d8"}
Sep 10 22:13:22.841915 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.841898    2573 generic.go:356] "Generic (PLEG): container finished" podID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerID="84eb596262b7effa67619c03d4491f4187b4bccbfe069f06a708b0110d9db668" exitCode=0
Sep 10 22:13:22.841995 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.841956    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94" event={"ID":"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb","Type":"ContainerDied","Data":"84eb596262b7effa67619c03d4491f4187b4bccbfe069f06a708b0110d9db668"}
Sep 10 22:13:22.842058 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:22.841998    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94" event={"ID":"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb","Type":"ContainerStarted","Data":"9f817df192506178229162c841c33fe83c85c8d8fd83906c6034bd10b9cb810c"}
Sep 10 22:13:23.854061 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:23.854029    2573 generic.go:356] "Generic (PLEG): container finished" podID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerID="7ca556879d5ab82fe242e7055fb15376a5896b104267174b1036bb712fddc879" exitCode=0
Sep 10 22:13:23.854450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:23.854093    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92" event={"ID":"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d","Type":"ContainerDied","Data":"7ca556879d5ab82fe242e7055fb15376a5896b104267174b1036bb712fddc879"}
Sep 10 22:13:23.855968 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:23.855948    2573 generic.go:356] "Generic (PLEG): container finished" podID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerID="d0afaf01822bd00915fe6d1b243d4cca5de6323d84d294e5e4cb2477d5c67e25" exitCode=0
Sep 10 22:13:23.856087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:23.856035    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht" event={"ID":"91d8e04e-f758-44a1-85f3-b1eeef353455","Type":"ContainerDied","Data":"d0afaf01822bd00915fe6d1b243d4cca5de6323d84d294e5e4cb2477d5c67e25"}
Sep 10 22:13:23.857818 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:23.857798    2573 generic.go:356] "Generic (PLEG): container finished" podID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerID="485946e8a6468d25906aec8f0e80e6e21d40f0a6d2fcb6936ec67f69530f456d" exitCode=0
Sep 10 22:13:23.857915 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:23.857883    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr" event={"ID":"8798d5b7-0818-4bd3-9d99-72e1a0bf3543","Type":"ContainerDied","Data":"485946e8a6468d25906aec8f0e80e6e21d40f0a6d2fcb6936ec67f69530f456d"}
Sep 10 22:13:24.865128 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:24.865097    2573 generic.go:356] "Generic (PLEG): container finished" podID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerID="5f8b42feaddde33c742cfe739d5f17d941c1327fc497b7e1a4b30122b5190ec1" exitCode=0
Sep 10 22:13:24.865520 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:24.865179    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92" event={"ID":"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d","Type":"ContainerDied","Data":"5f8b42feaddde33c742cfe739d5f17d941c1327fc497b7e1a4b30122b5190ec1"}
Sep 10 22:13:24.867632 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:24.867609    2573 generic.go:356] "Generic (PLEG): container finished" podID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerID="b5e5757c7835ea38f35119efc6553a23f1dd427eb701c72c62e4e186fa7c426b" exitCode=0
Sep 10 22:13:24.867776 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:24.867686    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht" event={"ID":"91d8e04e-f758-44a1-85f3-b1eeef353455","Type":"ContainerDied","Data":"b5e5757c7835ea38f35119efc6553a23f1dd427eb701c72c62e4e186fa7c426b"}
Sep 10 22:13:24.870196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:24.870173    2573 generic.go:356] "Generic (PLEG): container finished" podID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerID="40852a361f1b21c2198898c85708f497b5af6539cdd201289e2b26820f819688" exitCode=0
Sep 10 22:13:24.870358 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:24.870252    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr" event={"ID":"8798d5b7-0818-4bd3-9d99-72e1a0bf3543","Type":"ContainerDied","Data":"40852a361f1b21c2198898c85708f497b5af6539cdd201289e2b26820f819688"}
Sep 10 22:13:24.872089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:24.872070    2573 generic.go:356] "Generic (PLEG): container finished" podID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerID="5480215f76f8d1ec8992709e73bcaaa50f09be4b193bda2abc6d9ae8014b6e13" exitCode=0
Sep 10 22:13:24.872169 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:24.872120    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94" event={"ID":"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb","Type":"ContainerDied","Data":"5480215f76f8d1ec8992709e73bcaaa50f09be4b193bda2abc6d9ae8014b6e13"}
Sep 10 22:13:25.880018 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:25.879982    2573 generic.go:356] "Generic (PLEG): container finished" podID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerID="461bf7cc83eb2b318577ae714263ddb8e17ec65a4b671a90630838d9c596be97" exitCode=0
Sep 10 22:13:25.880441 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:25.880033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94" event={"ID":"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb","Type":"ContainerDied","Data":"461bf7cc83eb2b318577ae714263ddb8e17ec65a4b671a90630838d9c596be97"}
Sep 10 22:13:26.038580 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.038558    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:26.041255 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.041233    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:26.066075 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.066054    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:26.122613 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.122587    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xqtc\" (UniqueName: \"kubernetes.io/projected/91d8e04e-f758-44a1-85f3-b1eeef353455-kube-api-access-4xqtc\") pod \"91d8e04e-f758-44a1-85f3-b1eeef353455\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") "
Sep 10 22:13:26.122613 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.122615    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfqkt\" (UniqueName: \"kubernetes.io/projected/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-kube-api-access-kfqkt\") pod \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") "
Sep 10 22:13:26.122864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.122641    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-util\") pod \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") "
Sep 10 22:13:26.122864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.122659    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-util\") pod \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") "
Sep 10 22:13:26.122864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.122732    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tzzq\" (UniqueName: \"kubernetes.io/projected/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-kube-api-access-5tzzq\") pod \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") "
Sep 10 22:13:26.122864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.122779    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-bundle\") pod \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\" (UID: \"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d\") "
Sep 10 22:13:26.122864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.122816    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-bundle\") pod \"91d8e04e-f758-44a1-85f3-b1eeef353455\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") "
Sep 10 22:13:26.123131 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.122885    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-util\") pod \"91d8e04e-f758-44a1-85f3-b1eeef353455\" (UID: \"91d8e04e-f758-44a1-85f3-b1eeef353455\") "
Sep 10 22:13:26.123131 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.122910    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-bundle\") pod \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\" (UID: \"8798d5b7-0818-4bd3-9d99-72e1a0bf3543\") "
Sep 10 22:13:26.123503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.123478    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-bundle" (OuterVolumeSpecName: "bundle") pod "e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" (UID: "e3e76f81-6d6c-4535-8488-ae6fb3aeb23d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:13:26.123588 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.123374    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-bundle" (OuterVolumeSpecName: "bundle") pod "91d8e04e-f758-44a1-85f3-b1eeef353455" (UID: "91d8e04e-f758-44a1-85f3-b1eeef353455"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:13:26.124075 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.124032    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-bundle" (OuterVolumeSpecName: "bundle") pod "8798d5b7-0818-4bd3-9d99-72e1a0bf3543" (UID: "8798d5b7-0818-4bd3-9d99-72e1a0bf3543"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:13:26.124903 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.124875    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-kube-api-access-kfqkt" (OuterVolumeSpecName: "kube-api-access-kfqkt") pod "8798d5b7-0818-4bd3-9d99-72e1a0bf3543" (UID: "8798d5b7-0818-4bd3-9d99-72e1a0bf3543"). InnerVolumeSpecName "kube-api-access-kfqkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:13:26.125003 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.124937    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d8e04e-f758-44a1-85f3-b1eeef353455-kube-api-access-4xqtc" (OuterVolumeSpecName: "kube-api-access-4xqtc") pod "91d8e04e-f758-44a1-85f3-b1eeef353455" (UID: "91d8e04e-f758-44a1-85f3-b1eeef353455"). InnerVolumeSpecName "kube-api-access-4xqtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:13:26.125186 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.125166    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-kube-api-access-5tzzq" (OuterVolumeSpecName: "kube-api-access-5tzzq") pod "e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" (UID: "e3e76f81-6d6c-4535-8488-ae6fb3aeb23d"). InnerVolumeSpecName "kube-api-access-5tzzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:13:26.129304 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.129284    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-util" (OuterVolumeSpecName: "util") pod "8798d5b7-0818-4bd3-9d99-72e1a0bf3543" (UID: "8798d5b7-0818-4bd3-9d99-72e1a0bf3543"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:13:26.132532 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.132484    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-util" (OuterVolumeSpecName: "util") pod "91d8e04e-f758-44a1-85f3-b1eeef353455" (UID: "91d8e04e-f758-44a1-85f3-b1eeef353455"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:13:26.132597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.132572    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-util" (OuterVolumeSpecName: "util") pod "e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" (UID: "e3e76f81-6d6c-4535-8488-ae6fb3aeb23d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:13:26.223589 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.223564    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:26.223589 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.223588    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91d8e04e-f758-44a1-85f3-b1eeef353455-util\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:26.223751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.223600    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:26.223751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.223611    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xqtc\" (UniqueName: \"kubernetes.io/projected/91d8e04e-f758-44a1-85f3-b1eeef353455-kube-api-access-4xqtc\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:26.223751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.223622    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfqkt\" (UniqueName: \"kubernetes.io/projected/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-kube-api-access-kfqkt\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:26.223751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.223634    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8798d5b7-0818-4bd3-9d99-72e1a0bf3543-util\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:26.223751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.223645    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-util\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:26.223751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.223656    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tzzq\" (UniqueName: \"kubernetes.io/projected/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-kube-api-access-5tzzq\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:26.223751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.223668    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3e76f81-6d6c-4535-8488-ae6fb3aeb23d-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:26.887601 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.887516    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr"
Sep 10 22:13:26.887601 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.887543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a4c6sr" event={"ID":"8798d5b7-0818-4bd3-9d99-72e1a0bf3543","Type":"ContainerDied","Data":"ea5c42cbcf951940ced7fe092a36b547b30a9484be9cb01a8ec2d0d1aceb00d8"}
Sep 10 22:13:26.887601 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.887590    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea5c42cbcf951940ced7fe092a36b547b30a9484be9cb01a8ec2d0d1aceb00d8"
Sep 10 22:13:26.889618 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.889567    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92"
Sep 10 22:13:26.889618 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.889579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lqk92" event={"ID":"e3e76f81-6d6c-4535-8488-ae6fb3aeb23d","Type":"ContainerDied","Data":"1171343ddbd8cf90866ff21e5bb8919405ce93a834f45d9af43b00c9049af26e"}
Sep 10 22:13:26.889810 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.889620    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1171343ddbd8cf90866ff21e5bb8919405ce93a834f45d9af43b00c9049af26e"
Sep 10 22:13:26.891713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.891692    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht"
Sep 10 22:13:26.891819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.891712    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8rht" event={"ID":"91d8e04e-f758-44a1-85f3-b1eeef353455","Type":"ContainerDied","Data":"e8d6ba5995108fc2124f491cd675988c4d7d33b284439345801d789be17423e3"}
Sep 10 22:13:26.891819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:26.891744    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8d6ba5995108fc2124f491cd675988c4d7d33b284439345801d789be17423e3"
Sep 10 22:13:27.006024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.006001    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:27.030129 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.030100    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv7hp\" (UniqueName: \"kubernetes.io/projected/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-kube-api-access-nv7hp\") pod \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") "
Sep 10 22:13:27.030256 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.030150    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-util\") pod \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") "
Sep 10 22:13:27.030256 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.030227    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-bundle\") pod \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\" (UID: \"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb\") "
Sep 10 22:13:27.030796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.030767    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-bundle" (OuterVolumeSpecName: "bundle") pod "94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" (UID: "94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:13:27.032265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.032238    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-kube-api-access-nv7hp" (OuterVolumeSpecName: "kube-api-access-nv7hp") pod "94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" (UID: "94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb"). InnerVolumeSpecName "kube-api-access-nv7hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:13:27.035800 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.035776    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-util" (OuterVolumeSpecName: "util") pod "94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" (UID: "94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:13:27.131476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.131449    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv7hp\" (UniqueName: \"kubernetes.io/projected/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-kube-api-access-nv7hp\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:27.131476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.131471    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-util\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:27.131476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.131481    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb-bundle\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:13:27.899422 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.899384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94" event={"ID":"94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb","Type":"ContainerDied","Data":"9f817df192506178229162c841c33fe83c85c8d8fd83906c6034bd10b9cb810c"}
Sep 10 22:13:27.899915 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.899442    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f817df192506178229162c841c33fe83c85c8d8fd83906c6034bd10b9cb810c"
Sep 10 22:13:27.899915 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:27.899389    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cd8z94"
Sep 10 22:13:31.472835 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:31.472805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:32.260669 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:32.260634    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:33.064010 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:33.063979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:35.322502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:35.322468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:35.442418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:35.442388    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:36.691782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:36.691750    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:37.726775 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:37.726743    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:38.477424 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:38.477393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:38.879083 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:38.879003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:40.732367 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:40.732333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:41.492713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:41.492678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:42.524502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:42.524464    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:43.520276 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:43.520246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:43.730234 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:43.730203    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:46.474819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:46.474790    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:46.536462 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:46.536431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:46.871115 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:46.871034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:46.930303 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:46.930275    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:47.278518 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:47.278480    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:47.335820 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:47.335787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:53.035887 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:53.035856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:53.131593 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:53.131560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:59.501966 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:59.501928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:13:59.602566 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:13:59.602536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:02.358411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:02.358372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:02.487008 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:02.486976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:02.587854 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:02.587811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:07.686637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:07.686604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:07.747252 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:07.747224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:08.084104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:08.084074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:08.135912 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:08.135883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:08.292033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:08.292003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:08.391872 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:08.391784    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:12.224534 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:12.224502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:12.285966 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:12.285930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:17.088058 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:17.087978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:17.188678 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:17.188642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:22.895827 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:22.895791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:22.996023 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:22.995991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:25.894494 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:25.894462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:25.997342 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:25.997309    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:27.811203 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:27.811174    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:28.000604 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:28.000571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:30.038806 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:30.038776    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:30.092812 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:30.092783    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:31.518547 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:31.518517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:31.633236 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:31.633204    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:31.733194 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:31.733141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:32.434409 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:32.434373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:32.533705 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:32.533677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:46.440899 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.440861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:46.539816 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.539780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:46.832804 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.832772    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"]
Sep 10 22:14:46.833173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833156    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerName="pull"
Sep 10 22:14:46.833263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833176    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerName="pull"
Sep 10 22:14:46.833263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833189    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerName="util"
Sep 10 22:14:46.833263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833200    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerName="util"
Sep 10 22:14:46.833263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833209    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerName="extract"
Sep 10 22:14:46.833263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833218    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerName="extract"
Sep 10 22:14:46.833263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833227    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerName="extract"
Sep 10 22:14:46.833263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833235    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerName="extract"
Sep 10 22:14:46.833263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833243    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerName="extract"
Sep 10 22:14:46.833263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833251    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerName="extract"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833269    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerName="pull"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833277    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerName="pull"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833294    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerName="util"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833303    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerName="util"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833313    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerName="util"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833320    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerName="util"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833331    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerName="util"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833339    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerName="util"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833348    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerName="extract"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833356    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerName="extract"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833364    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerName="pull"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833372    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerName="pull"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833389    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerName="pull"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833398    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerName="pull"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833478    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d8e04e-f758-44a1-85f3-b1eeef353455" containerName="extract"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833493    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d79e39-f402-4f8f-a9f3-9b54a3eb9ffb" containerName="extract"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833506    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3e76f81-6d6c-4535-8488-ae6fb3aeb23d" containerName="extract"
Sep 10 22:14:46.833699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.833516    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8798d5b7-0818-4bd3-9d99-72e1a0bf3543" containerName="extract"
Sep 10 22:14:46.836684 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.836666    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:46.839014 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.838996    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jnbgj\""
Sep 10 22:14:46.839301 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.839279    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:14:46.839658 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.839631    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 22:14:46.839658 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.839645    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 22:14:46.847122 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.847095    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"]
Sep 10 22:14:46.866178 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.866154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:46.890182 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.890160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv64v\" (UniqueName: \"kubernetes.io/projected/cc8ab1c7-d052-4bd7-b30f-87df4d39d781-kube-api-access-qv64v\") pod \"postgres-69fb4594cf-blgfr\" (UID: \"cc8ab1c7-d052-4bd7-b30f-87df4d39d781\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:46.890262 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.890188    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cc8ab1c7-d052-4bd7-b30f-87df4d39d781-data\") pod \"postgres-69fb4594cf-blgfr\" (UID: \"cc8ab1c7-d052-4bd7-b30f-87df4d39d781\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:46.990705 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.990674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv64v\" (UniqueName: \"kubernetes.io/projected/cc8ab1c7-d052-4bd7-b30f-87df4d39d781-kube-api-access-qv64v\") pod \"postgres-69fb4594cf-blgfr\" (UID: \"cc8ab1c7-d052-4bd7-b30f-87df4d39d781\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:46.990835 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.990714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cc8ab1c7-d052-4bd7-b30f-87df4d39d781-data\") pod \"postgres-69fb4594cf-blgfr\" (UID: \"cc8ab1c7-d052-4bd7-b30f-87df4d39d781\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:46.991111 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.991092    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cc8ab1c7-d052-4bd7-b30f-87df4d39d781-data\") pod \"postgres-69fb4594cf-blgfr\" (UID: \"cc8ab1c7-d052-4bd7-b30f-87df4d39d781\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:46.998331 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:46.998312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv64v\" (UniqueName: \"kubernetes.io/projected/cc8ab1c7-d052-4bd7-b30f-87df4d39d781-kube-api-access-qv64v\") pod \"postgres-69fb4594cf-blgfr\" (UID: \"cc8ab1c7-d052-4bd7-b30f-87df4d39d781\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:47.148605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:47.148533    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:47.418212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:47.418187    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"]
Sep 10 22:14:47.419506 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:14:47.419478    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8ab1c7_d052_4bd7_b30f_87df4d39d781.slice/crio-cb239454c1f29cac9a9a0375427d62032bc81b4b0a8a8e020febdb445a390851 WatchSource:0}: Error finding container cb239454c1f29cac9a9a0375427d62032bc81b4b0a8a8e020febdb445a390851: Status 404 returned error can't find the container with id cb239454c1f29cac9a9a0375427d62032bc81b4b0a8a8e020febdb445a390851
Sep 10 22:14:48.305004 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:48.304962    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr" event={"ID":"cc8ab1c7-d052-4bd7-b30f-87df4d39d781","Type":"ContainerStarted","Data":"cb239454c1f29cac9a9a0375427d62032bc81b4b0a8a8e020febdb445a390851"}
Sep 10 22:14:52.328593 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:52.328559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr" event={"ID":"cc8ab1c7-d052-4bd7-b30f-87df4d39d781","Type":"ContainerStarted","Data":"594442924fd90c032ac8bba94587215e46b5f53fa029fa8d83216d26352247b0"}
Sep 10 22:14:52.328983 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:52.328635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:52.344724 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:52.344683    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr" podStartSLOduration=1.659240131 podStartE2EDuration="6.344668134s" totalImagesPullingTime="4.685428003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:14:52.342619672 +0000 UTC m=+572.225104242" watchObservedRunningTime="2026-09-10 22:14:52.344668134 +0000 UTC m=+572.227152540"
Sep 10 22:14:58.362582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:58.362544    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-blgfr"
Sep 10 22:14:58.662024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:58.661945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:14:58.936360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:14:58.936278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:06.155330 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:06.155298    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:06.231946 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:06.231913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:06.296709 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:06.296679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:06.364676 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:06.364613    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:06.851681 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:06.851649    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:10.119668 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:10.119632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:10.218496 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:10.218445    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:17.281525 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:17.281489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:17.338216 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:17.338105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:20.496539 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:20.496508    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:15:20.497727 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:20.497705    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:15:44.533419 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:44.533290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:45.791610 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:45.791571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:45.943988 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:45.943956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:46.045039 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.044956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:46.113071 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.113039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:46.199319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.199289    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:46.550040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.550003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:46.653104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.653074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:46.685533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.685501    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"]
Sep 10 22:15:46.688804 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.688788    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:15:46.690927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.690903    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 22:15:46.691056 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.690944    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7qns5\""
Sep 10 22:15:46.698510 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.698487    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"]
Sep 10 22:15:46.805070 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.804980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwlls\" (UniqueName: \"kubernetes.io/projected/630e1db1-b0aa-4af2-9a0b-428332191632-kube-api-access-mwlls\") pod \"payload-processing-5b54b7fbb7-2rcbw\" (UID: \"630e1db1-b0aa-4af2-9a0b-428332191632\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:15:46.805070 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.805036    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/630e1db1-b0aa-4af2-9a0b-428332191632-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2rcbw\" (UID: \"630e1db1-b0aa-4af2-9a0b-428332191632\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:15:46.906522 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.906489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwlls\" (UniqueName: \"kubernetes.io/projected/630e1db1-b0aa-4af2-9a0b-428332191632-kube-api-access-mwlls\") pod \"payload-processing-5b54b7fbb7-2rcbw\" (UID: \"630e1db1-b0aa-4af2-9a0b-428332191632\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:15:46.906677 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.906532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/630e1db1-b0aa-4af2-9a0b-428332191632-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2rcbw\" (UID: \"630e1db1-b0aa-4af2-9a0b-428332191632\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:15:46.907243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.907222    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/630e1db1-b0aa-4af2-9a0b-428332191632-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2rcbw\" (UID: \"630e1db1-b0aa-4af2-9a0b-428332191632\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:15:46.916682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.916655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwlls\" (UniqueName: \"kubernetes.io/projected/630e1db1-b0aa-4af2-9a0b-428332191632-kube-api-access-mwlls\") pod \"payload-processing-5b54b7fbb7-2rcbw\" (UID: \"630e1db1-b0aa-4af2-9a0b-428332191632\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:15:46.999387 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:46.999354    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:15:47.274482 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:47.274458    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"]
Sep 10 22:15:47.276594 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:15:47.276565    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630e1db1_b0aa_4af2_9a0b_428332191632.slice/crio-afa34a014a99c0faf548571138335ee27bac131467c635a8681f4783d3b3d3d5 WatchSource:0}: Error finding container afa34a014a99c0faf548571138335ee27bac131467c635a8681f4783d3b3d3d5: Status 404 returned error can't find the container with id afa34a014a99c0faf548571138335ee27bac131467c635a8681f4783d3b3d3d5
Sep 10 22:15:47.278582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:47.278565    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:15:47.615567 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:47.615487    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw" event={"ID":"630e1db1-b0aa-4af2-9a0b-428332191632","Type":"ContainerStarted","Data":"afa34a014a99c0faf548571138335ee27bac131467c635a8681f4783d3b3d3d5"}
Sep 10 22:15:49.627822 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:49.627784    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw" event={"ID":"630e1db1-b0aa-4af2-9a0b-428332191632","Type":"ContainerStarted","Data":"c71306a6edb906599f9fdfa7ef01b855c21991f06e775f27bf858ac67d902d46"}
Sep 10 22:15:49.628203 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:49.627952    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:15:49.646266 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:49.646221    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw" podStartSLOduration=2.097545393 podStartE2EDuration="3.646205755s" totalImagesPullingTime="1.548660362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:15:49.644109805 +0000 UTC m=+629.526594170" watchObservedRunningTime="2026-09-10 22:15:49.646205755 +0000 UTC m=+629.528690156"
Sep 10 22:15:55.989768 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:55.989732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:15:56.112446 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:15:56.112409    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:16:00.634819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:00.634786    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2rcbw"
Sep 10 22:16:00.938819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:00.938744    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:16:07.335016 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:07.334984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:16:28.999579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:28.999545    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"]
Sep 10 22:16:29.004945 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.004927    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.007976 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.007954    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v5j2d\""
Sep 10 22:16:29.008077 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.007990    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 22:16:29.008124 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.008074    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 22:16:29.008220 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.008204    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 22:16:29.013579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.013557    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"]
Sep 10 22:16:29.032183 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.032160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:16:29.055175 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.055149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.055275 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.055187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7adfe3e6-0c9d-4365-aacb-93796704c633-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.055275 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.055212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzfmf\" (UniqueName: \"kubernetes.io/projected/7adfe3e6-0c9d-4365-aacb-93796704c633-kube-api-access-zzfmf\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.055363 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.055300    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.055363 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.055326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.055433 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.055387    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.156255 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.156222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.156414 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.156261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.156414 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.156374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.156414 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.156410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.156571 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.156552    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7adfe3e6-0c9d-4365-aacb-93796704c633-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.156635 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.156596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzfmf\" (UniqueName: \"kubernetes.io/projected/7adfe3e6-0c9d-4365-aacb-93796704c633-kube-api-access-zzfmf\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.156688 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.156638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.156688 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.156656    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.156786 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.156695    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.158572 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.158551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7adfe3e6-0c9d-4365-aacb-93796704c633-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.158819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.158800    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7adfe3e6-0c9d-4365-aacb-93796704c633-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.164177 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.164157    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzfmf\" (UniqueName: \"kubernetes.io/projected/7adfe3e6-0c9d-4365-aacb-93796704c633-kube-api-access-zzfmf\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2\" (UID: \"7adfe3e6-0c9d-4365-aacb-93796704c633\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.317038 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.316961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:29.589312 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.589284    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"]
Sep 10 22:16:29.591071 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:16:29.591043    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7adfe3e6_0c9d_4365_aacb_93796704c633.slice/crio-f68a082ee55132ae432175252a737b1380e16bce4e30efcbf336a900a2d7d457 WatchSource:0}: Error finding container f68a082ee55132ae432175252a737b1380e16bce4e30efcbf336a900a2d7d457: Status 404 returned error can't find the container with id f68a082ee55132ae432175252a737b1380e16bce4e30efcbf336a900a2d7d457
Sep 10 22:16:29.838833 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:29.838751    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2" event={"ID":"7adfe3e6-0c9d-4365-aacb-93796704c633","Type":"ContainerStarted","Data":"f68a082ee55132ae432175252a737b1380e16bce4e30efcbf336a900a2d7d457"}
Sep 10 22:16:30.844883 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:30.844762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2" event={"ID":"7adfe3e6-0c9d-4365-aacb-93796704c633","Type":"ContainerStarted","Data":"29eb9e265fbfbb118b859bc686bceed122f70d286f496c811c7a183b54533e79"}
Sep 10 22:16:30.868571 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:30.868518    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2" podStartSLOduration=1.888565452 podStartE2EDuration="2.868499539s" totalImagesPullingTime="979.934087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:16:30.86582862 +0000 UTC m=+670.748312986" watchObservedRunningTime="2026-09-10 22:16:30.868499539 +0000 UTC m=+670.750983904"
Sep 10 22:16:37.525972 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:37.525939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:16:39.317756 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:39.317718    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:39.318255 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:39.317789    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:39.330553 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:39.330532    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:39.900561 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:39.900533    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2"
Sep 10 22:16:50.639092 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:16:50.639057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:17:00.923616 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:00.923575    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:17:00.979168 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:00.979122    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:17:06.009641 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.009607    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"]
Sep 10 22:17:06.014003 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.013982    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.015924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.015904    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 10 22:17:06.023739 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.023713    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"]
Sep 10 22:17:06.067999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.067971    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4292fcf-a830-4ab6-9cc0-227223859d87-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.068134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.068012    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.068134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.068074    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.068134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.068095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.068306 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.068193    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.068306 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.068255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8b8w\" (UniqueName: \"kubernetes.io/projected/d4292fcf-a830-4ab6-9cc0-227223859d87-kube-api-access-r8b8w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.099387 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.099359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:17:06.169390 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.169365    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.169530 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.169395    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.169530 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.169440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.169530 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.169478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8b8w\" (UniqueName: \"kubernetes.io/projected/d4292fcf-a830-4ab6-9cc0-227223859d87-kube-api-access-r8b8w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.169530 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.169505    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4292fcf-a830-4ab6-9cc0-227223859d87-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.169727 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.169633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.169788 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.169751    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.169873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.169802    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.169982 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.169965    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.171738 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.171715    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4292fcf-a830-4ab6-9cc0-227223859d87-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.172038 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.172018    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4292fcf-a830-4ab6-9cc0-227223859d87-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.176316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.176289    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8b8w\" (UniqueName: \"kubernetes.io/projected/d4292fcf-a830-4ab6-9cc0-227223859d87-kube-api-access-r8b8w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klhdb\" (UID: \"d4292fcf-a830-4ab6-9cc0-227223859d87\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.326300 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.326225    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:06.599356 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:06.599322    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"]
Sep 10 22:17:06.600970 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:17:06.600944    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4292fcf_a830_4ab6_9cc0_227223859d87.slice/crio-f88339dba37f3f8058f78b47fa359d8bb364dd722f9cbdcbb1f2a1b41b4ee186 WatchSource:0}: Error finding container f88339dba37f3f8058f78b47fa359d8bb364dd722f9cbdcbb1f2a1b41b4ee186: Status 404 returned error can't find the container with id f88339dba37f3f8058f78b47fa359d8bb364dd722f9cbdcbb1f2a1b41b4ee186
Sep 10 22:17:07.038207 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:07.038175    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb" event={"ID":"d4292fcf-a830-4ab6-9cc0-227223859d87","Type":"ContainerStarted","Data":"4ded012a5e103b9762b357b4671f8c73c4a59518d3255af0b3e658c38e2c93ef"}
Sep 10 22:17:07.038568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:07.038245    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb" event={"ID":"d4292fcf-a830-4ab6-9cc0-227223859d87","Type":"ContainerStarted","Data":"f88339dba37f3f8058f78b47fa359d8bb364dd722f9cbdcbb1f2a1b41b4ee186"}
Sep 10 22:17:07.054294 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:07.054250    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb" podStartSLOduration=1.839891551 podStartE2EDuration="2.054235672s" totalImagesPullingTime="214.344121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:17:07.052668491 +0000 UTC m=+706.935152857" watchObservedRunningTime="2026-09-10 22:17:07.054235672 +0000 UTC m=+706.936720060"
Sep 10 22:17:13.435436 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:13.435364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:17:16.326728 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:16.326696    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:16.327135 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:16.326750    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:16.339206 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:16.339184    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:17.103579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:17.103552    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klhdb"
Sep 10 22:17:49.863100 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:49.863067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:17:49.966001 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:17:49.965967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:03.088219 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:18:03.088179    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:46.436148 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:18:46.436060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:46.524931 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:18:46.524894    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:47.603112 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:18:47.603072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:47.702584 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:18:47.702546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:02.829522 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:02.829486    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:02.960760 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:02.960729    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:03.194225 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:03.194157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:03.343984 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:03.343957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:04.295686 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:04.295626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:04.391337 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:04.391303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:04.750466 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:04.750437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:06.517064 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:06.517023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:06.610409 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:06.610371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:07.843042 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:07.842999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:07.957533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:07.957503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:08.055991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.055959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:08.340144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.340116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:08.439896 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.439865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:08.475250 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.475222    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"]
Sep 10 22:19:08.478785 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.478764    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:08.480920 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.480896    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-669e2b-dockercfg-xdn5m\""
Sep 10 22:19:08.481026 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.480934    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-669e2b\""
Sep 10 22:19:08.489249 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.489227    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"]
Sep 10 22:19:08.637496 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.637417    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d\" (UID: \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:08.637496 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.637481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kglgg\" (UniqueName: \"kubernetes.io/projected/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-kube-api-access-kglgg\") pod \"payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d\" (UID: \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:08.738414 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.738378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d\" (UID: \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:08.738587 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.738445    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kglgg\" (UniqueName: \"kubernetes.io/projected/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-kube-api-access-kglgg\") pod \"payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d\" (UID: \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:08.739188 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.739165    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d\" (UID: \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:08.746323 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.746298    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kglgg\" (UniqueName: \"kubernetes.io/projected/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-kube-api-access-kglgg\") pod \"payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d\" (UID: \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:08.792268 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:08.792241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:09.063406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:09.063382    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"]
Sep 10 22:19:09.065492 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:19:09.065464    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bee4d78_fc5c_4d1b_825a_4f3e09932ce3.slice/crio-5c6f79e1aa75e1a85b4f2ef9db0a195474b31506004d81efaab5c1bd17772cd7 WatchSource:0}: Error finding container 5c6f79e1aa75e1a85b4f2ef9db0a195474b31506004d81efaab5c1bd17772cd7: Status 404 returned error can't find the container with id 5c6f79e1aa75e1a85b4f2ef9db0a195474b31506004d81efaab5c1bd17772cd7
Sep 10 22:19:09.676994 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:09.676956    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d" event={"ID":"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3","Type":"ContainerStarted","Data":"ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b"}
Sep 10 22:19:09.677152 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:09.677112    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:09.677200 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:09.677157    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d" event={"ID":"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3","Type":"ContainerStarted","Data":"5c6f79e1aa75e1a85b4f2ef9db0a195474b31506004d81efaab5c1bd17772cd7"}
Sep 10 22:19:09.697050 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:09.696985    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d" podStartSLOduration=1.696970675 podStartE2EDuration="1.696970675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:09.695360251 +0000 UTC m=+829.577844620" watchObservedRunningTime="2026-09-10 22:19:09.696970675 +0000 UTC m=+829.579455041"
Sep 10 22:19:10.484099 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:10.484065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:10.547860 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:10.547811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:10.704434 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:10.704405    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:10.995396 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:10.995365    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"]
Sep 10 22:19:10.998982 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:10.998961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.001110 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.001092    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-938f94d8-openshift-default-dockercfg-mzxrk\""
Sep 10 22:19:11.011784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.011763    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"]
Sep 10 22:19:11.023317 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.023288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:11.160296 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.160259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-podinfo\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.160461 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.160305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-certs\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.160461 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.160392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-data\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.160461 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.160452    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-credential-socket\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.160568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.160469    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istiod-ca-cert\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.160568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.160492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-envoy\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.160568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.160521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-socket\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.160668 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.160582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-token\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.160668 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.160601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w7cg\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-kube-api-access-6w7cg\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.261745 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.261659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-certs\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.261908 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.261753    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-data\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.261908 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.261807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-credential-socket\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.261908 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.261893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istiod-ca-cert\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.261954    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-envoy\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.262005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-socket\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.262039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-token\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.262063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w7cg\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-kube-api-access-6w7cg\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262303 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.262100    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-podinfo\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262303 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.262178    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-data\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262303 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.262205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-certs\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262303 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.262225    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-credential-socket\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.262414    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-socket\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.262793 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.262776    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istiod-ca-cert\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.264305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.264279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-envoy\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.265024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.264999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-podinfo\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.271309 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.271287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-token\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.271461 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.271444    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w7cg\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-kube-api-access-6w7cg\") pod \"e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") " pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.310381 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.310356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:11.590394 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:19:11.590367    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2880911_b5f4_4fe5_86ae_6ca92adf6177.slice/crio-6ca5c63e6d1f1296b94c171efee1b1f3426ee877f811473b86ea34ea970aa5fc WatchSource:0}: Error finding container 6ca5c63e6d1f1296b94c171efee1b1f3426ee877f811473b86ea34ea970aa5fc: Status 404 returned error can't find the container with id 6ca5c63e6d1f1296b94c171efee1b1f3426ee877f811473b86ea34ea970aa5fc
Sep 10 22:19:11.591939 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.591915    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"]
Sep 10 22:19:11.593142 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.593110    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:11.593223 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.593170    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:11.593223 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.593198    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:11.672065 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.672038    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:11.689021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.688987    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" event={"ID":"a2880911-b5f4-4fe5-86ae-6ca92adf6177","Type":"ContainerStarted","Data":"a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec"}
Sep 10 22:19:11.689158 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.689060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" event={"ID":"a2880911-b5f4-4fe5-86ae-6ca92adf6177","Type":"ContainerStarted","Data":"6ca5c63e6d1f1296b94c171efee1b1f3426ee877f811473b86ea34ea970aa5fc"}
Sep 10 22:19:11.709423 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.709338    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" podStartSLOduration=1.7093170309999999 podStartE2EDuration="1.709317031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:11.707394634 +0000 UTC m=+831.589878992" watchObservedRunningTime="2026-09-10 22:19:11.709317031 +0000 UTC m=+831.591801398"
Sep 10 22:19:11.776023 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:11.775986    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:12.080216 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:12.080184    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:12.311408 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:12.311376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:12.316886 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:12.316829    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:12.336067 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:12.335999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:12.694952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:12.694868    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:12.695924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:12.695900    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:13.252144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:13.252113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:13.341279 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:13.341250    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:14.624878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:14.624800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:14.683379 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:14.683344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:14.943169 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:14.943079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:15.094436 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.094405    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:15.192309 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.192271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:15.194088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.194015    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"]
Sep 10 22:19:15.197424 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.197404    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:15.201001 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.200976    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-938f94d8\""
Sep 10 22:19:15.201476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.201457    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-938f94d8-dockercfg-rqmwm\""
Sep 10 22:19:15.208929 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.208907    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"]
Sep 10 22:19:15.299740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.299704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4249x\" (UniqueName: \"kubernetes.io/projected/81c8e7c2-438b-42a8-a5c5-f001c0830635-kube-api-access-4249x\") pod \"payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8\" (UID: \"81c8e7c2-438b-42a8-a5c5-f001c0830635\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:15.299916 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.299833    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81c8e7c2-438b-42a8-a5c5-f001c0830635-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8\" (UID: \"81c8e7c2-438b-42a8-a5c5-f001c0830635\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:15.400386 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.400351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4249x\" (UniqueName: \"kubernetes.io/projected/81c8e7c2-438b-42a8-a5c5-f001c0830635-kube-api-access-4249x\") pod \"payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8\" (UID: \"81c8e7c2-438b-42a8-a5c5-f001c0830635\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:15.400545 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.400513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81c8e7c2-438b-42a8-a5c5-f001c0830635-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8\" (UID: \"81c8e7c2-438b-42a8-a5c5-f001c0830635\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:15.401204 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.401186    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81c8e7c2-438b-42a8-a5c5-f001c0830635-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8\" (UID: \"81c8e7c2-438b-42a8-a5c5-f001c0830635\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:15.407900 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.407879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4249x\" (UniqueName: \"kubernetes.io/projected/81c8e7c2-438b-42a8-a5c5-f001c0830635-kube-api-access-4249x\") pod \"payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8\" (UID: \"81c8e7c2-438b-42a8-a5c5-f001c0830635\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:15.509659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.509634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:15.687280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.687201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:15.798352 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.795530    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"]
Sep 10 22:19:15.799881 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:15.799829    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:16.717085 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:16.717038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8" event={"ID":"81c8e7c2-438b-42a8-a5c5-f001c0830635","Type":"ContainerStarted","Data":"1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034"}
Sep 10 22:19:16.717491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:16.717105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8" event={"ID":"81c8e7c2-438b-42a8-a5c5-f001c0830635","Type":"ContainerStarted","Data":"5cf47ba6361448eecfbb5f8d3691da156abcc2a0f01bb9dd039017a33349e95b"}
Sep 10 22:19:16.717491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:16.717137    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:16.736499 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:16.736451    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8" podStartSLOduration=1.7364370070000001 podStartE2EDuration="1.736437007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:16.734014205 +0000 UTC m=+836.616498572" watchObservedRunningTime="2026-09-10 22:19:16.736437007 +0000 UTC m=+836.618921373"
Sep 10 22:19:16.947876 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:16.947811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:17.047140 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.047084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:17.309208 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.309116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:17.471629 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.471596    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:17.570190 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.570103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:17.574882 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.574855    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"]
Sep 10 22:19:17.579848 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.579815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:17.583235 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.583211    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-44dc54\""
Sep 10 22:19:17.583235 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.583234    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-44dc54-dockercfg-vsb4b\""
Sep 10 22:19:17.590034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.590012    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"]
Sep 10 22:19:17.619044 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.619011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/454482a9-30d0-4ab4-9d87-725570b32c74-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq\" (UID: \"454482a9-30d0-4ab4-9d87-725570b32c74\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:17.619171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.619137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2hsv\" (UniqueName: \"kubernetes.io/projected/454482a9-30d0-4ab4-9d87-725570b32c74-kube-api-access-w2hsv\") pod \"payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq\" (UID: \"454482a9-30d0-4ab4-9d87-725570b32c74\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:17.720317 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.720282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/454482a9-30d0-4ab4-9d87-725570b32c74-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq\" (UID: \"454482a9-30d0-4ab4-9d87-725570b32c74\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:17.720722 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.720406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2hsv\" (UniqueName: \"kubernetes.io/projected/454482a9-30d0-4ab4-9d87-725570b32c74-kube-api-access-w2hsv\") pod \"payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq\" (UID: \"454482a9-30d0-4ab4-9d87-725570b32c74\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:17.721082 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.721063    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/454482a9-30d0-4ab4-9d87-725570b32c74-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq\" (UID: \"454482a9-30d0-4ab4-9d87-725570b32c74\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:17.731553 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.731523    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2hsv\" (UniqueName: \"kubernetes.io/projected/454482a9-30d0-4ab4-9d87-725570b32c74-kube-api-access-w2hsv\") pod \"payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq\" (UID: \"454482a9-30d0-4ab4-9d87-725570b32c74\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:17.890901 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:17.890815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:18.162430 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:18.162404    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"]
Sep 10 22:19:18.163899 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:19:18.163872    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454482a9_30d0_4ab4_9d87_725570b32c74.slice/crio-46830a967043eb369f0a7f4f02ed5cd492af99e37b7fae1585484cba5f7b5ec4 WatchSource:0}: Error finding container 46830a967043eb369f0a7f4f02ed5cd492af99e37b7fae1585484cba5f7b5ec4: Status 404 returned error can't find the container with id 46830a967043eb369f0a7f4f02ed5cd492af99e37b7fae1585484cba5f7b5ec4
Sep 10 22:19:18.731573 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:18.731537    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq" event={"ID":"454482a9-30d0-4ab4-9d87-725570b32c74","Type":"ContainerStarted","Data":"01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8"}
Sep 10 22:19:18.732017 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:18.731599    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq" event={"ID":"454482a9-30d0-4ab4-9d87-725570b32c74","Type":"ContainerStarted","Data":"46830a967043eb369f0a7f4f02ed5cd492af99e37b7fae1585484cba5f7b5ec4"}
Sep 10 22:19:18.732017 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:18.731629    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:18.746578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:18.746535    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq" podStartSLOduration=1.746522749 podStartE2EDuration="1.746522749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:18.744464449 +0000 UTC m=+838.626948817" watchObservedRunningTime="2026-09-10 22:19:18.746522749 +0000 UTC m=+838.629007115"
Sep 10 22:19:19.659558 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:19.659521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:19.756723 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:19.756692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:19.928595 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:19.928514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:20.684438 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:20.684411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:19:21.477984 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:21.477954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:21.647229 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:21.647200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:21.729229 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:21.729142    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:21.795734 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:21.795704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:24.438394 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:24.438359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:25.353858 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:25.353800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:26.029482 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:26.029443    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:26.316417 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:26.316285    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:26.377899 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:26.377866    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:26.464524 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:26.464495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:26.562103 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:26.562058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:26.687515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:26.687440    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:27.725880 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:27.725823    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:29.739451 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:29.739423    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:19:29.810671 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:29.810598    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:31.466452 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:31.466411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:31.801065 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:31.801026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:32.070287 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.070190    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"]
Sep 10 22:19:32.075316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.075289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.077491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.077471    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c3af05-openshift-default-dockercfg-wgh2r\""
Sep 10 22:19:32.085664 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.085639    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"]
Sep 10 22:19:32.105458 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.105419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:32.149036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.149000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-socket\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.149036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.149031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-certs\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.149233 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.149050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlmf4\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-kube-api-access-jlmf4\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.149233 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.149090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-credential-socket\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.149233 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.149135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-envoy\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.149233 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.149187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-data\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.149233 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.149203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-token\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.149402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.149248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-podinfo\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.149402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.149263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istiod-ca-cert\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.242426 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.242388    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:32.250574 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.250548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-podinfo\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.250703 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.250588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istiod-ca-cert\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.250703 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.250641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-socket\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.250703 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.250657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-certs\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.250703 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.250674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlmf4\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-kube-api-access-jlmf4\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.250952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.250722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-credential-socket\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.250952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.250745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-envoy\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.250952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.250792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-data\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.250952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.250816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-token\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.251205 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.251179    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-socket\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.251280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.251256    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-data\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.251280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.251272    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-credential-socket\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.251399 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.251369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-certs\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.251582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.251562    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istiod-ca-cert\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.253195 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.253175    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-envoy\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.253309 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.253285    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-podinfo\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.258242 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.258218    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-token\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.258485 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.258464    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlmf4\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-kube-api-access-jlmf4\") pod \"e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") " pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.388586 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.388492    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:32.671914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.671884    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"]
Sep 10 22:19:32.673366 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:19:32.673341    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b0db21_5ca9_4eb0_b391_b1b5635b9903.slice/crio-c2539994b48b59c599f26605e9bf91f1a7324ef478443d1b143172e4338d94a2 WatchSource:0}: Error finding container c2539994b48b59c599f26605e9bf91f1a7324ef478443d1b143172e4338d94a2: Status 404 returned error can't find the container with id c2539994b48b59c599f26605e9bf91f1a7324ef478443d1b143172e4338d94a2
Sep 10 22:19:32.676122 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.676092    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:32.676197 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.676152    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:32.676197 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.676183    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:32.677920 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.677892    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:32.739031 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.739003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:32.819098 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.819056    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" event={"ID":"33b0db21-5ca9-4eb0-b391-b1b5635b9903","Type":"ContainerStarted","Data":"7a6533fcff69e3ca1653094dd3167cb3fd6694f3c888c8d0b8b2368b6be40ccc"}
Sep 10 22:19:32.819260 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.819129    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" event={"ID":"33b0db21-5ca9-4eb0-b391-b1b5635b9903","Type":"ContainerStarted","Data":"c2539994b48b59c599f26605e9bf91f1a7324ef478443d1b143172e4338d94a2"}
Sep 10 22:19:32.841018 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:32.840973    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" podStartSLOduration=0.84095628 podStartE2EDuration="840.95628ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:32.838038764 +0000 UTC m=+852.720523132" watchObservedRunningTime="2026-09-10 22:19:32.84095628 +0000 UTC m=+852.723440645"
Sep 10 22:19:33.389414 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:33.389377    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:33.394901 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:33.394878    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:33.824510 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:33.824480    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:33.826935 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:33.825360    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:34.734998 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:34.734924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:34.823008 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:34.822978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:34.832095 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:34.832058    2573 generic.go:356] "Generic (PLEG): container finished" podID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerID="a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec" exitCode=0
Sep 10 22:19:34.832535 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:34.832131    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" event={"ID":"a2880911-b5f4-4fe5-86ae-6ca92adf6177","Type":"ContainerDied","Data":"a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec"}
Sep 10 22:19:34.832720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:34.832699    2573 scope.go:117] "RemoveContainer" containerID="a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec"
Sep 10 22:19:34.833816 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:34.833785    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:34.833961 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:34.833898    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:34.833961 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:34.833935    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:35.453104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:35.453076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:35.839908 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:35.839874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" event={"ID":"a2880911-b5f4-4fe5-86ae-6ca92adf6177","Type":"ContainerStarted","Data":"07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb"}
Sep 10 22:19:36.315079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.314991    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:36.316322 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.315952    2573 patch_prober.go:28] interesting pod/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:19:36.316322 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.316037    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 22:19:36.339833 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.339801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:36.440475 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.440441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:36.708721 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.708628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:36.812751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.812712    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:36.882791 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.882759    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:36.884021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.884000    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"]
Sep 10 22:19:36.887530 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.887515    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:36.889754 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.889727    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c3af05\""
Sep 10 22:19:36.889970 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.889732    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-c3af05-dockercfg-2tkrs\""
Sep 10 22:19:36.904860 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.896790    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"]
Sep 10 22:19:36.930370 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.930327    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"]
Sep 10 22:19:36.933831 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.933807    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:36.942261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:36.942238    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"]
Sep 10 22:19:37.013931 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.013884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqq7k\" (UniqueName: \"kubernetes.io/projected/c81e5394-979f-48a0-8c56-c2d6345a6ef3-kube-api-access-nqq7k\") pod \"payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72\" (UID: \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:37.013931 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.013933    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6568fef5-2bb0-4795-8b94-bc5ba9db4950-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs\" (UID: \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:37.014185 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.013988    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jbhr\" (UniqueName: \"kubernetes.io/projected/6568fef5-2bb0-4795-8b94-bc5ba9db4950-kube-api-access-5jbhr\") pod \"payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs\" (UID: \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:37.014185 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.014023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81e5394-979f-48a0-8c56-c2d6345a6ef3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72\" (UID: \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:37.114709 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.114673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jbhr\" (UniqueName: \"kubernetes.io/projected/6568fef5-2bb0-4795-8b94-bc5ba9db4950-kube-api-access-5jbhr\") pod \"payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs\" (UID: \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:37.115028 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.114991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81e5394-979f-48a0-8c56-c2d6345a6ef3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72\" (UID: \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:37.115354 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.115333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqq7k\" (UniqueName: \"kubernetes.io/projected/c81e5394-979f-48a0-8c56-c2d6345a6ef3-kube-api-access-nqq7k\") pod \"payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72\" (UID: \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:37.115510 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.115492    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6568fef5-2bb0-4795-8b94-bc5ba9db4950-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs\" (UID: \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:37.116151 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.116128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81e5394-979f-48a0-8c56-c2d6345a6ef3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72\" (UID: \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:37.116561 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.116534    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6568fef5-2bb0-4795-8b94-bc5ba9db4950-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs\" (UID: \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:37.126264 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.126239    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jbhr\" (UniqueName: \"kubernetes.io/projected/6568fef5-2bb0-4795-8b94-bc5ba9db4950-kube-api-access-5jbhr\") pod \"payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs\" (UID: \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:37.126361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.126241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqq7k\" (UniqueName: \"kubernetes.io/projected/c81e5394-979f-48a0-8c56-c2d6345a6ef3-kube-api-access-nqq7k\") pod \"payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72\" (UID: \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:37.152830 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.152804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:37.211429 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.211397    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:37.245394 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.245368    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:37.326188 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.325684    2573 patch_prober.go:28] interesting pod/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:19:37.326188 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.325756    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 22:19:37.491584 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.491555    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"]
Sep 10 22:19:37.493376 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:19:37.493345    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6568fef5_2bb0_4795_8b94_bc5ba9db4950.slice/crio-556eaede838c1968a474f7e29ec7f3d9751bdafcc23e70b71b44a15cf0deffa9 WatchSource:0}: Error finding container 556eaede838c1968a474f7e29ec7f3d9751bdafcc23e70b71b44a15cf0deffa9: Status 404 returned error can't find the container with id 556eaede838c1968a474f7e29ec7f3d9751bdafcc23e70b71b44a15cf0deffa9
Sep 10 22:19:37.574536 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.574509    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"]
Sep 10 22:19:37.575899 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:19:37.575876    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81e5394_979f_48a0_8c56_c2d6345a6ef3.slice/crio-e4067c6fbf9bac98824960fd247c9f9d3da5b046e674bb381ea5ccf11d375ac3 WatchSource:0}: Error finding container e4067c6fbf9bac98824960fd247c9f9d3da5b046e674bb381ea5ccf11d375ac3: Status 404 returned error can't find the container with id e4067c6fbf9bac98824960fd247c9f9d3da5b046e674bb381ea5ccf11d375ac3
Sep 10 22:19:37.853882 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.853770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72" event={"ID":"c81e5394-979f-48a0-8c56-c2d6345a6ef3","Type":"ContainerStarted","Data":"51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df"}
Sep 10 22:19:37.853882 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.853833    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72" event={"ID":"c81e5394-979f-48a0-8c56-c2d6345a6ef3","Type":"ContainerStarted","Data":"e4067c6fbf9bac98824960fd247c9f9d3da5b046e674bb381ea5ccf11d375ac3"}
Sep 10 22:19:37.854113 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.853978    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:37.855558 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.855531    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs" event={"ID":"6568fef5-2bb0-4795-8b94-bc5ba9db4950","Type":"ContainerStarted","Data":"30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a"}
Sep 10 22:19:37.855690 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.855571    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs" event={"ID":"6568fef5-2bb0-4795-8b94-bc5ba9db4950","Type":"ContainerStarted","Data":"556eaede838c1968a474f7e29ec7f3d9751bdafcc23e70b71b44a15cf0deffa9"}
Sep 10 22:19:37.855690 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.855599    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:37.871312 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.871263    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72" podStartSLOduration=1.871247154 podStartE2EDuration="1.871247154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:37.868975896 +0000 UTC m=+857.751460272" watchObservedRunningTime="2026-09-10 22:19:37.871247154 +0000 UTC m=+857.753731525"
Sep 10 22:19:37.883748 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.883706    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs" podStartSLOduration=1.883693628 podStartE2EDuration="1.883693628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:37.882214533 +0000 UTC m=+857.764698899" watchObservedRunningTime="2026-09-10 22:19:37.883693628 +0000 UTC m=+857.766177994"
Sep 10 22:19:37.922815 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:37.922751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:38.311710 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:38.311674    2573 patch_prober.go:28] interesting pod/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:19:38.311997 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:38.311970    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 22:19:38.738019 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:38.737983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:39.311678 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:39.311236    2573 patch_prober.go:28] interesting pod/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:19:39.311678 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:39.311298    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 22:19:39.534033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:39.533973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:40.182062 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:40.182026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:40.311181 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:40.311137    2573 patch_prober.go:28] interesting pod/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:19:40.311384 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:40.311215    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 22:19:40.529112 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:40.529070    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:41.311605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:41.311566    2573 patch_prober.go:28] interesting pod/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:19:41.311922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:41.311889    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 22:19:42.314996 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:42.314960    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:42.315447 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:42.315249    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:42.316006 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:42.315988    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:19:48.863814 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:48.863782    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:19:48.864266 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:48.864043    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:19:49.865982 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:49.865945    2573 patch_prober.go:28] interesting pod/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 22:19:49.866359 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:49.866002    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:19:51.944890 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:51.944832    2573 generic.go:356] "Generic (PLEG): container finished" podID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerID="7a6533fcff69e3ca1653094dd3167cb3fd6694f3c888c8d0b8b2368b6be40ccc" exitCode=0
Sep 10 22:19:51.945323 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:51.944907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" event={"ID":"33b0db21-5ca9-4eb0-b391-b1b5635b9903","Type":"ContainerDied","Data":"7a6533fcff69e3ca1653094dd3167cb3fd6694f3c888c8d0b8b2368b6be40ccc"}
Sep 10 22:19:51.945323 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:51.945265    2573 scope.go:117] "RemoveContainer" containerID="7a6533fcff69e3ca1653094dd3167cb3fd6694f3c888c8d0b8b2368b6be40ccc"
Sep 10 22:19:51.946327 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:51.946299    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:51.946423 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:51.946382    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:51.946486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:51.946433    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:19:52.952320 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:52.952288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" event={"ID":"33b0db21-5ca9-4eb0-b391-b1b5635b9903","Type":"ContainerStarted","Data":"e4f737183bb4f541df68110dea3203cb869e28b22251157df0cfcfdddb36a634"}
Sep 10 22:19:53.389441 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:53.389414    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:53.389651 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:53.389629    2573 patch_prober.go:28] interesting pod/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:19:53.389702 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:53.389686    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 22:19:54.389712 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:54.389677    2573 patch_prober.go:28] interesting pod/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:19:54.390116 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:54.389736    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 22:19:54.610626 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:54.610553    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.260782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.260747    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.307903 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.307867    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"]
Sep 10 22:19:55.308488 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.308452    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8" podUID="81c8e7c2-438b-42a8-a5c5-f001c0830635" containerName="payload-pre-processing" containerID="cri-o://1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034" gracePeriod=30
Sep 10 22:19:55.333319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.330768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.388813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.388781    2573 patch_prober.go:28] interesting pod/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:19:55.388994 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.388862    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 22:19:55.425551 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.425498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.489799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.489762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.576522 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.576426    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"]
Sep 10 22:19:55.576966 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.576935    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy" containerID="cri-o://07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb" gracePeriod=30
Sep 10 22:19:55.609648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.609576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.647918 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.647890    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:55.720927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.720203    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4249x\" (UniqueName: \"kubernetes.io/projected/81c8e7c2-438b-42a8-a5c5-f001c0830635-kube-api-access-4249x\") pod \"81c8e7c2-438b-42a8-a5c5-f001c0830635\" (UID: \"81c8e7c2-438b-42a8-a5c5-f001c0830635\") "
Sep 10 22:19:55.720927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.720273    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81c8e7c2-438b-42a8-a5c5-f001c0830635-plugins-config-volume\") pod \"81c8e7c2-438b-42a8-a5c5-f001c0830635\" (UID: \"81c8e7c2-438b-42a8-a5c5-f001c0830635\") "
Sep 10 22:19:55.721672 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.721341    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81c8e7c2-438b-42a8-a5c5-f001c0830635-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "81c8e7c2-438b-42a8-a5c5-f001c0830635" (UID: "81c8e7c2-438b-42a8-a5c5-f001c0830635"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:19:55.727037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.727010    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81c8e7c2-438b-42a8-a5c5-f001c0830635-kube-api-access-4249x" (OuterVolumeSpecName: "kube-api-access-4249x") pod "81c8e7c2-438b-42a8-a5c5-f001c0830635" (UID: "81c8e7c2-438b-42a8-a5c5-f001c0830635"). InnerVolumeSpecName "kube-api-access-4249x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:19:55.822172 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.822137    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4249x\" (UniqueName: \"kubernetes.io/projected/81c8e7c2-438b-42a8-a5c5-f001c0830635-kube-api-access-4249x\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:19:55.822172 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.822167    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81c8e7c2-438b-42a8-a5c5-f001c0830635-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:19:55.970192 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.970118    2573 generic.go:356] "Generic (PLEG): container finished" podID="81c8e7c2-438b-42a8-a5c5-f001c0830635" containerID="1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034" exitCode=0
Sep 10 22:19:55.970192 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.970159    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"
Sep 10 22:19:55.970370 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.970206    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8" event={"ID":"81c8e7c2-438b-42a8-a5c5-f001c0830635","Type":"ContainerDied","Data":"1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034"}
Sep 10 22:19:55.970370 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.970268    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8" event={"ID":"81c8e7c2-438b-42a8-a5c5-f001c0830635","Type":"ContainerDied","Data":"5cf47ba6361448eecfbb5f8d3691da156abcc2a0f01bb9dd039017a33349e95b"}
Sep 10 22:19:55.970370 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.970291    2573 scope.go:117] "RemoveContainer" containerID="1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034"
Sep 10 22:19:55.980631 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.980567    2573 scope.go:117] "RemoveContainer" containerID="1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034"
Sep 10 22:19:55.980824 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:19:55.980807    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034\": container with ID starting with 1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034 not found: ID does not exist" containerID="1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034"
Sep 10 22:19:55.980901 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.980832    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034"} err="failed to get container status \"1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034\": rpc error: code = NotFound desc = could not find container \"1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034\": container with ID starting with 1121d7f576907158561e6b01bb183813fb4e2665a5cfd95a1ff7db7a260a8034 not found: ID does not exist"
Sep 10 22:19:55.994254 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:55.994210    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"]
Sep 10 22:19:56.017824 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:56.017777    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-938f94d8-77f85f6fd-qh9z8"]
Sep 10 22:19:56.036369 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:56.036326    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:56.136004 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:56.135969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:56.234505 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:56.234473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:56.389502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:56.389472    2573 patch_prober.go:28] interesting pod/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:19:56.389631 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:56.389535    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 22:19:56.546102 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:56.546017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:56.554034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:56.554012    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81c8e7c2-438b-42a8-a5c5-f001c0830635" path="/var/lib/kubelet/pods/81c8e7c2-438b-42a8-a5c5-f001c0830635/volumes"
Sep 10 22:19:57.065583 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:57.065552    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:57.319327 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:57.319240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:57.320447 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:57.320415    2573 patch_prober.go:28] interesting pod/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:19:57.320572 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:57.320492    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:19:57.389102 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:57.389067    2573 patch_prober.go:28] interesting pod/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:19:57.389308 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:57.389275    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 22:19:58.624543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:58.624510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:58.625432 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:58.625407    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:58.626712 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:58.626690    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:19:59.547909 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:59.547873    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:59.645377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:59.645337    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:59.723502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:59.723472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:59.912506 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:19:59.912469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:00.287995 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.287964    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:00.398045 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.398007    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:00.413944 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.413914    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"]
Sep 10 22:20:00.414505 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.414482    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81c8e7c2-438b-42a8-a5c5-f001c0830635" containerName="payload-pre-processing"
Sep 10 22:20:00.414642 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.414574    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="81c8e7c2-438b-42a8-a5c5-f001c0830635" containerName="payload-pre-processing"
Sep 10 22:20:00.414733 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.414717    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="81c8e7c2-438b-42a8-a5c5-f001c0830635" containerName="payload-pre-processing"
Sep 10 22:20:00.419057 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.419035    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:00.421330 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.421312    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-7178ee60\""
Sep 10 22:20:00.431274 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.431248    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"]
Sep 10 22:20:00.469640 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.469611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nzc9\" (UniqueName: \"kubernetes.io/projected/dad302b1-fd22-4c6b-9945-c9fc28f8af44-kube-api-access-9nzc9\") pod \"payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf\" (UID: \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:00.469785 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.469662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad302b1-fd22-4c6b-9945-c9fc28f8af44-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf\" (UID: \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:00.570740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.570658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nzc9\" (UniqueName: \"kubernetes.io/projected/dad302b1-fd22-4c6b-9945-c9fc28f8af44-kube-api-access-9nzc9\") pod \"payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf\" (UID: \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:00.570740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.570707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad302b1-fd22-4c6b-9945-c9fc28f8af44-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf\" (UID: \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:00.571387 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.571362    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad302b1-fd22-4c6b-9945-c9fc28f8af44-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf\" (UID: \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:00.579340 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.579314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nzc9\" (UniqueName: \"kubernetes.io/projected/dad302b1-fd22-4c6b-9945-c9fc28f8af44-kube-api-access-9nzc9\") pod \"payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf\" (UID: \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:00.730935 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.730898    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:00.947375 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.947355    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:20:00.974559 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974535    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-credential-socket\") pod \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") "
Sep 10 22:20:00.974696 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974583    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istiod-ca-cert\") pod \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") "
Sep 10 22:20:00.974696 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974607    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-socket\") pod \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") "
Sep 10 22:20:00.974696 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974637    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-podinfo\") pod \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") "
Sep 10 22:20:00.974696 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974692    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-data\") pod \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") "
Sep 10 22:20:00.974940 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974736    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w7cg\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-kube-api-access-6w7cg\") pod \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") "
Sep 10 22:20:00.974940 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974768    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-certs\") pod \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") "
Sep 10 22:20:00.974940 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974834    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2880911-b5f4-4fe5-86ae-6ca92adf6177" (UID: "a2880911-b5f4-4fe5-86ae-6ca92adf6177"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:00.974940 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974865    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-envoy\") pod \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") "
Sep 10 22:20:00.974940 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974894    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-token\") pod \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\" (UID: \"a2880911-b5f4-4fe5-86ae-6ca92adf6177\") "
Sep 10 22:20:00.975205 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.974982    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2880911-b5f4-4fe5-86ae-6ca92adf6177" (UID: "a2880911-b5f4-4fe5-86ae-6ca92adf6177"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:00.975205 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.975066    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2880911-b5f4-4fe5-86ae-6ca92adf6177" (UID: "a2880911-b5f4-4fe5-86ae-6ca92adf6177"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:00.975609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.975364    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:00.975609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.975387    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:00.975609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.975402    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:00.975609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.975440    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2880911-b5f4-4fe5-86ae-6ca92adf6177" (UID: "a2880911-b5f4-4fe5-86ae-6ca92adf6177"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:00.975609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.975571    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2880911-b5f4-4fe5-86ae-6ca92adf6177" (UID: "a2880911-b5f4-4fe5-86ae-6ca92adf6177"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:00.977107 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.977081    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-kube-api-access-6w7cg" (OuterVolumeSpecName: "kube-api-access-6w7cg") pod "a2880911-b5f4-4fe5-86ae-6ca92adf6177" (UID: "a2880911-b5f4-4fe5-86ae-6ca92adf6177"). InnerVolumeSpecName "kube-api-access-6w7cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:00.977421 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.977402    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2880911-b5f4-4fe5-86ae-6ca92adf6177" (UID: "a2880911-b5f4-4fe5-86ae-6ca92adf6177"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:00.977652 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.977624    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2880911-b5f4-4fe5-86ae-6ca92adf6177" (UID: "a2880911-b5f4-4fe5-86ae-6ca92adf6177"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:20:00.977736 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:00.977703    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2880911-b5f4-4fe5-86ae-6ca92adf6177" (UID: "a2880911-b5f4-4fe5-86ae-6ca92adf6177"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:20:01.000656 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.000633    2573 generic.go:356] "Generic (PLEG): container finished" podID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerID="07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb" exitCode=0
Sep 10 22:20:01.000790 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.000676    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"
Sep 10 22:20:01.000790 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.000728    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" event={"ID":"a2880911-b5f4-4fe5-86ae-6ca92adf6177","Type":"ContainerDied","Data":"07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb"}
Sep 10 22:20:01.000941 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.000794    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl" event={"ID":"a2880911-b5f4-4fe5-86ae-6ca92adf6177","Type":"ContainerDied","Data":"6ca5c63e6d1f1296b94c171efee1b1f3426ee877f811473b86ea34ea970aa5fc"}
Sep 10 22:20:01.000941 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.000824    2573 scope.go:117] "RemoveContainer" containerID="07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb"
Sep 10 22:20:01.007399 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.007376    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"]
Sep 10 22:20:01.008475 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:20:01.008449    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad302b1_fd22_4c6b_9945_c9fc28f8af44.slice/crio-b3f453380f99657c824fc8f07f112b1cb781e0177adb35298166988eab1ed6a4 WatchSource:0}: Error finding container b3f453380f99657c824fc8f07f112b1cb781e0177adb35298166988eab1ed6a4: Status 404 returned error can't find the container with id b3f453380f99657c824fc8f07f112b1cb781e0177adb35298166988eab1ed6a4
Sep 10 22:20:01.012875 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.012827    2573 scope.go:117] "RemoveContainer" containerID="a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec"
Sep 10 22:20:01.021119 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.021099    2573 scope.go:117] "RemoveContainer" containerID="07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb"
Sep 10 22:20:01.021384 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:20:01.021365    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb\": container with ID starting with 07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb not found: ID does not exist" containerID="07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb"
Sep 10 22:20:01.021447 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.021391    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb"} err="failed to get container status \"07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb\": rpc error: code = NotFound desc = could not find container \"07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb\": container with ID starting with 07c867662d8ee643d44057541e760f83d814a5f37cea6d8e565e3eddd6e922fb not found: ID does not exist"
Sep 10 22:20:01.021447 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.021407    2573 scope.go:117] "RemoveContainer" containerID="a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec"
Sep 10 22:20:01.021655 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:20:01.021638    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec\": container with ID starting with a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec not found: ID does not exist" containerID="a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec"
Sep 10 22:20:01.021694 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.021662    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec"} err="failed to get container status \"a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec\": rpc error: code = NotFound desc = could not find container \"a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec\": container with ID starting with a54563d5a69e03a92f6424f7ac4ac75d4079b8095b4ec30089443fa10c7199ec not found: ID does not exist"
Sep 10 22:20:01.026221 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.026199    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"]
Sep 10 22:20:01.033445 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.033424    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-938f94d8-openshift-default-7dbd99878b-9jrrl"]
Sep 10 22:20:01.076267 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.076244    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:01.076267 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.076268    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:01.076393 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.076278    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:01.076393 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.076286    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2880911-b5f4-4fe5-86ae-6ca92adf6177-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:01.076393 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.076295    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w7cg\" (UniqueName: \"kubernetes.io/projected/a2880911-b5f4-4fe5-86ae-6ca92adf6177-kube-api-access-6w7cg\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:01.076393 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:01.076305    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2880911-b5f4-4fe5-86ae-6ca92adf6177-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:02.010312 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:02.010279    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf" event={"ID":"dad302b1-fd22-4c6b-9945-c9fc28f8af44","Type":"ContainerStarted","Data":"c6a71088860a4e43a8abd8db58996750da44d9010025705e3784549ffe68b5ac"}
Sep 10 22:20:02.010721 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:02.010337    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf" event={"ID":"dad302b1-fd22-4c6b-9945-c9fc28f8af44","Type":"ContainerStarted","Data":"b3f453380f99657c824fc8f07f112b1cb781e0177adb35298166988eab1ed6a4"}
Sep 10 22:20:02.010721 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:02.010363    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:02.080764 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:02.080710    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf" podStartSLOduration=2.080695754 podStartE2EDuration="2.080695754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:20:02.079060636 +0000 UTC m=+881.961545004" watchObservedRunningTime="2026-09-10 22:20:02.080695754 +0000 UTC m=+881.963180119"
Sep 10 22:20:02.554486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:02.554458    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" path="/var/lib/kubelet/pods/a2880911-b5f4-4fe5-86ae-6ca92adf6177/volumes"
Sep 10 22:20:13.017922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:13.017892    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:20.534170 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:20.534141    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:20:20.535527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:20.535505    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:20:24.364618 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.364581    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"]
Sep 10 22:20:24.365035 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.365021    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy"
Sep 10 22:20:24.365079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.365036    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy"
Sep 10 22:20:24.365159 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.365105    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy"
Sep 10 22:20:24.365159 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.365113    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy"
Sep 10 22:20:24.369482 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.369466    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"
Sep 10 22:20:24.372635 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.372613    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:20:24.390035 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.390008    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"]
Sep 10 22:20:24.483454 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.483402    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9912de9-a47b-4264-88bf-d5f5d6e728a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7\" (UID: \"e9912de9-a47b-4264-88bf-d5f5d6e728a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"
Sep 10 22:20:24.584197 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.584165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9912de9-a47b-4264-88bf-d5f5d6e728a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7\" (UID: \"e9912de9-a47b-4264-88bf-d5f5d6e728a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"
Sep 10 22:20:24.584722 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.584705    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9912de9-a47b-4264-88bf-d5f5d6e728a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7\" (UID: \"e9912de9-a47b-4264-88bf-d5f5d6e728a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"
Sep 10 22:20:24.679816 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.679745    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"
Sep 10 22:20:24.951649 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:24.951624    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"]
Sep 10 22:20:24.953440 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:20:24.953406    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9912de9_a47b_4264_88bf_d5f5d6e728a1.slice/crio-548c70e209d819c678c1dd62c65f22546a881a60a27d30929211ade5abd53c15 WatchSource:0}: Error finding container 548c70e209d819c678c1dd62c65f22546a881a60a27d30929211ade5abd53c15: Status 404 returned error can't find the container with id 548c70e209d819c678c1dd62c65f22546a881a60a27d30929211ade5abd53c15
Sep 10 22:20:25.140953 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:25.140919    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7" event={"ID":"e9912de9-a47b-4264-88bf-d5f5d6e728a1","Type":"ContainerStarted","Data":"548c70e209d819c678c1dd62c65f22546a881a60a27d30929211ade5abd53c15"}
Sep 10 22:20:28.161066 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:28.161032    2573 generic.go:356] "Generic (PLEG): container finished" podID="e9912de9-a47b-4264-88bf-d5f5d6e728a1" containerID="1b20e4f2b48ac9ef47f638ab4d41abaca7d39c147f3a3465512dc5d307393e0d" exitCode=0
Sep 10 22:20:28.161450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:28.161116    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7" event={"ID":"e9912de9-a47b-4264-88bf-d5f5d6e728a1","Type":"ContainerDied","Data":"1b20e4f2b48ac9ef47f638ab4d41abaca7d39c147f3a3465512dc5d307393e0d"}
Sep 10 22:20:29.304179 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:29.304156    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"
Sep 10 22:20:29.430551 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:29.430468    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9912de9-a47b-4264-88bf-d5f5d6e728a1-maas-api-service-ca\") pod \"e9912de9-a47b-4264-88bf-d5f5d6e728a1\" (UID: \"e9912de9-a47b-4264-88bf-d5f5d6e728a1\") "
Sep 10 22:20:29.430801 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:29.430779    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9912de9-a47b-4264-88bf-d5f5d6e728a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9912de9-a47b-4264-88bf-d5f5d6e728a1" (UID: "e9912de9-a47b-4264-88bf-d5f5d6e728a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:29.531672 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:29.531642    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9912de9-a47b-4264-88bf-d5f5d6e728a1-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:30.173305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:30.173276    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"
Sep 10 22:20:30.173469 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:30.173318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7" event={"ID":"e9912de9-a47b-4264-88bf-d5f5d6e728a1","Type":"ContainerDied","Data":"548c70e209d819c678c1dd62c65f22546a881a60a27d30929211ade5abd53c15"}
Sep 10 22:20:30.173469 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:30.173363    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="548c70e209d819c678c1dd62c65f22546a881a60a27d30929211ade5abd53c15"
Sep 10 22:20:30.992521 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:30.992460    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:31.035751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.034348    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"]
Sep 10 22:20:31.035751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.034641    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf" podUID="dad302b1-fd22-4c6b-9945-c9fc28f8af44" containerName="payload-pre-processing" containerID="cri-o://c6a71088860a4e43a8abd8db58996750da44d9010025705e3784549ffe68b5ac" gracePeriod=30
Sep 10 22:20:31.089325 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.089291    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:31.180531 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.180494    2573 generic.go:356] "Generic (PLEG): container finished" podID="dad302b1-fd22-4c6b-9945-c9fc28f8af44" containerID="c6a71088860a4e43a8abd8db58996750da44d9010025705e3784549ffe68b5ac" exitCode=0
Sep 10 22:20:31.180720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.180554    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf" event={"ID":"dad302b1-fd22-4c6b-9945-c9fc28f8af44","Type":"ContainerDied","Data":"c6a71088860a4e43a8abd8db58996750da44d9010025705e3784549ffe68b5ac"}
Sep 10 22:20:31.189392 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.189358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:31.212492 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.212468    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"]
Sep 10 22:20:31.216462 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.216438    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7178ee60-fl2x7"]
Sep 10 22:20:31.289799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.289769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:31.297799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.297776    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:31.389701 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.389671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:31.450642 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.450609    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nzc9\" (UniqueName: \"kubernetes.io/projected/dad302b1-fd22-4c6b-9945-c9fc28f8af44-kube-api-access-9nzc9\") pod \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\" (UID: \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\") "
Sep 10 22:20:31.450805 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.450661    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad302b1-fd22-4c6b-9945-c9fc28f8af44-plugins-config-volume\") pod \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\" (UID: \"dad302b1-fd22-4c6b-9945-c9fc28f8af44\") "
Sep 10 22:20:31.451079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.451052    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad302b1-fd22-4c6b-9945-c9fc28f8af44-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dad302b1-fd22-4c6b-9945-c9fc28f8af44" (UID: "dad302b1-fd22-4c6b-9945-c9fc28f8af44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:31.453125 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.453094    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad302b1-fd22-4c6b-9945-c9fc28f8af44-kube-api-access-9nzc9" (OuterVolumeSpecName: "kube-api-access-9nzc9") pod "dad302b1-fd22-4c6b-9945-c9fc28f8af44" (UID: "dad302b1-fd22-4c6b-9945-c9fc28f8af44"). InnerVolumeSpecName "kube-api-access-9nzc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:31.551711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.551635    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nzc9\" (UniqueName: \"kubernetes.io/projected/dad302b1-fd22-4c6b-9945-c9fc28f8af44-kube-api-access-9nzc9\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:31.551711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.551662    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad302b1-fd22-4c6b-9945-c9fc28f8af44-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:20:31.771155 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:31.771117    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:32.043618 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.043585    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"]
Sep 10 22:20:32.044151 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.044133    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy"
Sep 10 22:20:32.044151 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.044154    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2880911-b5f4-4fe5-86ae-6ca92adf6177" containerName="istio-proxy"
Sep 10 22:20:32.044237 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.044163    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dad302b1-fd22-4c6b-9945-c9fc28f8af44" containerName="payload-pre-processing"
Sep 10 22:20:32.044237 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.044170    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dad302b1-fd22-4c6b-9945-c9fc28f8af44" containerName="payload-pre-processing"
Sep 10 22:20:32.044237 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.044182    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9912de9-a47b-4264-88bf-d5f5d6e728a1" containerName="revoke-keys"
Sep 10 22:20:32.044237 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.044187    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9912de9-a47b-4264-88bf-d5f5d6e728a1" containerName="revoke-keys"
Sep 10 22:20:32.044364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.044252    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dad302b1-fd22-4c6b-9945-c9fc28f8af44" containerName="payload-pre-processing"
Sep 10 22:20:32.044364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.044261    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9912de9-a47b-4264-88bf-d5f5d6e728a1" containerName="revoke-keys"
Sep 10 22:20:32.047371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.047353    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.049422 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.049402    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-178c50fc-openshift-default-dockercfg-tscl9\""
Sep 10 22:20:32.059371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.059352    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"]
Sep 10 22:20:32.068775 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.068751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:32.157482 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.157440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257114fc-b57f-446a-903e-29015bfb242e-istio-podinfo\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.157482 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.157481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-certs\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.157735 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.157509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257114fc-b57f-446a-903e-29015bfb242e-istiod-ca-cert\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.157735 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.157533    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbs45\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-kube-api-access-cbs45\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.157735 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.157577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-socket\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.157735 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.157597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-data\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.157735 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.157623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-credential-socket\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.157735 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.157640    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-envoy\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.158057 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.157747    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-istio-token\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.188364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.188336    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"
Sep 10 22:20:32.188364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.188358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf" event={"ID":"dad302b1-fd22-4c6b-9945-c9fc28f8af44","Type":"ContainerDied","Data":"b3f453380f99657c824fc8f07f112b1cb781e0177adb35298166988eab1ed6a4"}
Sep 10 22:20:32.188696 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.188438    2573 scope.go:117] "RemoveContainer" containerID="c6a71088860a4e43a8abd8db58996750da44d9010025705e3784549ffe68b5ac"
Sep 10 22:20:32.212371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.212343    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"]
Sep 10 22:20:32.215903 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.215879    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7178ee60-5c9678fbdb-r9zjf"]
Sep 10 22:20:32.259184 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-certs\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259327 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257114fc-b57f-446a-903e-29015bfb242e-istiod-ca-cert\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259327 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259318    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbs45\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-kube-api-access-cbs45\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259448 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259384    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-socket\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259448 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-data\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259448 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-credential-socket\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259614 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259449    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-envoy\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259614 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-istio-token\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259614 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-certs\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259614 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257114fc-b57f-446a-903e-29015bfb242e-istio-podinfo\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259823 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259756    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-credential-socket\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-data\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.259924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.259870    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-socket\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.260068 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.260047    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257114fc-b57f-446a-903e-29015bfb242e-istiod-ca-cert\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.261769 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.261751    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-envoy\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.261920 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.261903    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257114fc-b57f-446a-903e-29015bfb242e-istio-podinfo\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.266642 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.266617    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-istio-token\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.266810 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.266791    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbs45\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-kube-api-access-cbs45\") pod \"e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") " pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.356694 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.356602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:32.358598 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.358578    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:32.422038 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.421448    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:32.553440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.553408    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dad302b1-fd22-4c6b-9945-c9fc28f8af44" path="/var/lib/kubelet/pods/dad302b1-fd22-4c6b-9945-c9fc28f8af44/volumes"
Sep 10 22:20:32.553748 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.553736    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9912de9-a47b-4264-88bf-d5f5d6e728a1" path="/var/lib/kubelet/pods/e9912de9-a47b-4264-88bf-d5f5d6e728a1/volumes"
Sep 10 22:20:32.637435 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.637408    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"]
Sep 10 22:20:32.638883 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:20:32.638850    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257114fc_b57f_446a_903e_29015bfb242e.slice/crio-73e7876b5d9a208d8db5b6f405a361ddd6690399ef1dbc3a81f85eda51b8efe3 WatchSource:0}: Error finding container 73e7876b5d9a208d8db5b6f405a361ddd6690399ef1dbc3a81f85eda51b8efe3: Status 404 returned error can't find the container with id 73e7876b5d9a208d8db5b6f405a361ddd6690399ef1dbc3a81f85eda51b8efe3
Sep 10 22:20:32.641107 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.641075    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:20:32.641177 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.641140    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:20:32.641177 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:32.641167    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:20:33.194930 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:33.194892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" event={"ID":"257114fc-b57f-446a-903e-29015bfb242e","Type":"ContainerStarted","Data":"f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a"}
Sep 10 22:20:33.195339 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:33.194957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" event={"ID":"257114fc-b57f-446a-903e-29015bfb242e","Type":"ContainerStarted","Data":"73e7876b5d9a208d8db5b6f405a361ddd6690399ef1dbc3a81f85eda51b8efe3"}
Sep 10 22:20:33.237967 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:33.237915    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podStartSLOduration=1.237898763 podStartE2EDuration="1.237898763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:20:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:20:33.235700228 +0000 UTC m=+913.118184594" watchObservedRunningTime="2026-09-10 22:20:33.237898763 +0000 UTC m=+913.120383129"
Sep 10 22:20:33.358912 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:33.358873    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:33.367007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:33.366975    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:34.201728 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:34.201689    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:34.202717 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:34.202697    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:34.580920 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:34.580868    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:34.679889 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:34.679830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:35.734605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:35.734577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:35.835392 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:35.835358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:35.934344 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:35.934311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:36.295781 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:36.295740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:36.399796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:36.399763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:49.601325 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:49.600481    2573 patch_prober.go:28] interesting pod/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:46442->10.133.0.54:15021: read: connection reset by peer" start-of-body=
Sep 10 22:20:49.601325 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:49.600559    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:46442->10.133.0.54:15021: read: connection reset by peer"
Sep 10 22:20:50.294973 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:50.294942    2573 generic.go:356] "Generic (PLEG): container finished" podID="257114fc-b57f-446a-903e-29015bfb242e" containerID="f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a" exitCode=0
Sep 10 22:20:50.295161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:50.295021    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" event={"ID":"257114fc-b57f-446a-903e-29015bfb242e","Type":"ContainerDied","Data":"f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a"}
Sep 10 22:20:50.295414 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:50.295399    2573 scope.go:117] "RemoveContainer" containerID="f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a"
Sep 10 22:20:50.296468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:50.296444    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:20:50.296517 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:50.296509    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:20:50.296555 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:50.296540    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:20:51.307350 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:51.307304    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" event={"ID":"257114fc-b57f-446a-903e-29015bfb242e","Type":"ContainerStarted","Data":"84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc"}
Sep 10 22:20:51.359253 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:51.359213    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:51.359449 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:51.359427    2573 patch_prober.go:28] interesting pod/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:20:51.359513 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:51.359474    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 22:20:52.359832 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:52.359797    2573 patch_prober.go:28] interesting pod/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:20:52.360231 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:52.359871    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 22:20:53.359699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:53.359671    2573 patch_prober.go:28] interesting pod/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:20:53.359876 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:53.359719    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 22:20:53.836820 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:53.836788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:54.359092 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:54.359059    2573 patch_prober.go:28] interesting pod/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:20:54.359265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:54.359110    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 22:20:55.359319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:55.359282    2573 patch_prober.go:28] interesting pod/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:20:55.359703 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:55.359336    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 22:20:56.359477 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:56.359443    2573 patch_prober.go:28] interesting pod/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 22:20:56.359954 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:56.359501    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 22:20:57.362953 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:57.362924    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:57.363364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:57.363212    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:20:57.363945 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:20:57.363924    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:21:00.315401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:00.315345    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"]
Sep 10 22:21:00.323697 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:00.323669    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"
Sep 10 22:21:00.325920 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:00.325893    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:21:00.326481 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:00.326459    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"]
Sep 10 22:21:00.419952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:00.419924    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80000685-92ac-4d90-81a2-541c8357eec6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9\" (UID: \"80000685-92ac-4d90-81a2-541c8357eec6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"
Sep 10 22:21:00.520999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:00.520967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80000685-92ac-4d90-81a2-541c8357eec6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9\" (UID: \"80000685-92ac-4d90-81a2-541c8357eec6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"
Sep 10 22:21:00.521578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:00.521560    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80000685-92ac-4d90-81a2-541c8357eec6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9\" (UID: \"80000685-92ac-4d90-81a2-541c8357eec6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"
Sep 10 22:21:00.637166 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:00.637090    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"
Sep 10 22:21:00.907181 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:00.907157    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"]
Sep 10 22:21:00.908202 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:21:00.908162    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80000685_92ac_4d90_81a2_541c8357eec6.slice/crio-96d47efe6124d02b76d30c05d2ea545e4bea898a9625efc5ab885604525f428d WatchSource:0}: Error finding container 96d47efe6124d02b76d30c05d2ea545e4bea898a9625efc5ab885604525f428d: Status 404 returned error can't find the container with id 96d47efe6124d02b76d30c05d2ea545e4bea898a9625efc5ab885604525f428d
Sep 10 22:21:01.379318 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:01.379283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9" event={"ID":"80000685-92ac-4d90-81a2-541c8357eec6","Type":"ContainerStarted","Data":"5bb3fcc32e6811af76a2752c8004dfe5235e0e865eb099d6a780a55e0223cada"}
Sep 10 22:21:01.379693 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:01.379369    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9" event={"ID":"80000685-92ac-4d90-81a2-541c8357eec6","Type":"ContainerStarted","Data":"96d47efe6124d02b76d30c05d2ea545e4bea898a9625efc5ab885604525f428d"}
Sep 10 22:21:01.395291 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:01.395241    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9" podStartSLOduration=1.395226176 podStartE2EDuration="1.395226176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:01.39313637 +0000 UTC m=+941.275620761" watchObservedRunningTime="2026-09-10 22:21:01.395226176 +0000 UTC m=+941.277710541"
Sep 10 22:21:02.013068 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:02.013017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:02.386711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:02.386635    2573 generic.go:356] "Generic (PLEG): container finished" podID="80000685-92ac-4d90-81a2-541c8357eec6" containerID="5bb3fcc32e6811af76a2752c8004dfe5235e0e865eb099d6a780a55e0223cada" exitCode=0
Sep 10 22:21:02.386711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:02.386687    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9" event={"ID":"80000685-92ac-4d90-81a2-541c8357eec6","Type":"ContainerDied","Data":"5bb3fcc32e6811af76a2752c8004dfe5235e0e865eb099d6a780a55e0223cada"}
Sep 10 22:21:03.526762 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:03.526739    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"
Sep 10 22:21:03.647478 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:03.647405    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80000685-92ac-4d90-81a2-541c8357eec6-maas-api-service-ca\") pod \"80000685-92ac-4d90-81a2-541c8357eec6\" (UID: \"80000685-92ac-4d90-81a2-541c8357eec6\") "
Sep 10 22:21:03.647725 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:03.647702    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80000685-92ac-4d90-81a2-541c8357eec6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "80000685-92ac-4d90-81a2-541c8357eec6" (UID: "80000685-92ac-4d90-81a2-541c8357eec6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:03.748920 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:03.748885    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80000685-92ac-4d90-81a2-541c8357eec6-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:04.400318 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:04.400289    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"
Sep 10 22:21:04.400474 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:04.400320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9" event={"ID":"80000685-92ac-4d90-81a2-541c8357eec6","Type":"ContainerDied","Data":"96d47efe6124d02b76d30c05d2ea545e4bea898a9625efc5ab885604525f428d"}
Sep 10 22:21:04.400474 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:04.400369    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96d47efe6124d02b76d30c05d2ea545e4bea898a9625efc5ab885604525f428d"
Sep 10 22:21:05.894070 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:05.894034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:06.236450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:06.236419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:06.337569 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:06.337541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:06.437140 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:06.437102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:06.496289 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:06.496015    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"]
Sep 10 22:21:06.497998 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:06.497972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:06.502343 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:06.502320    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-178c50fc-xbbn9"]
Sep 10 22:21:06.550346 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:06.550316    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:06.553457 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:06.553437    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80000685-92ac-4d90-81a2-541c8357eec6" path="/var/lib/kubelet/pods/80000685-92ac-4d90-81a2-541c8357eec6/volumes"
Sep 10 22:21:07.623274 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:07.623237    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"]
Sep 10 22:21:07.623667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:07.623487    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy" containerID="cri-o://84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc" gracePeriod=30
Sep 10 22:21:07.647386 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:07.647363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:08.079565 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:08.079532    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:08.184158 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:08.184126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:08.397923 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:08.397835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:08.619570 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:08.619530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:10.840798 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:10.840763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:10.938216 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:10.938180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:12.050294 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.050261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:12.120995 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.120961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:12.218702 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.218662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:12.366318 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.366232    2573 patch_prober.go:28] interesting pod/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:21:12.366318 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.366289    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:21:12.531565 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.531530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:12.621434 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.621359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:12.668299 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.668269    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"]
Sep 10 22:21:12.668664 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.668653    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80000685-92ac-4d90-81a2-541c8357eec6" containerName="revoke-keys"
Sep 10 22:21:12.668722 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.668666    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="80000685-92ac-4d90-81a2-541c8357eec6" containerName="revoke-keys"
Sep 10 22:21:12.668763 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.668736    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="80000685-92ac-4d90-81a2-541c8357eec6" containerName="revoke-keys"
Sep 10 22:21:12.671672 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.671656    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:12.673708 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.673686    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-2057d50e\""
Sep 10 22:21:12.673832 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.673816    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-2057d50e-dockercfg-7ztql\""
Sep 10 22:21:12.681230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.681209    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"]
Sep 10 22:21:12.702564 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.702531    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"]
Sep 10 22:21:12.705984 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.705965    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:12.715174 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.715151    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"]
Sep 10 22:21:12.834774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.834743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvfjd\" (UniqueName: \"kubernetes.io/projected/6055c78e-27af-4497-bd95-d262df5f8514-kube-api-access-pvfjd\") pod \"payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6\" (UID: \"6055c78e-27af-4497-bd95-d262df5f8514\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:12.834938 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.834781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6btsp\" (UniqueName: \"kubernetes.io/projected/23b14b23-df02-400d-89a0-8017d7f93b19-kube-api-access-6btsp\") pod \"payload-processing-e2e-derive-2057d50e-77b589b665-rn497\" (UID: \"23b14b23-df02-400d-89a0-8017d7f93b19\") " pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:12.834938 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.834899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6055c78e-27af-4497-bd95-d262df5f8514-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6\" (UID: \"6055c78e-27af-4497-bd95-d262df5f8514\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:12.835077 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.834970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b14b23-df02-400d-89a0-8017d7f93b19-plugins-config-volume\") pod \"payload-processing-e2e-derive-2057d50e-77b589b665-rn497\" (UID: \"23b14b23-df02-400d-89a0-8017d7f93b19\") " pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:12.886300 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.886241    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:21:12.935566 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.935532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvfjd\" (UniqueName: \"kubernetes.io/projected/6055c78e-27af-4497-bd95-d262df5f8514-kube-api-access-pvfjd\") pod \"payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6\" (UID: \"6055c78e-27af-4497-bd95-d262df5f8514\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:12.935738 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.935570    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6btsp\" (UniqueName: \"kubernetes.io/projected/23b14b23-df02-400d-89a0-8017d7f93b19-kube-api-access-6btsp\") pod \"payload-processing-e2e-derive-2057d50e-77b589b665-rn497\" (UID: \"23b14b23-df02-400d-89a0-8017d7f93b19\") " pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:12.935738 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.935623    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6055c78e-27af-4497-bd95-d262df5f8514-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6\" (UID: \"6055c78e-27af-4497-bd95-d262df5f8514\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:12.935738 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.935674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b14b23-df02-400d-89a0-8017d7f93b19-plugins-config-volume\") pod \"payload-processing-e2e-derive-2057d50e-77b589b665-rn497\" (UID: \"23b14b23-df02-400d-89a0-8017d7f93b19\") " pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:12.936326 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.936307    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b14b23-df02-400d-89a0-8017d7f93b19-plugins-config-volume\") pod \"payload-processing-e2e-derive-2057d50e-77b589b665-rn497\" (UID: \"23b14b23-df02-400d-89a0-8017d7f93b19\") " pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:12.936580 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.936555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6055c78e-27af-4497-bd95-d262df5f8514-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6\" (UID: \"6055c78e-27af-4497-bd95-d262df5f8514\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:12.945510 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.945487    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6btsp\" (UniqueName: \"kubernetes.io/projected/23b14b23-df02-400d-89a0-8017d7f93b19-kube-api-access-6btsp\") pod \"payload-processing-e2e-derive-2057d50e-77b589b665-rn497\" (UID: \"23b14b23-df02-400d-89a0-8017d7f93b19\") " pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:12.945637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:12.945616    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvfjd\" (UniqueName: \"kubernetes.io/projected/6055c78e-27af-4497-bd95-d262df5f8514-kube-api-access-pvfjd\") pod \"payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6\" (UID: \"6055c78e-27af-4497-bd95-d262df5f8514\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:13.027255 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.027219    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:13.033597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.033575    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:13.036247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036225    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-certs\") pod \"257114fc-b57f-446a-903e-29015bfb242e\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") "
Sep 10 22:21:13.036360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036264    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257114fc-b57f-446a-903e-29015bfb242e-istio-podinfo\") pod \"257114fc-b57f-446a-903e-29015bfb242e\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") "
Sep 10 22:21:13.036360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036294    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbs45\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-kube-api-access-cbs45\") pod \"257114fc-b57f-446a-903e-29015bfb242e\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") "
Sep 10 22:21:13.036360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036337    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-envoy\") pod \"257114fc-b57f-446a-903e-29015bfb242e\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") "
Sep 10 22:21:13.036637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036398    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-istio-token\") pod \"257114fc-b57f-446a-903e-29015bfb242e\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") "
Sep 10 22:21:13.036637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036458    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-credential-socket\") pod \"257114fc-b57f-446a-903e-29015bfb242e\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") "
Sep 10 22:21:13.036637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036478    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "257114fc-b57f-446a-903e-29015bfb242e" (UID: "257114fc-b57f-446a-903e-29015bfb242e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:21:13.036637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036492    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-data\") pod \"257114fc-b57f-446a-903e-29015bfb242e\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") "
Sep 10 22:21:13.036637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036544    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257114fc-b57f-446a-903e-29015bfb242e-istiod-ca-cert\") pod \"257114fc-b57f-446a-903e-29015bfb242e\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") "
Sep 10 22:21:13.036637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.036575    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-socket\") pod \"257114fc-b57f-446a-903e-29015bfb242e\" (UID: \"257114fc-b57f-446a-903e-29015bfb242e\") "
Sep 10 22:21:13.037319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.037006    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "257114fc-b57f-446a-903e-29015bfb242e" (UID: "257114fc-b57f-446a-903e-29015bfb242e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:21:13.037319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.037025    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-data" (OuterVolumeSpecName: "istio-data") pod "257114fc-b57f-446a-903e-29015bfb242e" (UID: "257114fc-b57f-446a-903e-29015bfb242e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:21:13.037319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.037235    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "257114fc-b57f-446a-903e-29015bfb242e" (UID: "257114fc-b57f-446a-903e-29015bfb242e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:21:13.037319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.037250    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:13.037319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.037270    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:13.037319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.037287    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:13.037582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.037318    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/257114fc-b57f-446a-903e-29015bfb242e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "257114fc-b57f-446a-903e-29015bfb242e" (UID: "257114fc-b57f-446a-903e-29015bfb242e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:13.039132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.039091    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-kube-api-access-cbs45" (OuterVolumeSpecName: "kube-api-access-cbs45") pod "257114fc-b57f-446a-903e-29015bfb242e" (UID: "257114fc-b57f-446a-903e-29015bfb242e"). InnerVolumeSpecName "kube-api-access-cbs45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:13.039132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.039102    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-istio-token" (OuterVolumeSpecName: "istio-token") pod "257114fc-b57f-446a-903e-29015bfb242e" (UID: "257114fc-b57f-446a-903e-29015bfb242e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:13.039132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.039095    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/257114fc-b57f-446a-903e-29015bfb242e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "257114fc-b57f-446a-903e-29015bfb242e" (UID: "257114fc-b57f-446a-903e-29015bfb242e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:21:13.039337 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.039137    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "257114fc-b57f-446a-903e-29015bfb242e" (UID: "257114fc-b57f-446a-903e-29015bfb242e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:21:13.138752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.138654    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257114fc-b57f-446a-903e-29015bfb242e-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:13.138752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.138697    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbs45\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-kube-api-access-cbs45\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:13.138752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.138714    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:13.138752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.138727    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257114fc-b57f-446a-903e-29015bfb242e-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:13.138752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.138740    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257114fc-b57f-446a-903e-29015bfb242e-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:13.139350 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.138753    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257114fc-b57f-446a-903e-29015bfb242e-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:13.301947 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.301917    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"]
Sep 10 22:21:13.303709 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:21:13.303683    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b14b23_df02_400d_89a0_8017d7f93b19.slice/crio-0fba7dbe0ea96ab8ebe726bb83d670bdb60979df0456defd33d6e096e1744cf9 WatchSource:0}: Error finding container 0fba7dbe0ea96ab8ebe726bb83d670bdb60979df0456defd33d6e096e1744cf9: Status 404 returned error can't find the container with id 0fba7dbe0ea96ab8ebe726bb83d670bdb60979df0456defd33d6e096e1744cf9
Sep 10 22:21:13.310403 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:21:13.310380    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6055c78e_27af_4497_bd95_d262df5f8514.slice/crio-749d462fed9d641924456b593894f89a3b0300a50b6e4ab6611fb40f82578977 WatchSource:0}: Error finding container 749d462fed9d641924456b593894f89a3b0300a50b6e4ab6611fb40f82578977: Status 404 returned error can't find the container with id 749d462fed9d641924456b593894f89a3b0300a50b6e4ab6611fb40f82578977
Sep 10 22:21:13.311005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.310921    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"]
Sep 10 22:21:13.453443 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.453335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497" event={"ID":"23b14b23-df02-400d-89a0-8017d7f93b19","Type":"ContainerStarted","Data":"795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25"}
Sep 10 22:21:13.453443 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.453412    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:13.453443 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.453437    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497" event={"ID":"23b14b23-df02-400d-89a0-8017d7f93b19","Type":"ContainerStarted","Data":"0fba7dbe0ea96ab8ebe726bb83d670bdb60979df0456defd33d6e096e1744cf9"}
Sep 10 22:21:13.455109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.455076    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6" event={"ID":"6055c78e-27af-4497-bd95-d262df5f8514","Type":"ContainerStarted","Data":"4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8"}
Sep 10 22:21:13.455249 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.455132    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6" event={"ID":"6055c78e-27af-4497-bd95-d262df5f8514","Type":"ContainerStarted","Data":"749d462fed9d641924456b593894f89a3b0300a50b6e4ab6611fb40f82578977"}
Sep 10 22:21:13.455249 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.455178    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:13.456926 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.456904    2573 generic.go:356] "Generic (PLEG): container finished" podID="257114fc-b57f-446a-903e-29015bfb242e" containerID="84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc" exitCode=0
Sep 10 22:21:13.457043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.456936    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"
Sep 10 22:21:13.457043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.456947    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" event={"ID":"257114fc-b57f-446a-903e-29015bfb242e","Type":"ContainerDied","Data":"84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc"}
Sep 10 22:21:13.457043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.456994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww" event={"ID":"257114fc-b57f-446a-903e-29015bfb242e","Type":"ContainerDied","Data":"73e7876b5d9a208d8db5b6f405a361ddd6690399ef1dbc3a81f85eda51b8efe3"}
Sep 10 22:21:13.457043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.457026    2573 scope.go:117] "RemoveContainer" containerID="84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc"
Sep 10 22:21:13.468032 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.468019    2573 scope.go:117] "RemoveContainer" containerID="f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a"
Sep 10 22:21:13.470377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.470337    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497" podStartSLOduration=1.4703242730000001 podStartE2EDuration="1.470324273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:13.467948067 +0000 UTC m=+953.350432436" watchObservedRunningTime="2026-09-10 22:21:13.470324273 +0000 UTC m=+953.352808639"
Sep 10 22:21:13.478456 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.478432    2573 scope.go:117] "RemoveContainer" containerID="84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc"
Sep 10 22:21:13.478759 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:21:13.478730    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc\": container with ID starting with 84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc not found: ID does not exist" containerID="84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc"
Sep 10 22:21:13.478873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.478761    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc"} err="failed to get container status \"84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc\": rpc error: code = NotFound desc = could not find container \"84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc\": container with ID starting with 84a244fcfba03cbb18e257f8b92f44071b1e91a4bcf25af2701ed9c52d3eb3dc not found: ID does not exist"
Sep 10 22:21:13.478873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.478780    2573 scope.go:117] "RemoveContainer" containerID="f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a"
Sep 10 22:21:13.479070 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:21:13.479051    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a\": container with ID starting with f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a not found: ID does not exist" containerID="f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a"
Sep 10 22:21:13.479115 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.479078    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a"} err="failed to get container status \"f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a\": rpc error: code = NotFound desc = could not find container \"f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a\": container with ID starting with f52443435712c694b4f1e84386fc06d77e43485e8bd5e928f7e5b903a174dd7a not found: ID does not exist"
Sep 10 22:21:13.483148 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.483118    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"]
Sep 10 22:21:13.486642 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.486616    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-178c50fc-openshift-default-65764ccc5d-jv7ww"]
Sep 10 22:21:13.500456 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:13.500406    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6" podStartSLOduration=1.500388649 podStartE2EDuration="1.500388649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:13.497505912 +0000 UTC m=+953.379990290" watchObservedRunningTime="2026-09-10 22:21:13.500388649 +0000 UTC m=+953.382873019"
Sep 10 22:21:14.553164 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:14.553133    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="257114fc-b57f-446a-903e-29015bfb242e" path="/var/lib/kubelet/pods/257114fc-b57f-446a-903e-29015bfb242e/volumes"
Sep 10 22:21:17.491544 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:17.491515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:24.466312 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:24.466279    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:24.466779 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:24.466351    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:25.354542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:25.354489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:28.030512 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.030469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:28.135411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.135375    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"]
Sep 10 22:21:28.135813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.135801    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy"
Sep 10 22:21:28.135873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.135816    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy"
Sep 10 22:21:28.135873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.135826    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy"
Sep 10 22:21:28.135873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.135831    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy"
Sep 10 22:21:28.135980 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.135924    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy"
Sep 10 22:21:28.135980 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.135932    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="257114fc-b57f-446a-903e-29015bfb242e" containerName="istio-proxy"
Sep 10 22:21:28.140069 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.140051    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"
Sep 10 22:21:28.142427 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.142404    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:21:28.145398 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.145377    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"]
Sep 10 22:21:28.178931 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.178896    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63fc8e0-6cdd-405c-bc57-634159cae41a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-44dc54-qzzst\" (UID: \"e63fc8e0-6cdd-405c-bc57-634159cae41a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"
Sep 10 22:21:28.237317 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.237288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:28.280296 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.280261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63fc8e0-6cdd-405c-bc57-634159cae41a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-44dc54-qzzst\" (UID: \"e63fc8e0-6cdd-405c-bc57-634159cae41a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"
Sep 10 22:21:28.280968 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.280921    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63fc8e0-6cdd-405c-bc57-634159cae41a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-44dc54-qzzst\" (UID: \"e63fc8e0-6cdd-405c-bc57-634159cae41a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"
Sep 10 22:21:28.452832 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.452796    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"
Sep 10 22:21:28.723169 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:28.723140    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"]
Sep 10 22:21:28.725679 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:21:28.725653    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63fc8e0_6cdd_405c_bc57_634159cae41a.slice/crio-2c2ff1912d06090fcfca9744f79dffbd0567a74954255e53bcef1b06db118f78 WatchSource:0}: Error finding container 2c2ff1912d06090fcfca9744f79dffbd0567a74954255e53bcef1b06db118f78: Status 404 returned error can't find the container with id 2c2ff1912d06090fcfca9744f79dffbd0567a74954255e53bcef1b06db118f78
Sep 10 22:21:29.553262 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:29.553228    2573 generic.go:356] "Generic (PLEG): container finished" podID="e63fc8e0-6cdd-405c-bc57-634159cae41a" containerID="0f136a46af2cd759f277ca3bf782936eef8f27931c94e42b5f0c830d43b4b2d3" exitCode=0
Sep 10 22:21:29.553623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:29.553298    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst" event={"ID":"e63fc8e0-6cdd-405c-bc57-634159cae41a","Type":"ContainerDied","Data":"0f136a46af2cd759f277ca3bf782936eef8f27931c94e42b5f0c830d43b4b2d3"}
Sep 10 22:21:29.553623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:29.553339    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst" event={"ID":"e63fc8e0-6cdd-405c-bc57-634159cae41a","Type":"ContainerStarted","Data":"2c2ff1912d06090fcfca9744f79dffbd0567a74954255e53bcef1b06db118f78"}
Sep 10 22:21:30.696099 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:30.696075    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"
Sep 10 22:21:30.803861 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:30.803812    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63fc8e0-6cdd-405c-bc57-634159cae41a-maas-api-service-ca\") pod \"e63fc8e0-6cdd-405c-bc57-634159cae41a\" (UID: \"e63fc8e0-6cdd-405c-bc57-634159cae41a\") "
Sep 10 22:21:30.804178 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:30.804154    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e63fc8e0-6cdd-405c-bc57-634159cae41a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e63fc8e0-6cdd-405c-bc57-634159cae41a" (UID: "e63fc8e0-6cdd-405c-bc57-634159cae41a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:30.904659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:30.904576    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e63fc8e0-6cdd-405c-bc57-634159cae41a-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:31.565568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:31.565536    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst" event={"ID":"e63fc8e0-6cdd-405c-bc57-634159cae41a","Type":"ContainerDied","Data":"2c2ff1912d06090fcfca9744f79dffbd0567a74954255e53bcef1b06db118f78"}
Sep 10 22:21:31.565568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:31.565557    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"
Sep 10 22:21:31.565772 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:31.565589    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c2ff1912d06090fcfca9744f79dffbd0567a74954255e53bcef1b06db118f78"
Sep 10 22:21:32.444741 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:32.444712    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:32.908122 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:32.908078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:35.612939 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.612906    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"]
Sep 10 22:21:35.613419 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.613329    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63fc8e0-6cdd-405c-bc57-634159cae41a" containerName="revoke-keys"
Sep 10 22:21:35.613419 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.613341    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63fc8e0-6cdd-405c-bc57-634159cae41a" containerName="revoke-keys"
Sep 10 22:21:35.613419 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.613407    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63fc8e0-6cdd-405c-bc57-634159cae41a" containerName="revoke-keys"
Sep 10 22:21:35.616754 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.616733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"
Sep 10 22:21:35.619087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.619063    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:21:35.624615 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.624590    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"]
Sep 10 22:21:35.649587 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.649557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20151f53-1ca4-44cc-a1e1-3bfc30f71005-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2057d50e-trlwq\" (UID: \"20151f53-1ca4-44cc-a1e1-3bfc30f71005\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"
Sep 10 22:21:35.751056 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.751021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20151f53-1ca4-44cc-a1e1-3bfc30f71005-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2057d50e-trlwq\" (UID: \"20151f53-1ca4-44cc-a1e1-3bfc30f71005\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"
Sep 10 22:21:35.751642 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.751614    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20151f53-1ca4-44cc-a1e1-3bfc30f71005-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2057d50e-trlwq\" (UID: \"20151f53-1ca4-44cc-a1e1-3bfc30f71005\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"
Sep 10 22:21:35.929188 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:35.929099    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"
Sep 10 22:21:36.203086 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:36.203056    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"]
Sep 10 22:21:36.204086 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:21:36.204059    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20151f53_1ca4_44cc_a1e1_3bfc30f71005.slice/crio-5f113d7a0167de383fabe4e9ee6aaa2a045808ec1bcad37156f0e7b30647a00c WatchSource:0}: Error finding container 5f113d7a0167de383fabe4e9ee6aaa2a045808ec1bcad37156f0e7b30647a00c: Status 404 returned error can't find the container with id 5f113d7a0167de383fabe4e9ee6aaa2a045808ec1bcad37156f0e7b30647a00c
Sep 10 22:21:36.602449 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:36.602403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq" event={"ID":"20151f53-1ca4-44cc-a1e1-3bfc30f71005","Type":"ContainerStarted","Data":"c556880a144b25e73c46437bfbac8fd30ae92e242bc17641ce1f7e26043e83e9"}
Sep 10 22:21:36.602623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:36.602494    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq" event={"ID":"20151f53-1ca4-44cc-a1e1-3bfc30f71005","Type":"ContainerStarted","Data":"5f113d7a0167de383fabe4e9ee6aaa2a045808ec1bcad37156f0e7b30647a00c"}
Sep 10 22:21:36.617581 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:36.617530    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq" podStartSLOduration=1.6175103370000001 podStartE2EDuration="1.617510337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:36.617160313 +0000 UTC m=+976.499644672" watchObservedRunningTime="2026-09-10 22:21:36.617510337 +0000 UTC m=+976.499994704"
Sep 10 22:21:36.857804 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:36.857722    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:36.957681 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:36.957649    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:37.610066 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:37.610030    2573 generic.go:356] "Generic (PLEG): container finished" podID="20151f53-1ca4-44cc-a1e1-3bfc30f71005" containerID="c556880a144b25e73c46437bfbac8fd30ae92e242bc17641ce1f7e26043e83e9" exitCode=0
Sep 10 22:21:37.610242 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:37.610081    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq" event={"ID":"20151f53-1ca4-44cc-a1e1-3bfc30f71005","Type":"ContainerDied","Data":"c556880a144b25e73c46437bfbac8fd30ae92e242bc17641ce1f7e26043e83e9"}
Sep 10 22:21:38.390953 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:38.390922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:38.752630 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:38.752607    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"
Sep 10 22:21:38.778970 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:38.778941    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20151f53-1ca4-44cc-a1e1-3bfc30f71005-maas-api-service-ca\") pod \"20151f53-1ca4-44cc-a1e1-3bfc30f71005\" (UID: \"20151f53-1ca4-44cc-a1e1-3bfc30f71005\") "
Sep 10 22:21:38.779284 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:38.779260    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20151f53-1ca4-44cc-a1e1-3bfc30f71005-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "20151f53-1ca4-44cc-a1e1-3bfc30f71005" (UID: "20151f53-1ca4-44cc-a1e1-3bfc30f71005"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:38.879693 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:38.879664    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20151f53-1ca4-44cc-a1e1-3bfc30f71005-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:38.949371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:38.949285    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:38.984153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:38.984120    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"]
Sep 10 22:21:38.984961 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:38.984350    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq" podUID="454482a9-30d0-4ab4-9d87-725570b32c74" containerName="payload-pre-processing" containerID="cri-o://01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8" gracePeriod=30
Sep 10 22:21:39.019360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.019328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:39.134011 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.133979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:39.139322 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.139296    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"]
Sep 10 22:21:39.149948 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.149919    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44dc54-qzzst"]
Sep 10 22:21:39.243236 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.243208    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:21:39.260608 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.260585    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:39.283128 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.283097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2hsv\" (UniqueName: \"kubernetes.io/projected/454482a9-30d0-4ab4-9d87-725570b32c74-kube-api-access-w2hsv\") pod \"454482a9-30d0-4ab4-9d87-725570b32c74\" (UID: \"454482a9-30d0-4ab4-9d87-725570b32c74\") "
Sep 10 22:21:39.283266 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.283138    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/454482a9-30d0-4ab4-9d87-725570b32c74-plugins-config-volume\") pod \"454482a9-30d0-4ab4-9d87-725570b32c74\" (UID: \"454482a9-30d0-4ab4-9d87-725570b32c74\") "
Sep 10 22:21:39.283557 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.283530    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/454482a9-30d0-4ab4-9d87-725570b32c74-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "454482a9-30d0-4ab4-9d87-725570b32c74" (UID: "454482a9-30d0-4ab4-9d87-725570b32c74"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:39.285210 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.285179    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/454482a9-30d0-4ab4-9d87-725570b32c74-kube-api-access-w2hsv" (OuterVolumeSpecName: "kube-api-access-w2hsv") pod "454482a9-30d0-4ab4-9d87-725570b32c74" (UID: "454482a9-30d0-4ab4-9d87-725570b32c74"). InnerVolumeSpecName "kube-api-access-w2hsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:39.384151 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.384115    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2hsv\" (UniqueName: \"kubernetes.io/projected/454482a9-30d0-4ab4-9d87-725570b32c74-kube-api-access-w2hsv\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:39.384151 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.384143    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/454482a9-30d0-4ab4-9d87-725570b32c74-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:39.472860 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.472803    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:39.622481 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.622444    2573 generic.go:356] "Generic (PLEG): container finished" podID="454482a9-30d0-4ab4-9d87-725570b32c74" containerID="01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8" exitCode=0
Sep 10 22:21:39.622661 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.622486    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"
Sep 10 22:21:39.622661 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.622523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq" event={"ID":"454482a9-30d0-4ab4-9d87-725570b32c74","Type":"ContainerDied","Data":"01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8"}
Sep 10 22:21:39.622661 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.622559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq" event={"ID":"454482a9-30d0-4ab4-9d87-725570b32c74","Type":"ContainerDied","Data":"46830a967043eb369f0a7f4f02ed5cd492af99e37b7fae1585484cba5f7b5ec4"}
Sep 10 22:21:39.622661 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.622590    2573 scope.go:117] "RemoveContainer" containerID="01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8"
Sep 10 22:21:39.624041 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.623949    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"
Sep 10 22:21:39.624041 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.623974    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq" event={"ID":"20151f53-1ca4-44cc-a1e1-3bfc30f71005","Type":"ContainerDied","Data":"5f113d7a0167de383fabe4e9ee6aaa2a045808ec1bcad37156f0e7b30647a00c"}
Sep 10 22:21:39.624041 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.624017    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f113d7a0167de383fabe4e9ee6aaa2a045808ec1bcad37156f0e7b30647a00c"
Sep 10 22:21:39.633070 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.633049    2573 scope.go:117] "RemoveContainer" containerID="01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8"
Sep 10 22:21:39.633361 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:21:39.633335    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8\": container with ID starting with 01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8 not found: ID does not exist" containerID="01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8"
Sep 10 22:21:39.633489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.633369    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8"} err="failed to get container status \"01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8\": rpc error: code = NotFound desc = could not find container \"01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8\": container with ID starting with 01c54889b798322b7f6b0feb9de04eddcdfec9539e7c159e7cf2e8d5620b8ff8 not found: ID does not exist"
Sep 10 22:21:39.651674 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.651652    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"]
Sep 10 22:21:39.660257 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:39.660232    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44dc54-5bf455c686-nhptq"]
Sep 10 22:21:40.553061 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:40.553034    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="454482a9-30d0-4ab4-9d87-725570b32c74" path="/var/lib/kubelet/pods/454482a9-30d0-4ab4-9d87-725570b32c74/volumes"
Sep 10 22:21:40.553433 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:40.553351    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e63fc8e0-6cdd-405c-bc57-634159cae41a" path="/var/lib/kubelet/pods/e63fc8e0-6cdd-405c-bc57-634159cae41a/volumes"
Sep 10 22:21:42.159511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:42.159479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:42.835151 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:42.835110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:42.862983 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:42.862947    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"]
Sep 10 22:21:42.863180 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:42.863161    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497" podUID="23b14b23-df02-400d-89a0-8017d7f93b19" containerName="payload-processing" containerID="cri-o://795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25" gracePeriod=30
Sep 10 22:21:42.870015 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:42.869955    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"]
Sep 10 22:21:42.870248 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:42.870222    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6" podUID="6055c78e-27af-4497-bd95-d262df5f8514" containerName="payload-pre-processing" containerID="cri-o://4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8" gracePeriod=30
Sep 10 22:21:42.905044 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:42.905016    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:42.969596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:42.969566    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:43.028185 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.028083    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"]
Sep 10 22:21:43.031664 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.031630    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2057d50e-trlwq"]
Sep 10 22:21:43.038235 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.038151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:43.153023 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.152984    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:43.157296 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.157265    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:43.174429 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.174400    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:43.217709 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.217670    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b14b23-df02-400d-89a0-8017d7f93b19-plugins-config-volume\") pod \"23b14b23-df02-400d-89a0-8017d7f93b19\" (UID: \"23b14b23-df02-400d-89a0-8017d7f93b19\") "
Sep 10 22:21:43.217890 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.217763    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6055c78e-27af-4497-bd95-d262df5f8514-plugins-config-volume\") pod \"6055c78e-27af-4497-bd95-d262df5f8514\" (UID: \"6055c78e-27af-4497-bd95-d262df5f8514\") "
Sep 10 22:21:43.217890 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.217863    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvfjd\" (UniqueName: \"kubernetes.io/projected/6055c78e-27af-4497-bd95-d262df5f8514-kube-api-access-pvfjd\") pod \"6055c78e-27af-4497-bd95-d262df5f8514\" (UID: \"6055c78e-27af-4497-bd95-d262df5f8514\") "
Sep 10 22:21:43.218006 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.217895    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6btsp\" (UniqueName: \"kubernetes.io/projected/23b14b23-df02-400d-89a0-8017d7f93b19-kube-api-access-6btsp\") pod \"23b14b23-df02-400d-89a0-8017d7f93b19\" (UID: \"23b14b23-df02-400d-89a0-8017d7f93b19\") "
Sep 10 22:21:43.218103 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.218074    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23b14b23-df02-400d-89a0-8017d7f93b19-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23b14b23-df02-400d-89a0-8017d7f93b19" (UID: "23b14b23-df02-400d-89a0-8017d7f93b19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:43.218169 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.218124    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6055c78e-27af-4497-bd95-d262df5f8514-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6055c78e-27af-4497-bd95-d262df5f8514" (UID: "6055c78e-27af-4497-bd95-d262df5f8514"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:43.219972 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.219950    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6055c78e-27af-4497-bd95-d262df5f8514-kube-api-access-pvfjd" (OuterVolumeSpecName: "kube-api-access-pvfjd") pod "6055c78e-27af-4497-bd95-d262df5f8514" (UID: "6055c78e-27af-4497-bd95-d262df5f8514"). InnerVolumeSpecName "kube-api-access-pvfjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:43.219972 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.219960    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23b14b23-df02-400d-89a0-8017d7f93b19-kube-api-access-6btsp" (OuterVolumeSpecName: "kube-api-access-6btsp") pod "23b14b23-df02-400d-89a0-8017d7f93b19" (UID: "23b14b23-df02-400d-89a0-8017d7f93b19"). InnerVolumeSpecName "kube-api-access-6btsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:43.319087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.319054    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvfjd\" (UniqueName: \"kubernetes.io/projected/6055c78e-27af-4497-bd95-d262df5f8514-kube-api-access-pvfjd\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:43.319087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.319084    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6btsp\" (UniqueName: \"kubernetes.io/projected/23b14b23-df02-400d-89a0-8017d7f93b19-kube-api-access-6btsp\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:43.319087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.319093    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23b14b23-df02-400d-89a0-8017d7f93b19-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:43.319325 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.319102    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6055c78e-27af-4497-bd95-d262df5f8514-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:21:43.649602 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.649572    2573 generic.go:356] "Generic (PLEG): container finished" podID="6055c78e-27af-4497-bd95-d262df5f8514" containerID="4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8" exitCode=0
Sep 10 22:21:43.649783 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.649612    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"
Sep 10 22:21:43.649783 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.649658    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6" event={"ID":"6055c78e-27af-4497-bd95-d262df5f8514","Type":"ContainerDied","Data":"4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8"}
Sep 10 22:21:43.649783 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.649715    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6" event={"ID":"6055c78e-27af-4497-bd95-d262df5f8514","Type":"ContainerDied","Data":"749d462fed9d641924456b593894f89a3b0300a50b6e4ab6611fb40f82578977"}
Sep 10 22:21:43.649783 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.649743    2573 scope.go:117] "RemoveContainer" containerID="4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8"
Sep 10 22:21:43.651183 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.651156    2573 generic.go:356] "Generic (PLEG): container finished" podID="23b14b23-df02-400d-89a0-8017d7f93b19" containerID="795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25" exitCode=0
Sep 10 22:21:43.651300 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.651194    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"
Sep 10 22:21:43.651300 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.651194    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497" event={"ID":"23b14b23-df02-400d-89a0-8017d7f93b19","Type":"ContainerDied","Data":"795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25"}
Sep 10 22:21:43.651391 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.651306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497" event={"ID":"23b14b23-df02-400d-89a0-8017d7f93b19","Type":"ContainerDied","Data":"0fba7dbe0ea96ab8ebe726bb83d670bdb60979df0456defd33d6e096e1744cf9"}
Sep 10 22:21:43.660137 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.660118    2573 scope.go:117] "RemoveContainer" containerID="4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8"
Sep 10 22:21:43.660469 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:21:43.660446    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8\": container with ID starting with 4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8 not found: ID does not exist" containerID="4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8"
Sep 10 22:21:43.660547 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.660476    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8"} err="failed to get container status \"4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8\": rpc error: code = NotFound desc = could not find container \"4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8\": container with ID starting with 4da6bc110cdd72c3cac0713c9f47db9f09716c578534f5967673e34e64dacca8 not found: ID does not exist"
Sep 10 22:21:43.660547 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.660494    2573 scope.go:117] "RemoveContainer" containerID="795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25"
Sep 10 22:21:43.668654 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.668639    2573 scope.go:117] "RemoveContainer" containerID="795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25"
Sep 10 22:21:43.668933 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:21:43.668911    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25\": container with ID starting with 795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25 not found: ID does not exist" containerID="795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25"
Sep 10 22:21:43.668986 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.668941    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25"} err="failed to get container status \"795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25\": rpc error: code = NotFound desc = could not find container \"795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25\": container with ID starting with 795b36683f55f4b23653bad5cd1cf8e85365e6f77ebe4dfa6832a6051ad8dd25 not found: ID does not exist"
Sep 10 22:21:43.676637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.676617    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"]
Sep 10 22:21:43.681914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.681890    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2057d50e-755c857cc4-x6tb6"]
Sep 10 22:21:43.691055 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.691036    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"]
Sep 10 22:21:43.694895 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.694877    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2057d50e-77b589b665-rn497"]
Sep 10 22:21:43.822900 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.822871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:43.924092 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:43.924017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:44.023414 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:44.023372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:44.553223 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:44.553195    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20151f53-1ca4-44cc-a1e1-3bfc30f71005" path="/var/lib/kubelet/pods/20151f53-1ca4-44cc-a1e1-3bfc30f71005/volumes"
Sep 10 22:21:44.553594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:44.553528    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23b14b23-df02-400d-89a0-8017d7f93b19" path="/var/lib/kubelet/pods/23b14b23-df02-400d-89a0-8017d7f93b19/volumes"
Sep 10 22:21:44.553850 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:44.553825    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6055c78e-27af-4497-bd95-d262df5f8514" path="/var/lib/kubelet/pods/6055c78e-27af-4497-bd95-d262df5f8514/volumes"
Sep 10 22:21:45.332456 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:45.332424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:45.794511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:45.794476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:45.894406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:45.894376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:46.049688 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.049606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:46.466523 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.466436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:46.731270 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731237    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"]
Sep 10 22:21:46.731655 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731642    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454482a9-30d0-4ab4-9d87-725570b32c74" containerName="payload-pre-processing"
Sep 10 22:21:46.731700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731656    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="454482a9-30d0-4ab4-9d87-725570b32c74" containerName="payload-pre-processing"
Sep 10 22:21:46.731700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731666    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23b14b23-df02-400d-89a0-8017d7f93b19" containerName="payload-processing"
Sep 10 22:21:46.731700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731672    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23b14b23-df02-400d-89a0-8017d7f93b19" containerName="payload-processing"
Sep 10 22:21:46.731700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731680    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20151f53-1ca4-44cc-a1e1-3bfc30f71005" containerName="revoke-keys"
Sep 10 22:21:46.731700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731685    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20151f53-1ca4-44cc-a1e1-3bfc30f71005" containerName="revoke-keys"
Sep 10 22:21:46.731864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731710    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6055c78e-27af-4497-bd95-d262df5f8514" containerName="payload-pre-processing"
Sep 10 22:21:46.731864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731716    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6055c78e-27af-4497-bd95-d262df5f8514" containerName="payload-pre-processing"
Sep 10 22:21:46.731864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731791    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="23b14b23-df02-400d-89a0-8017d7f93b19" containerName="payload-processing"
Sep 10 22:21:46.731864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731800    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="454482a9-30d0-4ab4-9d87-725570b32c74" containerName="payload-pre-processing"
Sep 10 22:21:46.731864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731806    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6055c78e-27af-4497-bd95-d262df5f8514" containerName="payload-pre-processing"
Sep 10 22:21:46.731864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.731813    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="20151f53-1ca4-44cc-a1e1-3bfc30f71005" containerName="revoke-keys"
Sep 10 22:21:46.736508 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.736490    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.738681 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.738665    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-65b791-openshift-default-dockercfg-q2brv\""
Sep 10 22:21:46.746302 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.746279    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"]
Sep 10 22:21:46.759543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.759519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:46.847491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.847458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-socket\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.847873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.847502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-envoy\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.847873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.847529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-istio-token\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.847873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.847577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b840353d-74fb-427a-a334-e19d4dde66ee-istiod-ca-cert\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.847873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.847593    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-data\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.847873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.847618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b840353d-74fb-427a-a334-e19d4dde66ee-istio-podinfo\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.847873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.847658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7tf\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-kube-api-access-wj7tf\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.847873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.847702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-credential-socket\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.847873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.847720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-certs\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.912519 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.912492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:46.948801 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.948773    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-socket\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.948943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.948814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-envoy\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.948943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.948862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-istio-token\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.948943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.948903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b840353d-74fb-427a-a334-e19d4dde66ee-istiod-ca-cert\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.948943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.948929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-data\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.949154 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.948960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b840353d-74fb-427a-a334-e19d4dde66ee-istio-podinfo\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.949154 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.948993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7tf\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-kube-api-access-wj7tf\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.949154 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.949040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-credential-socket\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.949154 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.949065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-certs\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.949374 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.949225    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-socket\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.949532 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.949506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-certs\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.949640 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.949536    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-data\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.949640 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.949555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-credential-socket\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.949640 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.949625    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b840353d-74fb-427a-a334-e19d4dde66ee-istiod-ca-cert\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.951322 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.951290    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-envoy\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.951487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.951466    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b840353d-74fb-427a-a334-e19d4dde66ee-istio-podinfo\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.956111 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.956092    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-istio-token\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:46.956542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:46.956520    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7tf\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-kube-api-access-wj7tf\") pod \"e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") " pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:47.047928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:47.047797    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:47.325142 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:47.325114    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"]
Sep 10 22:21:47.326611 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:21:47.326586    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb840353d_74fb_427a_a334_e19d4dde66ee.slice/crio-80cd59986b3c75c2c1e37388888c7ca17d743a424f1aaf3cb990d5fca963a1e4 WatchSource:0}: Error finding container 80cd59986b3c75c2c1e37388888c7ca17d743a424f1aaf3cb990d5fca963a1e4: Status 404 returned error can't find the container with id 80cd59986b3c75c2c1e37388888c7ca17d743a424f1aaf3cb990d5fca963a1e4
Sep 10 22:21:47.329362 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:47.329330    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:21:47.329457 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:47.329411    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:21:47.329527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:47.329459    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:21:47.678919 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:47.678801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" event={"ID":"b840353d-74fb-427a-a334-e19d4dde66ee","Type":"ContainerStarted","Data":"6f7624e7e8666b6f323f6dbf160382cbedba4d8f530f72d7bb43d015a81de6f2"}
Sep 10 22:21:47.678919 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:47.678890    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" event={"ID":"b840353d-74fb-427a-a334-e19d4dde66ee","Type":"ContainerStarted","Data":"80cd59986b3c75c2c1e37388888c7ca17d743a424f1aaf3cb990d5fca963a1e4"}
Sep 10 22:21:47.698015 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:47.697940    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" podStartSLOduration=1.6979237710000001 podStartE2EDuration="1.697923771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:47.696836107 +0000 UTC m=+987.579320476" watchObservedRunningTime="2026-09-10 22:21:47.697923771 +0000 UTC m=+987.580408138"
Sep 10 22:21:48.048014 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:48.047976    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:48.052857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:48.052822    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:48.684993 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:48.684962    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:48.685893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:48.685873    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:21:49.557944 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:49.557905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:49.654416 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:49.654387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:50.704574 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:50.704543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:50.764236 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:50.764192    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:50.917188 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:50.917137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:51.220488 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:51.220444    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:51.293601 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:51.293553    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:51.765258 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:51.765205    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:51.874444 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:51.874413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:51.952471 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:51.952413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:52.014927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:52.014897    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:52.436394 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:21:52.436367    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:04.346274 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:04.346238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:07.801550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:07.801512    2573 generic.go:356] "Generic (PLEG): container finished" podID="b840353d-74fb-427a-a334-e19d4dde66ee" containerID="6f7624e7e8666b6f323f6dbf160382cbedba4d8f530f72d7bb43d015a81de6f2" exitCode=0
Sep 10 22:22:07.802091 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:07.801561    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" event={"ID":"b840353d-74fb-427a-a334-e19d4dde66ee","Type":"ContainerDied","Data":"6f7624e7e8666b6f323f6dbf160382cbedba4d8f530f72d7bb43d015a81de6f2"}
Sep 10 22:22:07.802091 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:07.801962    2573 scope.go:117] "RemoveContainer" containerID="6f7624e7e8666b6f323f6dbf160382cbedba4d8f530f72d7bb43d015a81de6f2"
Sep 10 22:22:07.803088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:07.803058    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:22:07.803180 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:07.803136    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:22:07.803180 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:07.803167    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:22:08.813130 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:08.813087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" event={"ID":"b840353d-74fb-427a-a334-e19d4dde66ee","Type":"ContainerStarted","Data":"f3a65aebcaada4286ba6979fbb03b92fbf286bf76f5a7e6f2deee6693793865b"}
Sep 10 22:22:09.048988 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:09.048953    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:22:09.049167 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:09.049150    2573 patch_prober.go:28] interesting pod/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:22:09.049211 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:09.049192    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 22:22:10.049016 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:10.048974    2573 patch_prober.go:28] interesting pod/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:22:10.049392 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:10.049028    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 22:22:11.048623 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:11.048579    2573 patch_prober.go:28] interesting pod/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:22:11.048818 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:11.048645    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 22:22:12.048378 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:12.048339    2573 patch_prober.go:28] interesting pod/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:22:12.048755 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:12.048407    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 22:22:13.049036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:13.048999    2573 patch_prober.go:28] interesting pod/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:22:13.049418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:13.049064    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 22:22:14.095268 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:14.095234    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:22:14.095745 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:14.095702    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:22:14.096542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:14.096522    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:22:14.475874 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:14.475826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:18.419578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:18.419549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:24.283161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:24.283123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:24.391508 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:24.391471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:24.482960 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:24.482924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:40.319385 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:40.319346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:44.232806 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:44.232775    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:46.355422 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:46.355389    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:46.457520 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:46.457484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:46.555134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:46.555070    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:46.668747 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:46.668672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:46.756109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:46.756073    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"]
Sep 10 22:22:46.761312 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:46.761291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"
Sep 10 22:22:46.763562 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:46.763544    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:22:46.769563 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:46.769541    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"]
Sep 10 22:22:46.907515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:46.907474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f0f40-610d-464c-97c5-07dfb385ac85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-65b791-r8j55\" (UID: \"9f2f0f40-610d-464c-97c5-07dfb385ac85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"
Sep 10 22:22:47.008215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:47.008183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f0f40-610d-464c-97c5-07dfb385ac85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-65b791-r8j55\" (UID: \"9f2f0f40-610d-464c-97c5-07dfb385ac85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"
Sep 10 22:22:47.008750 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:47.008730    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f0f40-610d-464c-97c5-07dfb385ac85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-65b791-r8j55\" (UID: \"9f2f0f40-610d-464c-97c5-07dfb385ac85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"
Sep 10 22:22:47.073547 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:47.073521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"
Sep 10 22:22:47.345289 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:47.345265    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"]
Sep 10 22:22:47.347159 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:22:47.347134    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2f0f40_610d_464c_97c5_07dfb385ac85.slice/crio-8b8f6ab76fde22a334ce700ff5db44b1cc4c880622664e922ace667055da48cd WatchSource:0}: Error finding container 8b8f6ab76fde22a334ce700ff5db44b1cc4c880622664e922ace667055da48cd: Status 404 returned error can't find the container with id 8b8f6ab76fde22a334ce700ff5db44b1cc4c880622664e922ace667055da48cd
Sep 10 22:22:48.053656 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:48.053624    2573 generic.go:356] "Generic (PLEG): container finished" podID="9f2f0f40-610d-464c-97c5-07dfb385ac85" containerID="8f3b7d1b64c39f56171f27f9f0469e2edd8b58e4cd75671ded544c35a0073e65" exitCode=0
Sep 10 22:22:48.054087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:48.053709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55" event={"ID":"9f2f0f40-610d-464c-97c5-07dfb385ac85","Type":"ContainerDied","Data":"8f3b7d1b64c39f56171f27f9f0469e2edd8b58e4cd75671ded544c35a0073e65"}
Sep 10 22:22:48.054087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:48.053762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55" event={"ID":"9f2f0f40-610d-464c-97c5-07dfb385ac85","Type":"ContainerStarted","Data":"8b8f6ab76fde22a334ce700ff5db44b1cc4c880622664e922ace667055da48cd"}
Sep 10 22:22:49.193395 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:49.193373    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"
Sep 10 22:22:49.331600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:49.331531    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f0f40-610d-464c-97c5-07dfb385ac85-maas-api-service-ca\") pod \"9f2f0f40-610d-464c-97c5-07dfb385ac85\" (UID: \"9f2f0f40-610d-464c-97c5-07dfb385ac85\") "
Sep 10 22:22:49.331940 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:49.331921    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f2f0f40-610d-464c-97c5-07dfb385ac85-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9f2f0f40-610d-464c-97c5-07dfb385ac85" (UID: "9f2f0f40-610d-464c-97c5-07dfb385ac85"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:22:49.432661 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:49.432632    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2f0f40-610d-464c-97c5-07dfb385ac85-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:22:50.066272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:50.066244    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"
Sep 10 22:22:50.066440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:50.066275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55" event={"ID":"9f2f0f40-610d-464c-97c5-07dfb385ac85","Type":"ContainerDied","Data":"8b8f6ab76fde22a334ce700ff5db44b1cc4c880622664e922ace667055da48cd"}
Sep 10 22:22:50.066440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:50.066316    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b8f6ab76fde22a334ce700ff5db44b1cc4c880622664e922ace667055da48cd"
Sep 10 22:22:51.930115 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:51.930065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.281600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:56.281548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.382880 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:56.382808    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:57.034115 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:57.034066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:57.276697 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:57.276648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:57.350274 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:57.350162    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:57.433074 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:57.433022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:57.489448 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:57.489415    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"]
Sep 10 22:22:57.491718 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:57.491698    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65b791-r8j55"]
Sep 10 22:22:57.499981 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:57.499924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:57.847720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:57.847674    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:57.905799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:57.905767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:58.553243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:22:58.553214    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f2f0f40-610d-464c-97c5-07dfb385ac85" path="/var/lib/kubelet/pods/9f2f0f40-610d-464c-97c5-07dfb385ac85/volumes"
Sep 10 22:23:02.918493 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:02.918461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:03.901756 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:03.901722    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:04.015065 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:04.015034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:04.216293 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:04.216196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:04.735326 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:04.735266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:04.836352 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:04.836311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:04.940059 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:04.940023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:04.980033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:04.979997    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"]
Sep 10 22:23:04.980286 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:04.980260    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy" containerID="cri-o://f3a65aebcaada4286ba6979fbb03b92fbf286bf76f5a7e6f2deee6693793865b" gracePeriod=30
Sep 10 22:23:05.007865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:05.007790    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:05.433114 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:05.433032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:05.718666 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:05.718569    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:05.885408 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:05.885379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:06.451570 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:06.451529    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:07.357445 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:07.357413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:07.455303 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:07.455273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:07.560338 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:07.560307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:10.191096 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.191070    2573 generic.go:356] "Generic (PLEG): container finished" podID="b840353d-74fb-427a-a334-e19d4dde66ee" containerID="f3a65aebcaada4286ba6979fbb03b92fbf286bf76f5a7e6f2deee6693793865b" exitCode=0
Sep 10 22:23:10.191483 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.191161    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" event={"ID":"b840353d-74fb-427a-a334-e19d4dde66ee","Type":"ContainerDied","Data":"f3a65aebcaada4286ba6979fbb03b92fbf286bf76f5a7e6f2deee6693793865b"}
Sep 10 22:23:10.191483 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.191237    2573 scope.go:117] "RemoveContainer" containerID="6f7624e7e8666b6f323f6dbf160382cbedba4d8f530f72d7bb43d015a81de6f2"
Sep 10 22:23:10.253237 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.253188    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:23:10.322859 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.322820    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-envoy\") pod \"b840353d-74fb-427a-a334-e19d4dde66ee\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") "
Sep 10 22:23:10.323079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.322881    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-certs\") pod \"b840353d-74fb-427a-a334-e19d4dde66ee\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") "
Sep 10 22:23:10.323079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.322919    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b840353d-74fb-427a-a334-e19d4dde66ee-istiod-ca-cert\") pod \"b840353d-74fb-427a-a334-e19d4dde66ee\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") "
Sep 10 22:23:10.323079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.322971    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-istio-token\") pod \"b840353d-74fb-427a-a334-e19d4dde66ee\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") "
Sep 10 22:23:10.323079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.322998    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj7tf\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-kube-api-access-wj7tf\") pod \"b840353d-74fb-427a-a334-e19d4dde66ee\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") "
Sep 10 22:23:10.323079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323028    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-socket\") pod \"b840353d-74fb-427a-a334-e19d4dde66ee\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") "
Sep 10 22:23:10.323079 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323062    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b840353d-74fb-427a-a334-e19d4dde66ee-istio-podinfo\") pod \"b840353d-74fb-427a-a334-e19d4dde66ee\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") "
Sep 10 22:23:10.323389 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323131    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-data\") pod \"b840353d-74fb-427a-a334-e19d4dde66ee\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") "
Sep 10 22:23:10.323389 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323157    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-credential-socket\") pod \"b840353d-74fb-427a-a334-e19d4dde66ee\" (UID: \"b840353d-74fb-427a-a334-e19d4dde66ee\") "
Sep 10 22:23:10.323389 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323210    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b840353d-74fb-427a-a334-e19d4dde66ee" (UID: "b840353d-74fb-427a-a334-e19d4dde66ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:23:10.323533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323444    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "b840353d-74fb-427a-a334-e19d4dde66ee" (UID: "b840353d-74fb-427a-a334-e19d4dde66ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:23:10.323533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323482    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:10.323533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323463    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b840353d-74fb-427a-a334-e19d4dde66ee" (UID: "b840353d-74fb-427a-a334-e19d4dde66ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:23:10.323694 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323661    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b840353d-74fb-427a-a334-e19d4dde66ee" (UID: "b840353d-74fb-427a-a334-e19d4dde66ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:23:10.323758 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.323727    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b840353d-74fb-427a-a334-e19d4dde66ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b840353d-74fb-427a-a334-e19d4dde66ee" (UID: "b840353d-74fb-427a-a334-e19d4dde66ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:23:10.325183 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.325153    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b840353d-74fb-427a-a334-e19d4dde66ee" (UID: "b840353d-74fb-427a-a334-e19d4dde66ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:23:10.325284 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.325238    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "b840353d-74fb-427a-a334-e19d4dde66ee" (UID: "b840353d-74fb-427a-a334-e19d4dde66ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:23:10.325383 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.325364    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-kube-api-access-wj7tf" (OuterVolumeSpecName: "kube-api-access-wj7tf") pod "b840353d-74fb-427a-a334-e19d4dde66ee" (UID: "b840353d-74fb-427a-a334-e19d4dde66ee"). InnerVolumeSpecName "kube-api-access-wj7tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:23:10.325431 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.325409    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b840353d-74fb-427a-a334-e19d4dde66ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b840353d-74fb-427a-a334-e19d4dde66ee" (UID: "b840353d-74fb-427a-a334-e19d4dde66ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:23:10.424875 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.424819    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:10.424875 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.424871    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj7tf\" (UniqueName: \"kubernetes.io/projected/b840353d-74fb-427a-a334-e19d4dde66ee-kube-api-access-wj7tf\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:10.424875 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.424882    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:10.425089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.424891    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b840353d-74fb-427a-a334-e19d4dde66ee-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:10.425089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.424900    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:10.425089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.424909    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:10.425089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.424917    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b840353d-74fb-427a-a334-e19d4dde66ee-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:10.425089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:10.424925    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b840353d-74fb-427a-a334-e19d4dde66ee-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:11.198680 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:11.198652    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"
Sep 10 22:23:11.198680 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:11.198663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt" event={"ID":"b840353d-74fb-427a-a334-e19d4dde66ee","Type":"ContainerDied","Data":"80cd59986b3c75c2c1e37388888c7ca17d743a424f1aaf3cb990d5fca963a1e4"}
Sep 10 22:23:11.199226 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:11.198717    2573 scope.go:117] "RemoveContainer" containerID="f3a65aebcaada4286ba6979fbb03b92fbf286bf76f5a7e6f2deee6693793865b"
Sep 10 22:23:11.215634 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:11.215606    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"]
Sep 10 22:23:11.220727 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:11.220704    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-65b791-openshift-default-5b564fc444-7qnqt"]
Sep 10 22:23:12.160821 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:12.160775    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:12.222886 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:12.222835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:12.553375 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:12.553342    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" path="/var/lib/kubelet/pods/b840353d-74fb-427a-a334-e19d4dde66ee/volumes"
Sep 10 22:23:12.806656 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:12.806545    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:14.198302 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:14.198243    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:18.656755 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:18.656722    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:18.756985 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:18.756953    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:18.881087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:18.881062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:19.142768 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.142738    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"]
Sep 10 22:23:19.143268 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.143245    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f2f0f40-610d-464c-97c5-07dfb385ac85" containerName="revoke-keys"
Sep 10 22:23:19.143268 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.143267    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f2f0f40-610d-464c-97c5-07dfb385ac85" containerName="revoke-keys"
Sep 10 22:23:19.143440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.143295    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy"
Sep 10 22:23:19.143440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.143303    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy"
Sep 10 22:23:19.143440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.143318    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy"
Sep 10 22:23:19.143440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.143328    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy"
Sep 10 22:23:19.143440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.143428    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy"
Sep 10 22:23:19.143682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.143443    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f2f0f40-610d-464c-97c5-07dfb385ac85" containerName="revoke-keys"
Sep 10 22:23:19.146632 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.146609    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.148763 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.148745    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b2c924c3-openshift-default-dockercfg-pjcrf\""
Sep 10 22:23:19.158097 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.158074    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"]
Sep 10 22:23:19.171194 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.171164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:19.198344 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.198319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c230c44b-162f-4358-bfb5-1d822ca451e9-istiod-ca-cert\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.198429 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.198354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-podinfo\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.198429 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.198389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-token\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.198515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.198464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-credential-socket\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.198515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.198489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxpmm\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-kube-api-access-xxpmm\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.198586 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.198546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-envoy\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.198586 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.198570    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-certs\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.198664 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.198591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-data\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.198664 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.198627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-socket\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.299966 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.299930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c230c44b-162f-4358-bfb5-1d822ca451e9-istiod-ca-cert\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300124 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.299974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-podinfo\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300124 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-token\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300124 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300064    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-credential-socket\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300124 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxpmm\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-kube-api-access-xxpmm\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300311 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-envoy\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300311 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-certs\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300311 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-data\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300311 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-socket\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-credential-socket\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300642    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-data\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-socket\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300831 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300720    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-certs\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.300996 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.300975    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c230c44b-162f-4358-bfb5-1d822ca451e9-istiod-ca-cert\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.302941 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.302920    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-envoy\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.303055 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.303038    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-podinfo\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.307974 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.307955    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-token\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.308066 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.308056    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxpmm\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-kube-api-access-xxpmm\") pod \"e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") " pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.393214 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.393139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:19.458982 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.458934    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:19.734526 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.734502    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"]
Sep 10 22:23:19.736515 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:23:19.736477    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc230c44b_162f_4358_bfb5_1d822ca451e9.slice/crio-97c3d3b158498bb395175be8c8c9adb6260b6dd1aa6cb383b81c523ed629e8d9 WatchSource:0}: Error finding container 97c3d3b158498bb395175be8c8c9adb6260b6dd1aa6cb383b81c523ed629e8d9: Status 404 returned error can't find the container with id 97c3d3b158498bb395175be8c8c9adb6260b6dd1aa6cb383b81c523ed629e8d9
Sep 10 22:23:19.738617 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.738586    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:23:19.738720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.738648    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:23:19.738720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:19.738679    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:23:20.254192 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:20.254160    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" event={"ID":"c230c44b-162f-4358-bfb5-1d822ca451e9","Type":"ContainerStarted","Data":"66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647"}
Sep 10 22:23:20.254359 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:20.254208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" event={"ID":"c230c44b-162f-4358-bfb5-1d822ca451e9","Type":"ContainerStarted","Data":"97c3d3b158498bb395175be8c8c9adb6260b6dd1aa6cb383b81c523ed629e8d9"}
Sep 10 22:23:20.306212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:20.306157    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" podStartSLOduration=1.306142656 podStartE2EDuration="1.306142656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:23:20.30390759 +0000 UTC m=+1080.186391959" watchObservedRunningTime="2026-09-10 22:23:20.306142656 +0000 UTC m=+1080.188627022"
Sep 10 22:23:20.459655 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:20.459622    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:20.464586 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:20.464559    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:21.259819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:21.259783    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:21.260817 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:21.260795    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:22.159035 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:22.159000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:22.258678 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:22.258641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:23.340351 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.340324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:23.439835 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.439806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:23.546027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.545992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:23.811356 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.811322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:23.897613 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.897582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:23.908071 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.908043    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"]
Sep 10 22:23:23.908493 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.908479    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b840353d-74fb-427a-a334-e19d4dde66ee" containerName="istio-proxy"
Sep 10 22:23:23.912979 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.912963    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:23.915035 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.914993    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b2c924c3\""
Sep 10 22:23:23.915175 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.915039    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b2c924c3-dockercfg-kkfxf\""
Sep 10 22:23:23.921076 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:23.921053    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"]
Sep 10 22:23:24.044704 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:24.044674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6419b6c1-2002-4a85-b35f-21b82801ebe4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb\" (UID: \"6419b6c1-2002-4a85-b35f-21b82801ebe4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:24.044902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:24.044759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9scl\" (UniqueName: \"kubernetes.io/projected/6419b6c1-2002-4a85-b35f-21b82801ebe4-kube-api-access-g9scl\") pod \"payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb\" (UID: \"6419b6c1-2002-4a85-b35f-21b82801ebe4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:24.145234 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:24.145160    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9scl\" (UniqueName: \"kubernetes.io/projected/6419b6c1-2002-4a85-b35f-21b82801ebe4-kube-api-access-g9scl\") pod \"payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb\" (UID: \"6419b6c1-2002-4a85-b35f-21b82801ebe4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:24.145234 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:24.145229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6419b6c1-2002-4a85-b35f-21b82801ebe4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb\" (UID: \"6419b6c1-2002-4a85-b35f-21b82801ebe4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:24.145922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:24.145898    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6419b6c1-2002-4a85-b35f-21b82801ebe4-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb\" (UID: \"6419b6c1-2002-4a85-b35f-21b82801ebe4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:24.152446 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:24.152427    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9scl\" (UniqueName: \"kubernetes.io/projected/6419b6c1-2002-4a85-b35f-21b82801ebe4-kube-api-access-g9scl\") pod \"payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb\" (UID: \"6419b6c1-2002-4a85-b35f-21b82801ebe4\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:24.223987 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:24.223958    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:24.494725 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:24.494699    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"]
Sep 10 22:23:24.495902 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:23:24.495872    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6419b6c1_2002_4a85_b35f_21b82801ebe4.slice/crio-48e967978e848a54066ee3ba1ce626da797d4ae86c773a138803c1e2aab7fce9 WatchSource:0}: Error finding container 48e967978e848a54066ee3ba1ce626da797d4ae86c773a138803c1e2aab7fce9: Status 404 returned error can't find the container with id 48e967978e848a54066ee3ba1ce626da797d4ae86c773a138803c1e2aab7fce9
Sep 10 22:23:25.290548 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:25.290503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb" event={"ID":"6419b6c1-2002-4a85-b35f-21b82801ebe4","Type":"ContainerStarted","Data":"ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374"}
Sep 10 22:23:25.290724 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:25.290571    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb" event={"ID":"6419b6c1-2002-4a85-b35f-21b82801ebe4","Type":"ContainerStarted","Data":"48e967978e848a54066ee3ba1ce626da797d4ae86c773a138803c1e2aab7fce9"}
Sep 10 22:23:25.290724 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:25.290630    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:25.306591 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:25.306541    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb" podStartSLOduration=2.306526542 podStartE2EDuration="2.306526542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:23:25.304018184 +0000 UTC m=+1085.186502550" watchObservedRunningTime="2026-09-10 22:23:25.306526542 +0000 UTC m=+1085.189010907"
Sep 10 22:23:35.721576 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:35.721540    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:36.298607 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:36.298576    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:23:36.718650 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:36.718533    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:36.816654 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:36.816617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:37.047265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:37.047202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:37.161717 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:37.161682    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:37.903693 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:37.903661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:38.001231 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.001193    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"]
Sep 10 22:23:38.005957 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.005940    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"
Sep 10 22:23:38.008326 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.008307    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:23:38.012493 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.012467    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"]
Sep 10 22:23:38.179594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.179497    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460a35f1-b3ff-4c3f-af34-30749934abaa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr\" (UID: \"460a35f1-b3ff-4c3f-af34-30749934abaa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"
Sep 10 22:23:38.255059 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.255028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:38.280317 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.280283    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460a35f1-b3ff-4c3f-af34-30749934abaa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr\" (UID: \"460a35f1-b3ff-4c3f-af34-30749934abaa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"
Sep 10 22:23:38.281211 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.281183    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460a35f1-b3ff-4c3f-af34-30749934abaa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr\" (UID: \"460a35f1-b3ff-4c3f-af34-30749934abaa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"
Sep 10 22:23:38.318951 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.318918    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"
Sep 10 22:23:38.615506 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:23:38.615475    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460a35f1_b3ff_4c3f_af34_30749934abaa.slice/crio-c42eed4a544443c45c39808c10bfcd452870f4656752de370998356e0a75d565 WatchSource:0}: Error finding container c42eed4a544443c45c39808c10bfcd452870f4656752de370998356e0a75d565: Status 404 returned error can't find the container with id c42eed4a544443c45c39808c10bfcd452870f4656752de370998356e0a75d565
Sep 10 22:23:38.616827 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:38.616802    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"]
Sep 10 22:23:39.372829 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:39.372795    2573 generic.go:356] "Generic (PLEG): container finished" podID="460a35f1-b3ff-4c3f-af34-30749934abaa" containerID="763a51f4faa6c3974b017036342e885addb413a91a0edc65be23b376e526193b" exitCode=0
Sep 10 22:23:39.373249 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:39.372886    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr" event={"ID":"460a35f1-b3ff-4c3f-af34-30749934abaa","Type":"ContainerDied","Data":"763a51f4faa6c3974b017036342e885addb413a91a0edc65be23b376e526193b"}
Sep 10 22:23:39.373249 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:39.372956    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr" event={"ID":"460a35f1-b3ff-4c3f-af34-30749934abaa","Type":"ContainerStarted","Data":"c42eed4a544443c45c39808c10bfcd452870f4656752de370998356e0a75d565"}
Sep 10 22:23:40.380040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.380009    2573 generic.go:356] "Generic (PLEG): container finished" podID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerID="66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647" exitCode=0
Sep 10 22:23:40.380449 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.380080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" event={"ID":"c230c44b-162f-4358-bfb5-1d822ca451e9","Type":"ContainerDied","Data":"66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647"}
Sep 10 22:23:40.380864 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.380586    2573 scope.go:117] "RemoveContainer" containerID="66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647"
Sep 10 22:23:40.381643 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.381611    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:23:40.381778 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.381695    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:23:40.381778 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.381744    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:23:40.529349 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.529323    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"
Sep 10 22:23:40.703655 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.703560    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460a35f1-b3ff-4c3f-af34-30749934abaa-maas-api-service-ca\") pod \"460a35f1-b3ff-4c3f-af34-30749934abaa\" (UID: \"460a35f1-b3ff-4c3f-af34-30749934abaa\") "
Sep 10 22:23:40.703936 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.703911    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460a35f1-b3ff-4c3f-af34-30749934abaa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "460a35f1-b3ff-4c3f-af34-30749934abaa" (UID: "460a35f1-b3ff-4c3f-af34-30749934abaa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:23:40.804821 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:40.804663    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/460a35f1-b3ff-4c3f-af34-30749934abaa-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:41.388317 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:41.388280    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" event={"ID":"c230c44b-162f-4358-bfb5-1d822ca451e9","Type":"ContainerStarted","Data":"ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1"}
Sep 10 22:23:41.389711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:41.389688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr" event={"ID":"460a35f1-b3ff-4c3f-af34-30749934abaa","Type":"ContainerDied","Data":"c42eed4a544443c45c39808c10bfcd452870f4656752de370998356e0a75d565"}
Sep 10 22:23:41.389832 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:41.389716    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"
Sep 10 22:23:41.389832 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:41.389722    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c42eed4a544443c45c39808c10bfcd452870f4656752de370998356e0a75d565"
Sep 10 22:23:41.459594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:41.459558    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:41.459808 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:41.459788    2573 patch_prober.go:28] interesting pod/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:23:41.459888 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:41.459834    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 22:23:42.183105 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:42.183070    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:42.460093 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:42.459999    2573 patch_prober.go:28] interesting pod/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:23:42.460093 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:42.460058    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 22:23:43.460040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:43.460006    2573 patch_prober.go:28] interesting pod/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:23:43.460220 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:43.460060    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 22:23:44.459283 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:44.459248    2573 patch_prober.go:28] interesting pod/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:23:44.459464 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:44.459305    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 22:23:45.224543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:45.224511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:45.459948 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:45.459912    2573 patch_prober.go:28] interesting pod/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 10 22:23:45.460146 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:45.459974    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 10 22:23:46.596283 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:46.596250    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:46.596713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:46.596696    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:46.597628 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:46.597602    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:23:47.146746 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:47.146693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:47.823478 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:47.823441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:47.923657 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:47.923624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:48.240404 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:48.240374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:48.341734 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:48.341708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:48.804505 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:48.804450    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:48.832669 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:48.832637    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"]
Sep 10 22:23:48.833078 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:48.832923    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d" podUID="3bee4d78-fc5c-4d1b-825a-4f3e09932ce3" containerName="payload-processing" containerID="cri-o://ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b" gracePeriod=30
Sep 10 22:23:48.876528 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:48.876498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:48.976776 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:48.976739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:49.011687 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.011658    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"]
Sep 10 22:23:49.015644 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.015615    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-669e2b-tdblr"]
Sep 10 22:23:49.032273 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.032248    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:49.078242 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.078217    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:23:49.101995 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.101965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:49.177991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.177961    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kglgg\" (UniqueName: \"kubernetes.io/projected/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-kube-api-access-kglgg\") pod \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\" (UID: \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\") "
Sep 10 22:23:49.178179 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.178003    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-plugins-config-volume\") pod \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\" (UID: \"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3\") "
Sep 10 22:23:49.178390 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.178367    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3bee4d78-fc5c-4d1b-825a-4f3e09932ce3" (UID: "3bee4d78-fc5c-4d1b-825a-4f3e09932ce3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:23:49.180071 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.180050    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-kube-api-access-kglgg" (OuterVolumeSpecName: "kube-api-access-kglgg") pod "3bee4d78-fc5c-4d1b-825a-4f3e09932ce3" (UID: "3bee4d78-fc5c-4d1b-825a-4f3e09932ce3"). InnerVolumeSpecName "kube-api-access-kglgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:23:49.278655 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.278617    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kglgg\" (UniqueName: \"kubernetes.io/projected/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-kube-api-access-kglgg\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:49.278655 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.278650    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:49.351411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.351341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:49.450006 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.449978    2573 generic.go:356] "Generic (PLEG): container finished" podID="3bee4d78-fc5c-4d1b-825a-4f3e09932ce3" containerID="ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b" exitCode=0
Sep 10 22:23:49.450174 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.450024    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"
Sep 10 22:23:49.450174 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.450071    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d" event={"ID":"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3","Type":"ContainerDied","Data":"ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b"}
Sep 10 22:23:49.450174 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.450125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d" event={"ID":"3bee4d78-fc5c-4d1b-825a-4f3e09932ce3","Type":"ContainerDied","Data":"5c6f79e1aa75e1a85b4f2ef9db0a195474b31506004d81efaab5c1bd17772cd7"}
Sep 10 22:23:49.450174 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.450148    2573 scope.go:117] "RemoveContainer" containerID="ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b"
Sep 10 22:23:49.460155 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.460135    2573 scope.go:117] "RemoveContainer" containerID="ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b"
Sep 10 22:23:49.460442 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:23:49.460424    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b\": container with ID starting with ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b not found: ID does not exist" containerID="ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b"
Sep 10 22:23:49.460512 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.460447    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b"} err="failed to get container status \"ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b\": rpc error: code = NotFound desc = could not find container \"ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b\": container with ID starting with ca3f08dc3b8b00a23e6ec912cd8c173b6af55fd3f7724d64316df9899a6aeb6b not found: ID does not exist"
Sep 10 22:23:49.491666 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.491636    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"]
Sep 10 22:23:49.507036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:49.507016    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-669e2b-7797cd6d65-gf22d"]
Sep 10 22:23:50.553506 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:50.553477    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bee4d78-fc5c-4d1b-825a-4f3e09932ce3" path="/var/lib/kubelet/pods/3bee4d78-fc5c-4d1b-825a-4f3e09932ce3/volumes"
Sep 10 22:23:50.553886 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:50.553805    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="460a35f1-b3ff-4c3f-af34-30749934abaa" path="/var/lib/kubelet/pods/460a35f1-b3ff-4c3f-af34-30749934abaa/volumes"
Sep 10 22:23:54.117823 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:54.117790    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:54.187892 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:54.187858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:54.560199 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:54.560166    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:55.433345 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:55.433305    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:55.533874 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:55.533830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:55.693627 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:55.693549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:56.020088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.020044    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"]
Sep 10 22:23:56.020477 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.020464    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460a35f1-b3ff-4c3f-af34-30749934abaa" containerName="revoke-keys"
Sep 10 22:23:56.020525 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.020478    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="460a35f1-b3ff-4c3f-af34-30749934abaa" containerName="revoke-keys"
Sep 10 22:23:56.020525 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.020500    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bee4d78-fc5c-4d1b-825a-4f3e09932ce3" containerName="payload-processing"
Sep 10 22:23:56.020525 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.020506    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bee4d78-fc5c-4d1b-825a-4f3e09932ce3" containerName="payload-processing"
Sep 10 22:23:56.020635 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.020569    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bee4d78-fc5c-4d1b-825a-4f3e09932ce3" containerName="payload-processing"
Sep 10 22:23:56.020635 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.020579    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="460a35f1-b3ff-4c3f-af34-30749934abaa" containerName="revoke-keys"
Sep 10 22:23:56.025059 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.025040    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"
Sep 10 22:23:56.027420 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.027395    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:23:56.030280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.030254    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"]
Sep 10 22:23:56.034204 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.034179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0effda-ab4f-438f-a630-93734ad20141-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb\" (UID: \"ce0effda-ab4f-438f-a630-93734ad20141\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"
Sep 10 22:23:56.114659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.114583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:56.135057 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.135030    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0effda-ab4f-438f-a630-93734ad20141-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb\" (UID: \"ce0effda-ab4f-438f-a630-93734ad20141\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"
Sep 10 22:23:56.135665 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.135641    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0effda-ab4f-438f-a630-93734ad20141-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb\" (UID: \"ce0effda-ab4f-438f-a630-93734ad20141\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"
Sep 10 22:23:56.338200 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.338119    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"
Sep 10 22:23:56.609705 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:56.609681    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"]
Sep 10 22:23:56.611720 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:23:56.611686    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0effda_ab4f_438f_a630_93734ad20141.slice/crio-f48951efa68be5ea1808aa23348471b576814d4331283691cb850d6161940577 WatchSource:0}: Error finding container f48951efa68be5ea1808aa23348471b576814d4331283691cb850d6161940577: Status 404 returned error can't find the container with id f48951efa68be5ea1808aa23348471b576814d4331283691cb850d6161940577
Sep 10 22:23:57.499588 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:57.499555    2573 generic.go:356] "Generic (PLEG): container finished" podID="ce0effda-ab4f-438f-a630-93734ad20141" containerID="9269d7ecb0f33cc2a238c69da15da8fa96b68d3b53f9792374b28b911ff72eb3" exitCode=0
Sep 10 22:23:57.499799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:57.499655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb" event={"ID":"ce0effda-ab4f-438f-a630-93734ad20141","Type":"ContainerDied","Data":"9269d7ecb0f33cc2a238c69da15da8fa96b68d3b53f9792374b28b911ff72eb3"}
Sep 10 22:23:57.499799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:57.499718    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb" event={"ID":"ce0effda-ab4f-438f-a630-93734ad20141","Type":"ContainerStarted","Data":"f48951efa68be5ea1808aa23348471b576814d4331283691cb850d6161940577"}
Sep 10 22:23:58.643255 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:58.643231    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"
Sep 10 22:23:58.657815 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:58.657785    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0effda-ab4f-438f-a630-93734ad20141-maas-api-service-ca\") pod \"ce0effda-ab4f-438f-a630-93734ad20141\" (UID: \"ce0effda-ab4f-438f-a630-93734ad20141\") "
Sep 10 22:23:58.658143 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:58.658116    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce0effda-ab4f-438f-a630-93734ad20141-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce0effda-ab4f-438f-a630-93734ad20141" (UID: "ce0effda-ab4f-438f-a630-93734ad20141"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:23:58.759110 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:58.759044    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0effda-ab4f-438f-a630-93734ad20141-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:23:59.513558 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:59.513519    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"
Sep 10 22:23:59.513721 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:59.513559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb" event={"ID":"ce0effda-ab4f-438f-a630-93734ad20141","Type":"ContainerDied","Data":"f48951efa68be5ea1808aa23348471b576814d4331283691cb850d6161940577"}
Sep 10 22:23:59.513721 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:23:59.513604    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f48951efa68be5ea1808aa23348471b576814d4331283691cb850d6161940577"
Sep 10 22:24:04.577979 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:04.577937    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:05.125488 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.125458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:05.157912 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.157878    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"]
Sep 10 22:24:05.158144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.158096    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb" podUID="6419b6c1-2002-4a85-b35f-21b82801ebe4" containerName="payload-pre-processing" containerID="cri-o://ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374" gracePeriod=30
Sep 10 22:24:05.222955 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.222915    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:05.311371 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.311327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:05.372617 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.372584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:05.415492 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.415467    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:24:05.513752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.513716    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6419b6c1-2002-4a85-b35f-21b82801ebe4-plugins-config-volume\") pod \"6419b6c1-2002-4a85-b35f-21b82801ebe4\" (UID: \"6419b6c1-2002-4a85-b35f-21b82801ebe4\") "
Sep 10 22:24:05.513971 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.513788    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9scl\" (UniqueName: \"kubernetes.io/projected/6419b6c1-2002-4a85-b35f-21b82801ebe4-kube-api-access-g9scl\") pod \"6419b6c1-2002-4a85-b35f-21b82801ebe4\" (UID: \"6419b6c1-2002-4a85-b35f-21b82801ebe4\") "
Sep 10 22:24:05.514136 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.514111    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6419b6c1-2002-4a85-b35f-21b82801ebe4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6419b6c1-2002-4a85-b35f-21b82801ebe4" (UID: "6419b6c1-2002-4a85-b35f-21b82801ebe4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:24:05.515952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.515922    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6419b6c1-2002-4a85-b35f-21b82801ebe4-kube-api-access-g9scl" (OuterVolumeSpecName: "kube-api-access-g9scl") pod "6419b6c1-2002-4a85-b35f-21b82801ebe4" (UID: "6419b6c1-2002-4a85-b35f-21b82801ebe4"). InnerVolumeSpecName "kube-api-access-g9scl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:05.549390 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.549362    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"
Sep 10 22:24:05.549878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.549317    2573 generic.go:356] "Generic (PLEG): container finished" podID="6419b6c1-2002-4a85-b35f-21b82801ebe4" containerID="ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374" exitCode=0
Sep 10 22:24:05.549878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.549731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb" event={"ID":"6419b6c1-2002-4a85-b35f-21b82801ebe4","Type":"ContainerDied","Data":"ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374"}
Sep 10 22:24:05.549878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.549805    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb" event={"ID":"6419b6c1-2002-4a85-b35f-21b82801ebe4","Type":"ContainerDied","Data":"48e967978e848a54066ee3ba1ce626da797d4ae86c773a138803c1e2aab7fce9"}
Sep 10 22:24:05.550105 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.549882    2573 scope.go:117] "RemoveContainer" containerID="ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374"
Sep 10 22:24:05.565594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.565578    2573 scope.go:117] "RemoveContainer" containerID="ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374"
Sep 10 22:24:05.565873 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:24:05.565825    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374\": container with ID starting with ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374 not found: ID does not exist" containerID="ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374"
Sep 10 22:24:05.565943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.565882    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374"} err="failed to get container status \"ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374\": rpc error: code = NotFound desc = could not find container \"ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374\": container with ID starting with ee308f2c75582b43a9dcf28352f41ef8a34e99b4644d3334672d981542900374 not found: ID does not exist"
Sep 10 22:24:05.573855 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.573821    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"]
Sep 10 22:24:05.577983 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.577960    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b2c924c3-65df48d8d6-c2mmb"]
Sep 10 22:24:05.615155 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.615133    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6419b6c1-2002-4a85-b35f-21b82801ebe4-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:05.615155 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.615152    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9scl\" (UniqueName: \"kubernetes.io/projected/6419b6c1-2002-4a85-b35f-21b82801ebe4-kube-api-access-g9scl\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:05.668978 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:05.668920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:06.146605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.146574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:06.553942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.553908    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6419b6c1-2002-4a85-b35f-21b82801ebe4" path="/var/lib/kubelet/pods/6419b6c1-2002-4a85-b35f-21b82801ebe4/volumes"
Sep 10 22:24:06.697740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.697714    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:06.783212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.783180    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"]
Sep 10 22:24:06.783440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.783394    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72" podUID="c81e5394-979f-48a0-8c56-c2d6345a6ef3" containerName="payload-processing" containerID="cri-o://51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df" gracePeriod=30
Sep 10 22:24:06.786938 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.786902    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"]
Sep 10 22:24:06.787366 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.787315    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs" podUID="6568fef5-2bb0-4795-8b94-bc5ba9db4950" containerName="payload-pre-processing" containerID="cri-o://30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a" gracePeriod=30
Sep 10 22:24:06.813543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.813453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:06.913581 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.913553    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:06.929486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.929458    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"]
Sep 10 22:24:06.933456 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:06.933424    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c3af05-dchtb"]
Sep 10 22:24:07.015023 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.014988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:07.073189 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.073164    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:24:07.078038 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.078004    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:24:07.129486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.129458    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6568fef5-2bb0-4795-8b94-bc5ba9db4950-plugins-config-volume\") pod \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\" (UID: \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\") "
Sep 10 22:24:07.129486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.129490    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jbhr\" (UniqueName: \"kubernetes.io/projected/6568fef5-2bb0-4795-8b94-bc5ba9db4950-kube-api-access-5jbhr\") pod \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\" (UID: \"6568fef5-2bb0-4795-8b94-bc5ba9db4950\") "
Sep 10 22:24:07.129703 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.129519    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81e5394-979f-48a0-8c56-c2d6345a6ef3-plugins-config-volume\") pod \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\" (UID: \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\") "
Sep 10 22:24:07.129703 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.129542    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqq7k\" (UniqueName: \"kubernetes.io/projected/c81e5394-979f-48a0-8c56-c2d6345a6ef3-kube-api-access-nqq7k\") pod \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\" (UID: \"c81e5394-979f-48a0-8c56-c2d6345a6ef3\") "
Sep 10 22:24:07.129929 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.129897    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c81e5394-979f-48a0-8c56-c2d6345a6ef3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c81e5394-979f-48a0-8c56-c2d6345a6ef3" (UID: "c81e5394-979f-48a0-8c56-c2d6345a6ef3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:24:07.129999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.129905    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6568fef5-2bb0-4795-8b94-bc5ba9db4950-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6568fef5-2bb0-4795-8b94-bc5ba9db4950" (UID: "6568fef5-2bb0-4795-8b94-bc5ba9db4950"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:24:07.131701 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.131681    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c81e5394-979f-48a0-8c56-c2d6345a6ef3-kube-api-access-nqq7k" (OuterVolumeSpecName: "kube-api-access-nqq7k") pod "c81e5394-979f-48a0-8c56-c2d6345a6ef3" (UID: "c81e5394-979f-48a0-8c56-c2d6345a6ef3"). InnerVolumeSpecName "kube-api-access-nqq7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:07.131760 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.131708    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6568fef5-2bb0-4795-8b94-bc5ba9db4950-kube-api-access-5jbhr" (OuterVolumeSpecName: "kube-api-access-5jbhr") pod "6568fef5-2bb0-4795-8b94-bc5ba9db4950" (UID: "6568fef5-2bb0-4795-8b94-bc5ba9db4950"). InnerVolumeSpecName "kube-api-access-5jbhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:07.230547 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.230520    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6568fef5-2bb0-4795-8b94-bc5ba9db4950-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:07.230547 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.230545    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jbhr\" (UniqueName: \"kubernetes.io/projected/6568fef5-2bb0-4795-8b94-bc5ba9db4950-kube-api-access-5jbhr\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:07.230727 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.230558    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c81e5394-979f-48a0-8c56-c2d6345a6ef3-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:07.230727 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.230567    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqq7k\" (UniqueName: \"kubernetes.io/projected/c81e5394-979f-48a0-8c56-c2d6345a6ef3-kube-api-access-nqq7k\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:07.319894 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.319779    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:07.564408 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.564373    2573 generic.go:356] "Generic (PLEG): container finished" podID="6568fef5-2bb0-4795-8b94-bc5ba9db4950" containerID="30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a" exitCode=0
Sep 10 22:24:07.564594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.564426    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"
Sep 10 22:24:07.564594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.564460    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs" event={"ID":"6568fef5-2bb0-4795-8b94-bc5ba9db4950","Type":"ContainerDied","Data":"30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a"}
Sep 10 22:24:07.564594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.564502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs" event={"ID":"6568fef5-2bb0-4795-8b94-bc5ba9db4950","Type":"ContainerDied","Data":"556eaede838c1968a474f7e29ec7f3d9751bdafcc23e70b71b44a15cf0deffa9"}
Sep 10 22:24:07.564594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.564526    2573 scope.go:117] "RemoveContainer" containerID="30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a"
Sep 10 22:24:07.565905 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.565883    2573 generic.go:356] "Generic (PLEG): container finished" podID="c81e5394-979f-48a0-8c56-c2d6345a6ef3" containerID="51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df" exitCode=0
Sep 10 22:24:07.566007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.565922    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"
Sep 10 22:24:07.566007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.565957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72" event={"ID":"c81e5394-979f-48a0-8c56-c2d6345a6ef3","Type":"ContainerDied","Data":"51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df"}
Sep 10 22:24:07.566133 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.566006    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72" event={"ID":"c81e5394-979f-48a0-8c56-c2d6345a6ef3","Type":"ContainerDied","Data":"e4067c6fbf9bac98824960fd247c9f9d3da5b046e674bb381ea5ccf11d375ac3"}
Sep 10 22:24:07.575390 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.575375    2573 scope.go:117] "RemoveContainer" containerID="30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a"
Sep 10 22:24:07.575787 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:24:07.575666    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a\": container with ID starting with 30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a not found: ID does not exist" containerID="30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a"
Sep 10 22:24:07.575787 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.575695    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a"} err="failed to get container status \"30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a\": rpc error: code = NotFound desc = could not find container \"30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a\": container with ID starting with 30773190047ebee9abb85094d9702c61703d2f5cdbb8dc71a9bde4fc29eda11a not found: ID does not exist"
Sep 10 22:24:07.575787 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.575719    2573 scope.go:117] "RemoveContainer" containerID="51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df"
Sep 10 22:24:07.583794 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.583770    2573 scope.go:117] "RemoveContainer" containerID="51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df"
Sep 10 22:24:07.584466 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:24:07.584437    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df\": container with ID starting with 51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df not found: ID does not exist" containerID="51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df"
Sep 10 22:24:07.584569 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.584475    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df"} err="failed to get container status \"51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df\": rpc error: code = NotFound desc = could not find container \"51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df\": container with ID starting with 51090660d8f7549966656b808f55bcd35d99845a3bd6eb3c2e41fe38cdade2df not found: ID does not exist"
Sep 10 22:24:07.586481 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.586462    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"]
Sep 10 22:24:07.589989 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.589970    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c3af05-7bc6d7ff7d-g97fs"]
Sep 10 22:24:07.598724 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.598698    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"]
Sep 10 22:24:07.602200 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:07.602180    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c3af05-84f8cf49cf-pfb72"]
Sep 10 22:24:08.555480 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:08.555445    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6568fef5-2bb0-4795-8b94-bc5ba9db4950" path="/var/lib/kubelet/pods/6568fef5-2bb0-4795-8b94-bc5ba9db4950/volumes"
Sep 10 22:24:08.556037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:08.555877    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c81e5394-979f-48a0-8c56-c2d6345a6ef3" path="/var/lib/kubelet/pods/c81e5394-979f-48a0-8c56-c2d6345a6ef3/volumes"
Sep 10 22:24:08.556213 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:08.556195    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce0effda-ab4f-438f-a630-93734ad20141" path="/var/lib/kubelet/pods/ce0effda-ab4f-438f-a630-93734ad20141/volumes"
Sep 10 22:24:11.378798 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:11.378760    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:11.462409 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:11.462376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:11.623539 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:11.623507    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"]
Sep 10 22:24:11.623807 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:11.623781    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy" containerID="cri-o://ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1" gracePeriod=30
Sep 10 22:24:11.645555 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:11.645476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:11.976092 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:11.976035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:12.066991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:12.066954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:12.171998 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:12.171970    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:13.214091 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:13.214051    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:13.314365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:13.314322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:13.455341 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:13.455311    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"]
Sep 10 22:24:13.455544 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:13.455520    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy" containerID="cri-o://e4f737183bb4f541df68110dea3203cb869e28b22251157df0cfcfdddb36a634" gracePeriod=30
Sep 10 22:24:13.469886 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:13.469805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:13.627396 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:13.627364    2573 patch_prober.go:28] interesting pod/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:24:13.627563 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:13.627423    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:24:14.032397 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:14.032362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:14.342360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:14.342285    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:14.440678 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:14.440641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:16.599356 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:16.599317    2573 patch_prober.go:28] interesting pod/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:24:16.599747 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:16.599376    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:24:16.875982 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:16.875955    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:24:17.016247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016214    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c230c44b-162f-4358-bfb5-1d822ca451e9-istiod-ca-cert\") pod \"c230c44b-162f-4358-bfb5-1d822ca451e9\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") "
Sep 10 22:24:17.016247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016249    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxpmm\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-kube-api-access-xxpmm\") pod \"c230c44b-162f-4358-bfb5-1d822ca451e9\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") "
Sep 10 22:24:17.016442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016297    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-credential-socket\") pod \"c230c44b-162f-4358-bfb5-1d822ca451e9\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") "
Sep 10 22:24:17.016442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016329    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-envoy\") pod \"c230c44b-162f-4358-bfb5-1d822ca451e9\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") "
Sep 10 22:24:17.016442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-certs\") pod \"c230c44b-162f-4358-bfb5-1d822ca451e9\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") "
Sep 10 22:24:17.016442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016360    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-data\") pod \"c230c44b-162f-4358-bfb5-1d822ca451e9\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") "
Sep 10 22:24:17.016442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016377    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-token\") pod \"c230c44b-162f-4358-bfb5-1d822ca451e9\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") "
Sep 10 22:24:17.016442 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016428    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-podinfo\") pod \"c230c44b-162f-4358-bfb5-1d822ca451e9\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") "
Sep 10 22:24:17.016740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016465    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-socket\") pod \"c230c44b-162f-4358-bfb5-1d822ca451e9\" (UID: \"c230c44b-162f-4358-bfb5-1d822ca451e9\") "
Sep 10 22:24:17.016740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016655    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c230c44b-162f-4358-bfb5-1d822ca451e9" (UID: "c230c44b-162f-4358-bfb5-1d822ca451e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:17.016740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016677    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c230c44b-162f-4358-bfb5-1d822ca451e9" (UID: "c230c44b-162f-4358-bfb5-1d822ca451e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:17.016740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016629    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c230c44b-162f-4358-bfb5-1d822ca451e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c230c44b-162f-4358-bfb5-1d822ca451e9" (UID: "c230c44b-162f-4358-bfb5-1d822ca451e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:24:17.016740 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016707    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "c230c44b-162f-4358-bfb5-1d822ca451e9" (UID: "c230c44b-162f-4358-bfb5-1d822ca451e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:17.017040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016818    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:17.017040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016864    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:17.017040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016878    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c230c44b-162f-4358-bfb5-1d822ca451e9-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:17.017040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016890    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:17.017040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.016935    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c230c44b-162f-4358-bfb5-1d822ca451e9" (UID: "c230c44b-162f-4358-bfb5-1d822ca451e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:17.018550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.018526    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-kube-api-access-xxpmm" (OuterVolumeSpecName: "kube-api-access-xxpmm") pod "c230c44b-162f-4358-bfb5-1d822ca451e9" (UID: "c230c44b-162f-4358-bfb5-1d822ca451e9"). InnerVolumeSpecName "kube-api-access-xxpmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:17.018659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.018569    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c230c44b-162f-4358-bfb5-1d822ca451e9" (UID: "c230c44b-162f-4358-bfb5-1d822ca451e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:17.018659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.018587    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c230c44b-162f-4358-bfb5-1d822ca451e9" (UID: "c230c44b-162f-4358-bfb5-1d822ca451e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:24:17.018659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.018612    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "c230c44b-162f-4358-bfb5-1d822ca451e9" (UID: "c230c44b-162f-4358-bfb5-1d822ca451e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:17.118161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.118098    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxpmm\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-kube-api-access-xxpmm\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:17.118161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.118120    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:17.118161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.118130    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:17.118161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.118137    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c230c44b-162f-4358-bfb5-1d822ca451e9-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:17.118161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.118145    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c230c44b-162f-4358-bfb5-1d822ca451e9-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:17.327923 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.327891    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:17.428055 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.427983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:17.632891 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.632828    2573 generic.go:356] "Generic (PLEG): container finished" podID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerID="ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1" exitCode=0
Sep 10 22:24:17.632891 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.632885    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"
Sep 10 22:24:17.633298 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.632914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" event={"ID":"c230c44b-162f-4358-bfb5-1d822ca451e9","Type":"ContainerDied","Data":"ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1"}
Sep 10 22:24:17.633298 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.632971    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp" event={"ID":"c230c44b-162f-4358-bfb5-1d822ca451e9","Type":"ContainerDied","Data":"97c3d3b158498bb395175be8c8c9adb6260b6dd1aa6cb383b81c523ed629e8d9"}
Sep 10 22:24:17.633298 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.632997    2573 scope.go:117] "RemoveContainer" containerID="ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1"
Sep 10 22:24:17.643198 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.643177    2573 scope.go:117] "RemoveContainer" containerID="66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647"
Sep 10 22:24:17.651167 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.651151    2573 scope.go:117] "RemoveContainer" containerID="ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1"
Sep 10 22:24:17.651423 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:24:17.651405    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1\": container with ID starting with ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1 not found: ID does not exist" containerID="ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1"
Sep 10 22:24:17.651473 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.651430    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1"} err="failed to get container status \"ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1\": rpc error: code = NotFound desc = could not find container \"ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1\": container with ID starting with ab4e6c717f5ecf9eb1678af707894b3375356a618bc20e42952ebdc96739e4a1 not found: ID does not exist"
Sep 10 22:24:17.651473 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.651446    2573 scope.go:117] "RemoveContainer" containerID="66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647"
Sep 10 22:24:17.651755 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:24:17.651728    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647\": container with ID starting with 66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647 not found: ID does not exist" containerID="66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647"
Sep 10 22:24:17.651878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.651764    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647"} err="failed to get container status \"66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647\": rpc error: code = NotFound desc = could not find container \"66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647\": container with ID starting with 66c43ade9969fd3b7d93b74870cdbb125b23724c3d26a68b9a3f9742abf21647 not found: ID does not exist"
Sep 10 22:24:17.654498 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.654478    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"]
Sep 10 22:24:17.658585 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:17.658566    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b2c924c3-openshift-default-65bf5d9dd8-55wkp"]
Sep 10 22:24:18.278163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.278128    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:18.374798 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.374764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:18.433275 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.433249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:18.540529 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.540456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:18.553418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.553390    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" path="/var/lib/kubelet/pods/c230c44b-162f-4358-bfb5-1d822ca451e9/volumes"
Sep 10 22:24:18.640018 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.639895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:18.644776 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.644700    2573 generic.go:356] "Generic (PLEG): container finished" podID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerID="e4f737183bb4f541df68110dea3203cb869e28b22251157df0cfcfdddb36a634" exitCode=0
Sep 10 22:24:18.644990 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.644780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" event={"ID":"33b0db21-5ca9-4eb0-b391-b1b5635b9903","Type":"ContainerDied","Data":"e4f737183bb4f541df68110dea3203cb869e28b22251157df0cfcfdddb36a634"}
Sep 10 22:24:18.644990 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.644950    2573 scope.go:117] "RemoveContainer" containerID="7a6533fcff69e3ca1653094dd3167cb3fd6694f3c888c8d0b8b2368b6be40ccc"
Sep 10 22:24:18.709504 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.709482    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:24:18.835377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835297    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-certs\") pod \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") "
Sep 10 22:24:18.835377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835338    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istiod-ca-cert\") pod \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") "
Sep 10 22:24:18.835597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835381    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-socket\") pod \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") "
Sep 10 22:24:18.835597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835399    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-credential-socket\") pod \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") "
Sep 10 22:24:18.835597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835413    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-envoy\") pod \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") "
Sep 10 22:24:18.835597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835434    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlmf4\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-kube-api-access-jlmf4\") pod \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") "
Sep 10 22:24:18.835597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835455    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-podinfo\") pod \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") "
Sep 10 22:24:18.835597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835501    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-data\") pod \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") "
Sep 10 22:24:18.835597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835530    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-token\") pod \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\" (UID: \"33b0db21-5ca9-4eb0-b391-b1b5635b9903\") "
Sep 10 22:24:18.835597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835583    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "33b0db21-5ca9-4eb0-b391-b1b5635b9903" (UID: "33b0db21-5ca9-4eb0-b391-b1b5635b9903"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:18.836037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835721    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "33b0db21-5ca9-4eb0-b391-b1b5635b9903" (UID: "33b0db21-5ca9-4eb0-b391-b1b5635b9903"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:18.836037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835766    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "33b0db21-5ca9-4eb0-b391-b1b5635b9903" (UID: "33b0db21-5ca9-4eb0-b391-b1b5635b9903"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:18.836037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835908    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:18.836037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835939    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:18.836037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835955    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:18.836037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.835953    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-data" (OuterVolumeSpecName: "istio-data") pod "33b0db21-5ca9-4eb0-b391-b1b5635b9903" (UID: "33b0db21-5ca9-4eb0-b391-b1b5635b9903"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:18.836292 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.836106    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "33b0db21-5ca9-4eb0-b391-b1b5635b9903" (UID: "33b0db21-5ca9-4eb0-b391-b1b5635b9903"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:24:18.837769 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.837744    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "33b0db21-5ca9-4eb0-b391-b1b5635b9903" (UID: "33b0db21-5ca9-4eb0-b391-b1b5635b9903"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:24:18.837878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.837794    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "33b0db21-5ca9-4eb0-b391-b1b5635b9903" (UID: "33b0db21-5ca9-4eb0-b391-b1b5635b9903"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:24:18.838041 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.838026    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-token" (OuterVolumeSpecName: "istio-token") pod "33b0db21-5ca9-4eb0-b391-b1b5635b9903" (UID: "33b0db21-5ca9-4eb0-b391-b1b5635b9903"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:18.838169 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.838146    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-kube-api-access-jlmf4" (OuterVolumeSpecName: "kube-api-access-jlmf4") pod "33b0db21-5ca9-4eb0-b391-b1b5635b9903" (UID: "33b0db21-5ca9-4eb0-b391-b1b5635b9903"). InnerVolumeSpecName "kube-api-access-jlmf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:24:18.927275 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.927242    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:18.936489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.936469    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:18.936489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.936490    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:18.936605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.936500    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlmf4\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-kube-api-access-jlmf4\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:18.936605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.936510    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:18.936605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.936519    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:18.936605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:18.936527    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33b0db21-5ca9-4eb0-b391-b1b5635b9903-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:24:19.031010 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.030973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:19.119656 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.119570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:19.124941 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.124917    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"]
Sep 10 22:24:19.125269 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125257    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6568fef5-2bb0-4795-8b94-bc5ba9db4950" containerName="payload-pre-processing"
Sep 10 22:24:19.125316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125272    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6568fef5-2bb0-4795-8b94-bc5ba9db4950" containerName="payload-pre-processing"
Sep 10 22:24:19.125316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125288    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy"
Sep 10 22:24:19.125316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125294    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy"
Sep 10 22:24:19.125316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125302    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce0effda-ab4f-438f-a630-93734ad20141" containerName="revoke-keys"
Sep 10 22:24:19.125316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125307    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce0effda-ab4f-438f-a630-93734ad20141" containerName="revoke-keys"
Sep 10 22:24:19.125316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125315    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c81e5394-979f-48a0-8c56-c2d6345a6ef3" containerName="payload-processing"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125321    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c81e5394-979f-48a0-8c56-c2d6345a6ef3" containerName="payload-processing"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125329    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125334    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125342    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125347    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125354    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125359    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125364    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6419b6c1-2002-4a85-b35f-21b82801ebe4" containerName="payload-pre-processing"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125370    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6419b6c1-2002-4a85-b35f-21b82801ebe4" containerName="payload-pre-processing"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125420    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125427    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c230c44b-162f-4358-bfb5-1d822ca451e9" containerName="istio-proxy"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125434    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce0effda-ab4f-438f-a630-93734ad20141" containerName="revoke-keys"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125440    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c81e5394-979f-48a0-8c56-c2d6345a6ef3" containerName="payload-processing"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125447    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125451    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6419b6c1-2002-4a85-b35f-21b82801ebe4" containerName="payload-pre-processing"
Sep 10 22:24:19.125582 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.125460    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6568fef5-2bb0-4795-8b94-bc5ba9db4950" containerName="payload-pre-processing"
Sep 10 22:24:19.128615 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.128598    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:19.131129 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.131100    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-e367c1-dockercfg-mb48l\""
Sep 10 22:24:19.131129 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.131117    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-e367c1\""
Sep 10 22:24:19.139855 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.138063    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"]
Sep 10 22:24:19.239403 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.239367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/121111cb-b35b-4860-aa57-d856cc314ea0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w\" (UID: \"121111cb-b35b-4860-aa57-d856cc314ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:19.239558 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.239502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4tnn\" (UniqueName: \"kubernetes.io/projected/121111cb-b35b-4860-aa57-d856cc314ea0-kube-api-access-w4tnn\") pod \"payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w\" (UID: \"121111cb-b35b-4860-aa57-d856cc314ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:19.340467 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.340430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4tnn\" (UniqueName: \"kubernetes.io/projected/121111cb-b35b-4860-aa57-d856cc314ea0-kube-api-access-w4tnn\") pod \"payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w\" (UID: \"121111cb-b35b-4860-aa57-d856cc314ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:19.340467 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.340469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/121111cb-b35b-4860-aa57-d856cc314ea0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w\" (UID: \"121111cb-b35b-4860-aa57-d856cc314ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:19.341159 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.341140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/121111cb-b35b-4860-aa57-d856cc314ea0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w\" (UID: \"121111cb-b35b-4860-aa57-d856cc314ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:19.347609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.347581    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4tnn\" (UniqueName: \"kubernetes.io/projected/121111cb-b35b-4860-aa57-d856cc314ea0-kube-api-access-w4tnn\") pod \"payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w\" (UID: \"121111cb-b35b-4860-aa57-d856cc314ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:19.446889 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.446809    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:19.652678 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.652642    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"
Sep 10 22:24:19.653084 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.652677    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn" event={"ID":"33b0db21-5ca9-4eb0-b391-b1b5635b9903","Type":"ContainerDied","Data":"c2539994b48b59c599f26605e9bf91f1a7324ef478443d1b143172e4338d94a2"}
Sep 10 22:24:19.653084 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.652735    2573 scope.go:117] "RemoveContainer" containerID="e4f737183bb4f541df68110dea3203cb869e28b22251157df0cfcfdddb36a634"
Sep 10 22:24:19.680549 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.680525    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"]
Sep 10 22:24:19.687222 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.687202    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c3af05-openshift-default-84657ccf76-676mn"]
Sep 10 22:24:19.721105 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:19.721085    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"]
Sep 10 22:24:19.722750 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:24:19.722727    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121111cb_b35b_4860_aa57_d856cc314ea0.slice/crio-0e8736abc7f1b23d739ddb9a1f8b0f86b100b5d6eeb92a383350536bac36dc5e WatchSource:0}: Error finding container 0e8736abc7f1b23d739ddb9a1f8b0f86b100b5d6eeb92a383350536bac36dc5e: Status 404 returned error can't find the container with id 0e8736abc7f1b23d739ddb9a1f8b0f86b100b5d6eeb92a383350536bac36dc5e
Sep 10 22:24:20.052605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:20.052575    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:20.554981 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:20.554948    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" path="/var/lib/kubelet/pods/33b0db21-5ca9-4eb0-b391-b1b5635b9903/volumes"
Sep 10 22:24:20.661437 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:20.661398    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w" event={"ID":"121111cb-b35b-4860-aa57-d856cc314ea0","Type":"ContainerStarted","Data":"0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b"}
Sep 10 22:24:20.661736 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:20.661465    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:20.661736 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:20.661500    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w" event={"ID":"121111cb-b35b-4860-aa57-d856cc314ea0","Type":"ContainerStarted","Data":"0e8736abc7f1b23d739ddb9a1f8b0f86b100b5d6eeb92a383350536bac36dc5e"}
Sep 10 22:24:20.679577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:20.679533    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w" podStartSLOduration=1.6795201789999998 podStartE2EDuration="1.679520179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:24:20.677530458 +0000 UTC m=+1140.560014823" watchObservedRunningTime="2026-09-10 22:24:20.679520179 +0000 UTC m=+1140.562004541"
Sep 10 22:24:24.368899 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:24.368857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:24.468974 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:24.468939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:25.277996 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.277961    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:25.546997 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.546908    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"]
Sep 10 22:24:25.547462 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.547444    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b0db21-5ca9-4eb0-b391-b1b5635b9903" containerName="istio-proxy"
Sep 10 22:24:25.551952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.551929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.554025 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.554004    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-4a864c-openshift-default-dockercfg-zt4c7\""
Sep 10 22:24:25.561000 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.560974    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"]
Sep 10 22:24:25.580632 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.580599    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:25.696540 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.696506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-podinfo\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.696540 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.696542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-envoy\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.696813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.696568    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5lrw\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-kube-api-access-p5lrw\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.696813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.696637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-data\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.696813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.696677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-credential-socket\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.696813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.696695    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-certs\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.696813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.696716    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f102dafb-e6c8-44e6-b494-c40d1223bfca-istiod-ca-cert\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.696813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.696782    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-socket\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.697091 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.696826    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-token\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.797974 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.797891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-podinfo\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.797974 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.797930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-envoy\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.797974 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.797965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5lrw\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-kube-api-access-p5lrw\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-data\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-credential-socket\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-certs\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f102dafb-e6c8-44e6-b494-c40d1223bfca-istiod-ca-cert\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-socket\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798243 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-token\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798624 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798590    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-certs\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-data\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798723    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-socket\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798742    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-credential-socket\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.798959 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.798799    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f102dafb-e6c8-44e6-b494-c40d1223bfca-istiod-ca-cert\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.800713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.800686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-envoy\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.801015 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.800997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-podinfo\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.806110 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.806082    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-token\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.806390 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.806370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5lrw\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-kube-api-access-p5lrw\") pod \"e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") " pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:25.864013 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:25.863990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:26.139066 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:26.139039    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"]
Sep 10 22:24:26.141253 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:24:26.141228    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf102dafb_e6c8_44e6_b494_c40d1223bfca.slice/crio-007f14f8e218afbe35e4f1fa15b35cf751c14c801aa6847e81d739f01d47698f WatchSource:0}: Error finding container 007f14f8e218afbe35e4f1fa15b35cf751c14c801aa6847e81d739f01d47698f: Status 404 returned error can't find the container with id 007f14f8e218afbe35e4f1fa15b35cf751c14c801aa6847e81d739f01d47698f
Sep 10 22:24:26.143450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:26.143420    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:26.143509 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:26.143484    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:26.143550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:26.143512    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:26.329990 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:26.329955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:26.697308 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:26.697270    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" event={"ID":"f102dafb-e6c8-44e6-b494-c40d1223bfca","Type":"ContainerStarted","Data":"cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee"}
Sep 10 22:24:26.697683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:26.697322    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" event={"ID":"f102dafb-e6c8-44e6-b494-c40d1223bfca","Type":"ContainerStarted","Data":"007f14f8e218afbe35e4f1fa15b35cf751c14c801aa6847e81d739f01d47698f"}
Sep 10 22:24:26.717573 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:26.717518    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" podStartSLOduration=1.71750173 podStartE2EDuration="1.71750173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:24:26.715224671 +0000 UTC m=+1146.597709038" watchObservedRunningTime="2026-09-10 22:24:26.71750173 +0000 UTC m=+1146.599986100"
Sep 10 22:24:26.864460 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:26.864425    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:27.869387 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:27.869358    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:28.613356 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:28.613311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:28.707991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:28.707956    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:28.708927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:28.708905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:28.714731 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:28.714707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:29.761238 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:29.761202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:29.861612 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:29.861577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:29.962962 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:29.962902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:30.233511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.233446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:30.314264 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.314234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:30.377123 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.377092    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"]
Sep 10 22:24:30.380930 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.380909    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:30.383105 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.383086    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-4a864c-dockercfg-r522v\""
Sep 10 22:24:30.383421 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.383404    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-4a864c\""
Sep 10 22:24:30.389793 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.389768    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"]
Sep 10 22:24:30.544083 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.543999    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f014ea-4c63-4b5a-b330-e5179ced0be0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v\" (UID: \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:30.544083 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.544053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w44sw\" (UniqueName: \"kubernetes.io/projected/c3f014ea-4c63-4b5a-b330-e5179ced0be0-kube-api-access-w44sw\") pod \"payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v\" (UID: \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:30.645274 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.645229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f014ea-4c63-4b5a-b330-e5179ced0be0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v\" (UID: \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:30.645479 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.645319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w44sw\" (UniqueName: \"kubernetes.io/projected/c3f014ea-4c63-4b5a-b330-e5179ced0be0-kube-api-access-w44sw\") pod \"payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v\" (UID: \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:30.645973 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.645954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f014ea-4c63-4b5a-b330-e5179ced0be0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v\" (UID: \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:30.652546 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.652526    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w44sw\" (UniqueName: \"kubernetes.io/projected/c3f014ea-4c63-4b5a-b330-e5179ced0be0-kube-api-access-w44sw\") pod \"payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v\" (UID: \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:30.693610 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.693576    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:30.965081 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:30.965053    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"]
Sep 10 22:24:30.966281 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:24:30.966255    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f014ea_4c63_4b5a_b330_e5179ced0be0.slice/crio-4c324763c1e12d1a3800e40af2499caec9bf9d6de67642dbfaeb092ed984ca2d WatchSource:0}: Error finding container 4c324763c1e12d1a3800e40af2499caec9bf9d6de67642dbfaeb092ed984ca2d: Status 404 returned error can't find the container with id 4c324763c1e12d1a3800e40af2499caec9bf9d6de67642dbfaeb092ed984ca2d
Sep 10 22:24:31.669614 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:31.669584    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:24:31.733380 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:31.733344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v" event={"ID":"c3f014ea-4c63-4b5a-b330-e5179ced0be0","Type":"ContainerStarted","Data":"6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a"}
Sep 10 22:24:31.733541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:31.733410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v" event={"ID":"c3f014ea-4c63-4b5a-b330-e5179ced0be0","Type":"ContainerStarted","Data":"4c324763c1e12d1a3800e40af2499caec9bf9d6de67642dbfaeb092ed984ca2d"}
Sep 10 22:24:31.733541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:31.733444    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:31.749431 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:31.749386    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v" podStartSLOduration=1.7493689959999998 podStartE2EDuration="1.749368996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:24:31.74819641 +0000 UTC m=+1151.630680777" watchObservedRunningTime="2026-09-10 22:24:31.749368996 +0000 UTC m=+1151.631853361"
Sep 10 22:24:37.036743 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:37.036704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:40.616491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:40.616455    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:42.359595 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:42.359561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:42.700084 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:42.699988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:42.741929 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:42.741898    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:24:42.982027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:42.981997    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"]
Sep 10 22:24:42.985675 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:42.985653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:42.988329 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:42.988310    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-0ada08-openshift-default-dockercfg-vr4vt\""
Sep 10 22:24:43.000364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.000333    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"]
Sep 10 22:24:43.010403 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.010373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:43.065032 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.064961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-credential-socket\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.065032 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.065008    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-istio-token\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.065215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.065037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-data\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.065215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.065061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4877045f-5025-4810-888f-c4833c227701-istiod-ca-cert\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.065215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.065086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-socket\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.065215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.065161    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-envoy\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.065215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.065192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4877045f-5025-4810-888f-c4833c227701-istio-podinfo\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.065377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.065219    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99vtm\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-kube-api-access-99vtm\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.065377 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.065251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-certs\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.166406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-envoy\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.166406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4877045f-5025-4810-888f-c4833c227701-istio-podinfo\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.166406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99vtm\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-kube-api-access-99vtm\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.166700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-certs\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.166700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166501    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-credential-socket\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.166700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166554    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-istio-token\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.166700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-data\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.166700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4877045f-5025-4810-888f-c4833c227701-istiod-ca-cert\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.166700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-socket\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.167067 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166912    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-certs\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.167067 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-data\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.167067 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.166997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-credential-socket\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.167267 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.167251    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-socket\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.167447 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.167427    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4877045f-5025-4810-888f-c4833c227701-istiod-ca-cert\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.168788 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.168765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-envoy\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.168963 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.168945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4877045f-5025-4810-888f-c4833c227701-istio-podinfo\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.174011 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.173994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99vtm\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-kube-api-access-99vtm\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.174085 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.174021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-istio-token\") pod \"e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") " pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.327696 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.327671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:43.385493 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.385239    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:43.610667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.610643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"]
Sep 10 22:24:43.611388 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:24:43.611363    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4877045f_5025_4810_888f_c4833c227701.slice/crio-a3d8678328854efd8b0af4d7994fa7275e13cdad3e6b5364b7e322e2420654c1 WatchSource:0}: Error finding container a3d8678328854efd8b0af4d7994fa7275e13cdad3e6b5364b7e322e2420654c1: Status 404 returned error can't find the container with id a3d8678328854efd8b0af4d7994fa7275e13cdad3e6b5364b7e322e2420654c1
Sep 10 22:24:43.613527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.613501    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:43.613580 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.613558    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:43.613616 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.613587    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:43.709122 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.709085    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:24:43.709294 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.709138    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 22:24:43.816365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.816316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" event={"ID":"4877045f-5025-4810-888f-c4833c227701","Type":"ContainerStarted","Data":"763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425"}
Sep 10 22:24:43.816571 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.816409    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" event={"ID":"4877045f-5025-4810-888f-c4833c227701","Type":"ContainerStarted","Data":"a3d8678328854efd8b0af4d7994fa7275e13cdad3e6b5364b7e322e2420654c1"}
Sep 10 22:24:43.818073 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.818047    2573 generic.go:356] "Generic (PLEG): container finished" podID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerID="cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee" exitCode=0
Sep 10 22:24:43.818178 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.818132    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" event={"ID":"f102dafb-e6c8-44e6-b494-c40d1223bfca","Type":"ContainerDied","Data":"cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee"}
Sep 10 22:24:43.818574 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.818556    2573 scope.go:117] "RemoveContainer" containerID="cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee"
Sep 10 22:24:43.819609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.819580    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:43.819698 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.819673    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:43.819749 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.819714    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:43.836259 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:43.836219    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" podStartSLOduration=1.836206472 podStartE2EDuration="1.836206472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:24:43.833175308 +0000 UTC m=+1163.715659674" watchObservedRunningTime="2026-09-10 22:24:43.836206472 +0000 UTC m=+1163.718690837"
Sep 10 22:24:44.328097 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:44.328056    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:44.333192 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:44.333168    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:44.826767 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:44.826733    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" event={"ID":"f102dafb-e6c8-44e6-b494-c40d1223bfca","Type":"ContainerStarted","Data":"818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3"}
Sep 10 22:24:44.827181 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:44.827063    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:44.828033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:44.828011    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:24:44.864220 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:44.864181    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:44.864417 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:44.864394    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:24:44.864500 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:44.864444    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 22:24:45.762956 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:45.762903    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:45.850883 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:45.850830    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:45.864936 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:45.864899    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:24:45.865078 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:45.864968    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 22:24:46.865171 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:46.865137    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:24:46.865548 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:46.865193    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 22:24:46.927991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:46.927958    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:47.040303 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:47.040260    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:47.506185 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:47.506149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:47.611317 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:47.611281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:47.864937 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:47.864829    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:24:47.864937 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:47.864915    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 22:24:48.864665 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:48.864631    2573 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 10 22:24:48.865036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:48.864706    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 10 22:24:49.868772 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:49.868745    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:49.869181 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:49.869162    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:49.869868 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:49.869833    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:24:50.601422 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:50.601376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:53.633019 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:53.632980    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:53.950188 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:53.950092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:54.220199 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.216502    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"]
Sep 10 22:24:54.229245 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.229172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.232009 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.231776    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-32343f-openshift-default-dockercfg-hhdgg\""
Sep 10 22:24:54.236291 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.236266    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"]
Sep 10 22:24:54.240271 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.240245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:54.285247 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.285218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-envoy\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.285365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.285260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4609b-9840-4d69-81eb-9645e64da5b1-istiod-ca-cert\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.285365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.285282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-data\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.285365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.285341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-credential-socket\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.285365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.285361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-certs\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.285503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.285387    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-token\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.285503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.285425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-socket\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.285503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.285444    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfxnc\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-kube-api-access-qfxnc\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.285503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.285470    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-podinfo\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-podinfo\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-envoy\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4609b-9840-4d69-81eb-9645e64da5b1-istiod-ca-cert\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-data\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-credential-socket\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386214    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-certs\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-token\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386290    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-socket\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfxnc\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-kube-api-access-qfxnc\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386599 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-credential-socket\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386949 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386895    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-certs\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.386949 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386904    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-data\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.387145 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.386953    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-socket\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.387145 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.387025    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4609b-9840-4d69-81eb-9645e64da5b1-istiod-ca-cert\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.388500 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.388474    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-envoy\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.388715 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.388699    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-podinfo\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.393403 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.393379    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-token\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.393580 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.393556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfxnc\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-kube-api-access-qfxnc\") pod \"e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") " pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.468388 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.468354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:54.543664 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.543625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:54.839743 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.839708    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"]
Sep 10 22:24:54.841434 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:24:54.841395    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa4609b_9840_4d69_81eb_9645e64da5b1.slice/crio-3c4f30a93ac9e6e9206550db5ccc42a4b083b1fc0027dbc92a8f676743803fbd WatchSource:0}: Error finding container 3c4f30a93ac9e6e9206550db5ccc42a4b083b1fc0027dbc92a8f676743803fbd: Status 404 returned error can't find the container with id 3c4f30a93ac9e6e9206550db5ccc42a4b083b1fc0027dbc92a8f676743803fbd
Sep 10 22:24:54.844032 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.844002    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:54.844122 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.844064    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:54.844122 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.844095    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:24:54.883641 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:54.883618    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" event={"ID":"dfa4609b-9840-4d69-81eb-9645e64da5b1","Type":"ContainerStarted","Data":"3c4f30a93ac9e6e9206550db5ccc42a4b083b1fc0027dbc92a8f676743803fbd"}
Sep 10 22:24:55.890975 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:55.890937    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" event={"ID":"dfa4609b-9840-4d69-81eb-9645e64da5b1","Type":"ContainerStarted","Data":"6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a"}
Sep 10 22:24:55.912139 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:55.912070    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" podStartSLOduration=1.9120477299999998 podStartE2EDuration="1.91204773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:24:55.910326121 +0000 UTC m=+1175.792810488" watchObservedRunningTime="2026-09-10 22:24:55.91204773 +0000 UTC m=+1175.794532097"
Sep 10 22:24:56.544133 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:56.544097    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:56.552899 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:56.552876    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:56.899162 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:56.899047    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:56.900857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:56.900813    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:24:57.786966 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:57.786928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:57.885203 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:57.885170    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:58.933542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:58.933507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:58.993786 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:58.993743    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:59.330573 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:59.330543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:59.429108 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:59.429076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:59.518447 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:24:59.518415    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:00.868988 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:00.868956    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 22:25:00.869358 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:00.869024    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:25:01.936603 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:01.936563    2573 generic.go:356] "Generic (PLEG): container finished" podID="4877045f-5025-4810-888f-c4833c227701" containerID="763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425" exitCode=0
Sep 10 22:25:01.937047 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:01.936635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" event={"ID":"4877045f-5025-4810-888f-c4833c227701","Type":"ContainerDied","Data":"763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425"}
Sep 10 22:25:01.937047 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:01.937018    2573 scope.go:117] "RemoveContainer" containerID="763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425"
Sep 10 22:25:01.938080 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:01.938048    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:01.938177 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:01.938114    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:01.938177 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:01.938148    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:02.944455 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:02.944414    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" event={"ID":"4877045f-5025-4810-888f-c4833c227701","Type":"ContainerStarted","Data":"1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4"}
Sep 10 22:25:03.328624 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:03.328585    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:25:03.328833 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:03.328758    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:25:03.328833 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:03.328814    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 10 22:25:04.329132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:04.329100    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:25:04.329502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:04.329152    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 10 22:25:05.328438 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:05.328398    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:25:05.328728 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:05.328698    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 10 22:25:06.328940 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:06.328903    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:25:06.329509 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:06.329478    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 10 22:25:07.328201 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:07.328163    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 10 22:25:07.328541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:07.328514    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 10 22:25:07.895942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:07.895906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:08.332476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:08.332446    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:25:08.332908 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:08.332884    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:25:08.333496 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:08.333475    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:25:10.778817 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:10.778781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:12.941013 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:12.940973    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 22:25:12.941408 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:12.941039    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:25:14.013165 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:14.013133    2573 generic.go:356] "Generic (PLEG): container finished" podID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerID="6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a" exitCode=0
Sep 10 22:25:14.013580 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:14.013204    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" event={"ID":"dfa4609b-9840-4d69-81eb-9645e64da5b1","Type":"ContainerDied","Data":"6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a"}
Sep 10 22:25:14.013624 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:14.013615    2573 scope.go:117] "RemoveContainer" containerID="6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a"
Sep 10 22:25:14.014640 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:14.014616    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:14.014699 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:14.014677    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:14.014734 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:14.014709    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:15.024123 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:15.024087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" event={"ID":"dfa4609b-9840-4d69-81eb-9645e64da5b1","Type":"ContainerStarted","Data":"6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97"}
Sep 10 22:25:15.544255 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:15.544220    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:25:15.544455 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:15.544430    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 22:25:15.544507 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:15.544487    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 22:25:16.544752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:16.544718    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 22:25:16.545143 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:16.544770    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 22:25:17.127698 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:17.127658    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:17.544835 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:17.544798    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 22:25:17.545252 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:17.544882    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 22:25:18.544445 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:18.544385    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 22:25:18.544624 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:18.544456    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 22:25:19.544205 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:19.544164    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 22:25:19.544673 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:19.544229    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 22:25:19.983626 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:19.983596    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:20.577141 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:20.577109    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:25:20.577988 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:20.577964    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:25:20.645261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:20.645230    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:25:20.645621 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:20.645599    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:25:20.646340 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:20.646316    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:25:22.786217 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:22.786184    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:32.004585 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.004549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:32.280316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.280236    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"]
Sep 10 22:25:32.285137 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.285117    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.287507 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.287487    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-853c9ae4-openshift-default-dockercfg-vt2vl\""
Sep 10 22:25:32.297381 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.297358    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"]
Sep 10 22:25:32.317230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.317201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:32.369203 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.369174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a208a961-38f8-481d-936c-f97bce850403-istio-podinfo\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.369448 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.369427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-credential-socket\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.369668 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.369646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzs94\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-kube-api-access-gzs94\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.369898 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.369870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a208a961-38f8-481d-936c-f97bce850403-istiod-ca-cert\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.370083 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.370069    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-certs\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.370226 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.370210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-istio-token\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.370372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.370358    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-envoy\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.370499 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.370486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-socket\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.370645 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.370632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-data\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472058 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472030    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-envoy\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-socket\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-data\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472117    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a208a961-38f8-481d-936c-f97bce850403-istio-podinfo\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-credential-socket\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzs94\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-kube-api-access-gzs94\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472265 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a208a961-38f8-481d-936c-f97bce850403-istiod-ca-cert\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472619 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472306    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-certs\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472619 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-istio-token\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472619 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472590    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-credential-socket\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472773 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472588    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-socket\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.472961 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-data\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.473038 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.472986    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-certs\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.473224 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.473206    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a208a961-38f8-481d-936c-f97bce850403-istiod-ca-cert\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.474602 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.474580    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-envoy\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.474818 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.474800    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a208a961-38f8-481d-936c-f97bce850403-istio-podinfo\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.479924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.479900    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-istio-token\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.479924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.479914    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzs94\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-kube-api-access-gzs94\") pod \"e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") " pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.596314 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.596244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:32.681703 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.681675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:32.872099 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.872071    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"]
Sep 10 22:25:32.874893 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:25:32.874859    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda208a961_38f8_481d_936c_f97bce850403.slice/crio-fe27176291a695f90c59ee126878d6bd4e135b0abceb44ea52758653409f7979 WatchSource:0}: Error finding container fe27176291a695f90c59ee126878d6bd4e135b0abceb44ea52758653409f7979: Status 404 returned error can't find the container with id fe27176291a695f90c59ee126878d6bd4e135b0abceb44ea52758653409f7979
Sep 10 22:25:32.877114 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.877081    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:32.877195 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.877151    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:32.877195 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:32.877187    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:33.130281 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:33.130193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" event={"ID":"a208a961-38f8-481d-936c-f97bce850403","Type":"ContainerStarted","Data":"5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1"}
Sep 10 22:25:33.130281 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:33.130248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" event={"ID":"a208a961-38f8-481d-936c-f97bce850403","Type":"ContainerStarted","Data":"fe27176291a695f90c59ee126878d6bd4e135b0abceb44ea52758653409f7979"}
Sep 10 22:25:33.150108 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:33.150061    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podStartSLOduration=1.150044477 podStartE2EDuration="1.150044477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:25:33.148704434 +0000 UTC m=+1213.031188801" watchObservedRunningTime="2026-09-10 22:25:33.150044477 +0000 UTC m=+1213.032528845"
Sep 10 22:25:33.596692 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:33.596656    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:33.601542 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:33.601518    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:34.135617 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:34.135590    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:34.136615 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:34.136589    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:35.037144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:35.037108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:35.135075 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:35.135047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:36.180337 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.180310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:36.280088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.280054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:36.431782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.431702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:36.760379 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.760350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:36.923406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.923374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:36.982710 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.982679    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"]
Sep 10 22:25:36.986485 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.986462    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:36.988569 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.988544    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-853c9ae4\""
Sep 10 22:25:36.988569 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.988560    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-853c9ae4-dockercfg-kcgv5\""
Sep 10 22:25:36.997338 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:36.997314    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"]
Sep 10 22:25:37.124865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:37.124775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8snc2\" (UniqueName: \"kubernetes.io/projected/f8c11969-5395-4df9-aa1d-7f40ea5e406b-kube-api-access-8snc2\") pod \"payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5\" (UID: \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:37.125040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:37.124960    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c11969-5395-4df9-aa1d-7f40ea5e406b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5\" (UID: \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:37.226094 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:37.226047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c11969-5395-4df9-aa1d-7f40ea5e406b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5\" (UID: \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:37.226491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:37.226109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8snc2\" (UniqueName: \"kubernetes.io/projected/f8c11969-5395-4df9-aa1d-7f40ea5e406b-kube-api-access-8snc2\") pod \"payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5\" (UID: \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:37.226723 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:37.226702    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c11969-5395-4df9-aa1d-7f40ea5e406b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5\" (UID: \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:37.233512 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:37.233481    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8snc2\" (UniqueName: \"kubernetes.io/projected/f8c11969-5395-4df9-aa1d-7f40ea5e406b-kube-api-access-8snc2\") pod \"payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5\" (UID: \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:37.297782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:37.297753    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:37.570432 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:37.570409    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"]
Sep 10 22:25:37.571595 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:25:37.571563    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c11969_5395_4df9_aa1d_7f40ea5e406b.slice/crio-88c18392b3961a0a05ba7fc3fa2671cb5690e551a515d83b7236b3be49444e2a WatchSource:0}: Error finding container 88c18392b3961a0a05ba7fc3fa2671cb5690e551a515d83b7236b3be49444e2a: Status 404 returned error can't find the container with id 88c18392b3961a0a05ba7fc3fa2671cb5690e551a515d83b7236b3be49444e2a
Sep 10 22:25:38.160282 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:38.160244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5" event={"ID":"f8c11969-5395-4df9-aa1d-7f40ea5e406b","Type":"ContainerStarted","Data":"8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501"}
Sep 10 22:25:38.160503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:38.160296    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5" event={"ID":"f8c11969-5395-4df9-aa1d-7f40ea5e406b","Type":"ContainerStarted","Data":"88c18392b3961a0a05ba7fc3fa2671cb5690e551a515d83b7236b3be49444e2a"}
Sep 10 22:25:38.160503 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:38.160427    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:38.175729 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:38.175676    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5" podStartSLOduration=2.175662801 podStartE2EDuration="2.175662801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:25:38.1739268 +0000 UTC m=+1218.056411168" watchObservedRunningTime="2026-09-10 22:25:38.175662801 +0000 UTC m=+1218.058147168"
Sep 10 22:25:47.117207 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:47.117150    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:49.168686 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:49.168598    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:25:50.177029 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:50.176987    2573 patch_prober.go:28] interesting pod/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 22:25:50.177459 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:50.177099    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:25:52.257893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:52.257859    2573 generic.go:356] "Generic (PLEG): container finished" podID="a208a961-38f8-481d-936c-f97bce850403" containerID="5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1" exitCode=0
Sep 10 22:25:52.258350 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:52.257938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" event={"ID":"a208a961-38f8-481d-936c-f97bce850403","Type":"ContainerDied","Data":"5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1"}
Sep 10 22:25:52.258437 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:52.258357    2573 scope.go:117] "RemoveContainer" containerID="5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1"
Sep 10 22:25:52.259451 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:52.259423    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:52.259546 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:52.259490    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:52.259546 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:52.259519    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:25:53.266325 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:53.266293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" event={"ID":"a208a961-38f8-481d-936c-f97bce850403","Type":"ContainerStarted","Data":"39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc"}
Sep 10 22:25:53.596741 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:53.596646    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:53.596960 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:53.596936    2573 patch_prober.go:28] interesting pod/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:25:53.597027 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:53.597009    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 22:25:54.596961 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:54.596917    2573 patch_prober.go:28] interesting pod/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:25:54.597453 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:54.597004    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 22:25:55.597109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:55.597066    2573 patch_prober.go:28] interesting pod/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:25:55.597730 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:55.597700    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 22:25:56.596725 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:56.596683    2573 patch_prober.go:28] interesting pod/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:25:56.596949 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:56.596775    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 22:25:57.597667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:57.597626    2573 patch_prober.go:28] interesting pod/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:25:57.598170 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:57.597695    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 22:25:58.597084 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:58.597043    2573 patch_prober.go:28] interesting pod/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 10 22:25:58.597307 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:58.597147    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 10 22:25:59.622900 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:59.622859    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:59.623421 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:59.623394    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:25:59.624170 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:25:59.624151    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:26:00.011037 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:00.011006    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:04.722372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:04.722333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:08.864660 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:08.864621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:28.999920 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:28.999820    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"]
Sep 10 22:26:29.003554 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:29.003530    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"
Sep 10 22:26:29.005715 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:29.005694    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:26:29.010429 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:29.010406    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"]
Sep 10 22:26:29.132922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:29.132888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:29.154997 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:29.154965    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7402795-9ebe-4d5a-b60a-c06da3a37fdc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9\" (UID: \"a7402795-9ebe-4d5a-b60a-c06da3a37fdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"
Sep 10 22:26:29.255680 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:29.255604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7402795-9ebe-4d5a-b60a-c06da3a37fdc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9\" (UID: \"a7402795-9ebe-4d5a-b60a-c06da3a37fdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"
Sep 10 22:26:29.256261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:29.256240    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7402795-9ebe-4d5a-b60a-c06da3a37fdc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9\" (UID: \"a7402795-9ebe-4d5a-b60a-c06da3a37fdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"
Sep 10 22:26:29.317230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:29.317192    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"
Sep 10 22:26:29.587305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:29.587277    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"]
Sep 10 22:26:29.588908 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:26:29.588885    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7402795_9ebe_4d5a_b60a_c06da3a37fdc.slice/crio-81e4c6b25f956122ea593348d1e4b6ce67a49c63d76df1ec0c11b1c1ccff4afc WatchSource:0}: Error finding container 81e4c6b25f956122ea593348d1e4b6ce67a49c63d76df1ec0c11b1c1ccff4afc: Status 404 returned error can't find the container with id 81e4c6b25f956122ea593348d1e4b6ce67a49c63d76df1ec0c11b1c1ccff4afc
Sep 10 22:26:30.498894 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:30.498858    2573 generic.go:356] "Generic (PLEG): container finished" podID="a7402795-9ebe-4d5a-b60a-c06da3a37fdc" containerID="3bad528d8bc4ce7439231a08b0a275df5503aefc9e43aa8c367c1ded5ffc5d32" exitCode=0
Sep 10 22:26:30.499311 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:30.498944    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9" event={"ID":"a7402795-9ebe-4d5a-b60a-c06da3a37fdc","Type":"ContainerDied","Data":"3bad528d8bc4ce7439231a08b0a275df5503aefc9e43aa8c367c1ded5ffc5d32"}
Sep 10 22:26:30.499311 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:30.499046    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9" event={"ID":"a7402795-9ebe-4d5a-b60a-c06da3a37fdc","Type":"ContainerStarted","Data":"81e4c6b25f956122ea593348d1e4b6ce67a49c63d76df1ec0c11b1c1ccff4afc"}
Sep 10 22:26:31.644108 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:31.644086    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"
Sep 10 22:26:31.675295 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:31.675269    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7402795-9ebe-4d5a-b60a-c06da3a37fdc-maas-api-service-ca\") pod \"a7402795-9ebe-4d5a-b60a-c06da3a37fdc\" (UID: \"a7402795-9ebe-4d5a-b60a-c06da3a37fdc\") "
Sep 10 22:26:31.675596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:31.675574    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7402795-9ebe-4d5a-b60a-c06da3a37fdc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a7402795-9ebe-4d5a-b60a-c06da3a37fdc" (UID: "a7402795-9ebe-4d5a-b60a-c06da3a37fdc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:26:31.776576 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:31.776509    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7402795-9ebe-4d5a-b60a-c06da3a37fdc-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:26:32.512834 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:32.512804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9" event={"ID":"a7402795-9ebe-4d5a-b60a-c06da3a37fdc","Type":"ContainerDied","Data":"81e4c6b25f956122ea593348d1e4b6ce67a49c63d76df1ec0c11b1c1ccff4afc"}
Sep 10 22:26:32.513024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:32.512860    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"
Sep 10 22:26:32.513024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:32.512864    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81e4c6b25f956122ea593348d1e4b6ce67a49c63d76df1ec0c11b1c1ccff4afc"
Sep 10 22:26:44.469611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.469559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:44.497867 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.497820    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"]
Sep 10 22:26:44.498093 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.498068    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5" podUID="f8c11969-5395-4df9-aa1d-7f40ea5e406b" containerName="payload-pre-processing" containerID="cri-o://8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501" gracePeriod=30
Sep 10 22:26:44.570040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.570013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:44.648785 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.648740    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"]
Sep 10 22:26:44.650559 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.650461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:44.651670 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.651646    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-853c9ae4-fkff9"]
Sep 10 22:26:44.701445 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.701412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:44.748608 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.748587    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:26:44.790382 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.790355    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c11969-5395-4df9-aa1d-7f40ea5e406b-plugins-config-volume\") pod \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\" (UID: \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\") "
Sep 10 22:26:44.790523 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.790436    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8snc2\" (UniqueName: \"kubernetes.io/projected/f8c11969-5395-4df9-aa1d-7f40ea5e406b-kube-api-access-8snc2\") pod \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\" (UID: \"f8c11969-5395-4df9-aa1d-7f40ea5e406b\") "
Sep 10 22:26:44.790711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.790685    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c11969-5395-4df9-aa1d-7f40ea5e406b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8c11969-5395-4df9-aa1d-7f40ea5e406b" (UID: "f8c11969-5395-4df9-aa1d-7f40ea5e406b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:26:44.792566 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.792543    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c11969-5395-4df9-aa1d-7f40ea5e406b-kube-api-access-8snc2" (OuterVolumeSpecName: "kube-api-access-8snc2") pod "f8c11969-5395-4df9-aa1d-7f40ea5e406b" (UID: "f8c11969-5395-4df9-aa1d-7f40ea5e406b"). InnerVolumeSpecName "kube-api-access-8snc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:44.891682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.891651    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c11969-5395-4df9-aa1d-7f40ea5e406b-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:26:44.891682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:44.891678    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8snc2\" (UniqueName: \"kubernetes.io/projected/f8c11969-5395-4df9-aa1d-7f40ea5e406b-kube-api-access-8snc2\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:26:45.591167 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:45.591130    2573 generic.go:356] "Generic (PLEG): container finished" podID="f8c11969-5395-4df9-aa1d-7f40ea5e406b" containerID="8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501" exitCode=0
Sep 10 22:26:45.591580 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:45.591171    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"
Sep 10 22:26:45.591580 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:45.591188    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5" event={"ID":"f8c11969-5395-4df9-aa1d-7f40ea5e406b","Type":"ContainerDied","Data":"8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501"}
Sep 10 22:26:45.591580 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:45.591228    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5" event={"ID":"f8c11969-5395-4df9-aa1d-7f40ea5e406b","Type":"ContainerDied","Data":"88c18392b3961a0a05ba7fc3fa2671cb5690e551a515d83b7236b3be49444e2a"}
Sep 10 22:26:45.591580 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:45.591250    2573 scope.go:117] "RemoveContainer" containerID="8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501"
Sep 10 22:26:45.601183 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:45.601165    2573 scope.go:117] "RemoveContainer" containerID="8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501"
Sep 10 22:26:45.601468 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:26:45.601447    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501\": container with ID starting with 8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501 not found: ID does not exist" containerID="8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501"
Sep 10 22:26:45.601514 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:45.601477    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501"} err="failed to get container status \"8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501\": rpc error: code = NotFound desc = could not find container \"8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501\": container with ID starting with 8123b12b4e23c3331a553395cb2db9021f90a14a7d7956697862e3eb8d249501 not found: ID does not exist"
Sep 10 22:26:45.612558 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:45.612535    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"]
Sep 10 22:26:45.616389 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:45.616371    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-853c9ae4-6899f85d98-5bjs5"]
Sep 10 22:26:46.553483 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:46.553453    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7402795-9ebe-4d5a-b60a-c06da3a37fdc" path="/var/lib/kubelet/pods/a7402795-9ebe-4d5a-b60a-c06da3a37fdc/volumes"
Sep 10 22:26:46.554021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:46.554000    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c11969-5395-4df9-aa1d-7f40ea5e406b" path="/var/lib/kubelet/pods/f8c11969-5395-4df9-aa1d-7f40ea5e406b/volumes"
Sep 10 22:26:47.797504 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:47.797473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:52.867005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:26:52.866969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:20.696385 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:20.696355    2573 scope.go:117] "RemoveContainer" containerID="1b20e4f2b48ac9ef47f638ab4d41abaca7d39c147f3a3465512dc5d307393e0d"
Sep 10 22:27:20.705181 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:20.705161    2573 scope.go:117] "RemoveContainer" containerID="5bb3fcc32e6811af76a2752c8004dfe5235e0e865eb099d6a780a55e0223cada"
Sep 10 22:27:29.676526 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:29.676495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:29.837128 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:29.837098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:35.434865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:35.434812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:41.174713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:41.174679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:41.274873 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:41.274826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:41.404166 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:41.404126    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"]
Sep 10 22:27:41.404396 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:41.404364    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy" containerID="cri-o://39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc" gracePeriod=30
Sep 10 22:27:41.435219 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:41.435137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:42.554961 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:42.554925    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:42.660253 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:42.660219    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:42.755244 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:42.755213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:42.855895 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:42.855807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:43.480775 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:43.480748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:43.581672 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:43.581639    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:43.681089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:43.681057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:44.625907 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:44.625868    2573 patch_prober.go:28] interesting pod/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:27:44.626275 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:44.625958    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:27:44.938732 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:44.938652    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:46.662960 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.662908    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:27:46.765753 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.765720    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzs94\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-kube-api-access-gzs94\") pod \"a208a961-38f8-481d-936c-f97bce850403\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") "
Sep 10 22:27:46.765969 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.765767    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a208a961-38f8-481d-936c-f97bce850403-istiod-ca-cert\") pod \"a208a961-38f8-481d-936c-f97bce850403\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") "
Sep 10 22:27:46.765969 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.765788    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-socket\") pod \"a208a961-38f8-481d-936c-f97bce850403\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") "
Sep 10 22:27:46.765969 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.765912    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-envoy\") pod \"a208a961-38f8-481d-936c-f97bce850403\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") "
Sep 10 22:27:46.766144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.765995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-certs\") pod \"a208a961-38f8-481d-936c-f97bce850403\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") "
Sep 10 22:27:46.766144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766024    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a208a961-38f8-481d-936c-f97bce850403-istio-podinfo\") pod \"a208a961-38f8-481d-936c-f97bce850403\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") "
Sep 10 22:27:46.766144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766047    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-data\") pod \"a208a961-38f8-481d-936c-f97bce850403\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") "
Sep 10 22:27:46.766144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766087    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-istio-token\") pod \"a208a961-38f8-481d-936c-f97bce850403\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") "
Sep 10 22:27:46.766144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766106    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a208a961-38f8-481d-936c-f97bce850403" (UID: "a208a961-38f8-481d-936c-f97bce850403"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:46.766144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766122    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-credential-socket\") pod \"a208a961-38f8-481d-936c-f97bce850403\" (UID: \"a208a961-38f8-481d-936c-f97bce850403\") "
Sep 10 22:27:46.766460 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766232    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a208a961-38f8-481d-936c-f97bce850403-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a208a961-38f8-481d-936c-f97bce850403" (UID: "a208a961-38f8-481d-936c-f97bce850403"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:27:46.766460 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766329    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a208a961-38f8-481d-936c-f97bce850403" (UID: "a208a961-38f8-481d-936c-f97bce850403"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:46.766460 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766342    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-data" (OuterVolumeSpecName: "istio-data") pod "a208a961-38f8-481d-936c-f97bce850403" (UID: "a208a961-38f8-481d-936c-f97bce850403"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:46.766460 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766423    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a208a961-38f8-481d-936c-f97bce850403" (UID: "a208a961-38f8-481d-936c-f97bce850403"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:46.766682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766546    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:27:46.766682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766560    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:27:46.766682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766568    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:27:46.766682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766576    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a208a961-38f8-481d-936c-f97bce850403-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:27:46.766682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.766584    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:27:46.768270 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.768243    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a208a961-38f8-481d-936c-f97bce850403" (UID: "a208a961-38f8-481d-936c-f97bce850403"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:27:46.768270 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.768251    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-kube-api-access-gzs94" (OuterVolumeSpecName: "kube-api-access-gzs94") pod "a208a961-38f8-481d-936c-f97bce850403" (UID: "a208a961-38f8-481d-936c-f97bce850403"). InnerVolumeSpecName "kube-api-access-gzs94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:27:46.768434 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.768281    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-istio-token" (OuterVolumeSpecName: "istio-token") pod "a208a961-38f8-481d-936c-f97bce850403" (UID: "a208a961-38f8-481d-936c-f97bce850403"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:27:46.768434 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.768329    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a208a961-38f8-481d-936c-f97bce850403-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a208a961-38f8-481d-936c-f97bce850403" (UID: "a208a961-38f8-481d-936c-f97bce850403"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:27:46.867533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.867498    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzs94\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-kube-api-access-gzs94\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:27:46.867533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.867528    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a208a961-38f8-481d-936c-f97bce850403-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:27:46.867533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.867539    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a208a961-38f8-481d-936c-f97bce850403-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:27:46.867758 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.867547    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a208a961-38f8-481d-936c-f97bce850403-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:27:46.960209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.960121    2573 generic.go:356] "Generic (PLEG): container finished" podID="a208a961-38f8-481d-936c-f97bce850403" containerID="39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc" exitCode=0
Sep 10 22:27:46.960209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.960179    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"
Sep 10 22:27:46.960386 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.960212    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" event={"ID":"a208a961-38f8-481d-936c-f97bce850403","Type":"ContainerDied","Data":"39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc"}
Sep 10 22:27:46.960386 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.960268    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6" event={"ID":"a208a961-38f8-481d-936c-f97bce850403","Type":"ContainerDied","Data":"fe27176291a695f90c59ee126878d6bd4e135b0abceb44ea52758653409f7979"}
Sep 10 22:27:46.960386 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.960292    2573 scope.go:117] "RemoveContainer" containerID="39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc"
Sep 10 22:27:46.973121 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.972712    2573 scope.go:117] "RemoveContainer" containerID="5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1"
Sep 10 22:27:46.983491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.983470    2573 scope.go:117] "RemoveContainer" containerID="39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc"
Sep 10 22:27:46.983783 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:27:46.983755    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc\": container with ID starting with 39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc not found: ID does not exist" containerID="39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc"
Sep 10 22:27:46.983833 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.983796    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc"} err="failed to get container status \"39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc\": rpc error: code = NotFound desc = could not find container \"39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc\": container with ID starting with 39dec26ab75541f39aad34d6f4978762eeacd2bb0d6ce8b11100c8bb3eaaa6dc not found: ID does not exist"
Sep 10 22:27:46.983833 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.983814    2573 scope.go:117] "RemoveContainer" containerID="5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1"
Sep 10 22:27:46.984110 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:27:46.984087    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1\": container with ID starting with 5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1 not found: ID does not exist" containerID="5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1"
Sep 10 22:27:46.984209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.984112    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1"} err="failed to get container status \"5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1\": rpc error: code = NotFound desc = could not find container \"5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1\": container with ID starting with 5f80a1bdbd74613b131ab77d5749b8d0b7942318a5ca4eb4259ab92e99b74be1 not found: ID does not exist"
Sep 10 22:27:46.987769 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.987748    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"]
Sep 10 22:27:46.991721 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:46.991698    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-853c9ae4-openshift-default-7bf5d7594d-h4ps6"]
Sep 10 22:27:48.554410 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:48.554373    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a208a961-38f8-481d-936c-f97bce850403" path="/var/lib/kubelet/pods/a208a961-38f8-481d-936c-f97bce850403/volumes"
Sep 10 22:27:50.771557 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:50.771522    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:50.850273 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:50.850238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:51.432314 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:51.432282    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:52.766214 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:52.766180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:55.623409 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:55.623374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:56.713890 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:56.713859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:57.243719 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:57.243684    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:57.349888 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:57.349825    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:57.446030 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:27:57.445995    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:05.004517 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.004487    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"]
Sep 10 22:28:05.005053 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005033    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c11969-5395-4df9-aa1d-7f40ea5e406b" containerName="payload-pre-processing"
Sep 10 22:28:05.005134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005056    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c11969-5395-4df9-aa1d-7f40ea5e406b" containerName="payload-pre-processing"
Sep 10 22:28:05.005134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005071    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7402795-9ebe-4d5a-b60a-c06da3a37fdc" containerName="revoke-keys"
Sep 10 22:28:05.005134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005079    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7402795-9ebe-4d5a-b60a-c06da3a37fdc" containerName="revoke-keys"
Sep 10 22:28:05.005134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005092    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy"
Sep 10 22:28:05.005134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005101    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy"
Sep 10 22:28:05.005134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005120    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy"
Sep 10 22:28:05.005134 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005128    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy"
Sep 10 22:28:05.005451 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005224    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy"
Sep 10 22:28:05.005451 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005234    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a208a961-38f8-481d-936c-f97bce850403" containerName="istio-proxy"
Sep 10 22:28:05.005451 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005245    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c11969-5395-4df9-aa1d-7f40ea5e406b" containerName="payload-pre-processing"
Sep 10 22:28:05.005451 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.005252    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7402795-9ebe-4d5a-b60a-c06da3a37fdc" containerName="revoke-keys"
Sep 10 22:28:05.008505 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.008487    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.010794 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.010772    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-e367c1\"/\"openshift-service-ca.crt\""
Sep 10 22:28:05.011502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.011475    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-e367c1\"/\"kube-root-ca.crt\""
Sep 10 22:28:05.011597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.011513    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-e367c1\"/\"default-dockercfg-rxtzj\""
Sep 10 22:28:05.011798 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.011784    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-e367c1\"/\"sub-test-model-e367c1-kserve-self-signed-certs\""
Sep 10 22:28:05.018751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.018727    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"]
Sep 10 22:28:05.028797 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.028771    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:05.035611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.035586    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-model-cache\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.035720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.035629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tmp-dir\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.035720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.035647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tls-certs\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.035720 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.035663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-home\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.035829 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.035741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6rd9\" (UniqueName: \"kubernetes.io/projected/fe2b5a19-ebd5-441a-8a69-f99c9487696c-kube-api-access-q6rd9\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.035829 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.035783    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-dshm\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.136596 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.136558    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-model-cache\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.136782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.136611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tmp-dir\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.136782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.136646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tls-certs\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.136782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.136669    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-home\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.136782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.136695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6rd9\" (UniqueName: \"kubernetes.io/projected/fe2b5a19-ebd5-441a-8a69-f99c9487696c-kube-api-access-q6rd9\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.136782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.136716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-dshm\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.137161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.137055    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-model-cache\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.137161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.137104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-home\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.137161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.137113    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tmp-dir\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.139097 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.139075    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-dshm\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.139291 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.139271    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tls-certs\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.144403 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.144381    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6rd9\" (UniqueName: \"kubernetes.io/projected/fe2b5a19-ebd5-441a-8a69-f99c9487696c-kube-api-access-q6rd9\") pod \"sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") " pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.318878 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.318769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:05.589461 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:05.589433    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"]
Sep 10 22:28:05.590636 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:28:05.590610    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe2b5a19_ebd5_441a_8a69_f99c9487696c.slice/crio-9b07871d837ea3b54c4d1387245ef70cd7ba3dcfc9d6850a4828a453d1ee4f60 WatchSource:0}: Error finding container 9b07871d837ea3b54c4d1387245ef70cd7ba3dcfc9d6850a4828a453d1ee4f60: Status 404 returned error can't find the container with id 9b07871d837ea3b54c4d1387245ef70cd7ba3dcfc9d6850a4828a453d1ee4f60
Sep 10 22:28:06.072407 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:06.072376    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg" event={"ID":"fe2b5a19-ebd5-441a-8a69-f99c9487696c","Type":"ContainerStarted","Data":"8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65"}
Sep 10 22:28:06.072786 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:06.072416    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg" event={"ID":"fe2b5a19-ebd5-441a-8a69-f99c9487696c","Type":"ContainerStarted","Data":"9b07871d837ea3b54c4d1387245ef70cd7ba3dcfc9d6850a4828a453d1ee4f60"}
Sep 10 22:28:06.088022 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:06.087954    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg" podStartSLOduration=2.087932902 podStartE2EDuration="2.087932902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:28:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:28:06.08671789 +0000 UTC m=+1365.969202257" watchObservedRunningTime="2026-09-10 22:28:06.087932902 +0000 UTC m=+1365.970417270"
Sep 10 22:28:07.926286 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:07.926239    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:08.227755 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:08.227728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:15.319206 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:15.319158    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:15.319675 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:15.319437    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:15.331975 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:15.331950    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:16.148392 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:16.148361    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:28:20.734098 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:20.734067    2573 scope.go:117] "RemoveContainer" containerID="0f136a46af2cd759f277ca3bf782936eef8f27931c94e42b5f0c830d43b4b2d3"
Sep 10 22:28:20.743032 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:20.743013    2573 scope.go:117] "RemoveContainer" containerID="c556880a144b25e73c46437bfbac8fd30ae92e242bc17641ce1f7e26043e83e9"
Sep 10 22:28:25.212352 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:25.212307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:29.117011 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:29.116976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:34.901280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:34.901248    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:34.972984 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:34.972957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:35.246441 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:35.246410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:35.555976 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:35.555891    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:35.748889 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:35.748831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:38.746384 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:38.746340    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:38.841611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:38.841577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:40.025086 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.025056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:40.198801 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.198770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:40.704449 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.704417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:40.805617 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.805576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:40.807046 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.807024    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"]
Sep 10 22:28:40.812316 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.812297    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:28:40.817119 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.817102    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-19922b\""
Sep 10 22:28:40.821746 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.821724    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"]
Sep 10 22:28:40.846945 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.846918    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"]
Sep 10 22:28:40.850385 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.850369    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:40.853110 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.853090    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-19922b-dockercfg-wvww8\""
Sep 10 22:28:40.864450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.864426    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"]
Sep 10 22:28:40.978430 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.978400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2\" (UID: \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:28:40.978589 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.978441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrvx9\" (UniqueName: \"kubernetes.io/projected/dad679d4-bc0e-42e4-b982-98fd311f93eb-kube-api-access-vrvx9\") pod \"payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq\" (UID: \"dad679d4-bc0e-42e4-b982-98fd311f93eb\") " pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:40.978589 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.978573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrk52\" (UniqueName: \"kubernetes.io/projected/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-kube-api-access-rrk52\") pod \"payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2\" (UID: \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:28:40.978667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:40.978613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad679d4-bc0e-42e4-b982-98fd311f93eb-plugins-config-volume\") pod \"payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq\" (UID: \"dad679d4-bc0e-42e4-b982-98fd311f93eb\") " pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:41.079499 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.079458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrk52\" (UniqueName: \"kubernetes.io/projected/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-kube-api-access-rrk52\") pod \"payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2\" (UID: \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:28:41.080002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.079508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad679d4-bc0e-42e4-b982-98fd311f93eb-plugins-config-volume\") pod \"payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq\" (UID: \"dad679d4-bc0e-42e4-b982-98fd311f93eb\") " pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:41.080002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.079583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2\" (UID: \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:28:41.080002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.079617    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrvx9\" (UniqueName: \"kubernetes.io/projected/dad679d4-bc0e-42e4-b982-98fd311f93eb-kube-api-access-vrvx9\") pod \"payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq\" (UID: \"dad679d4-bc0e-42e4-b982-98fd311f93eb\") " pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:41.080319 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.080299    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad679d4-bc0e-42e4-b982-98fd311f93eb-plugins-config-volume\") pod \"payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq\" (UID: \"dad679d4-bc0e-42e4-b982-98fd311f93eb\") " pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:41.080387 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.080366    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2\" (UID: \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:28:41.087669 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.087640    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrk52\" (UniqueName: \"kubernetes.io/projected/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-kube-api-access-rrk52\") pod \"payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2\" (UID: \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:28:41.088093 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.088075    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrvx9\" (UniqueName: \"kubernetes.io/projected/dad679d4-bc0e-42e4-b982-98fd311f93eb-kube-api-access-vrvx9\") pod \"payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq\" (UID: \"dad679d4-bc0e-42e4-b982-98fd311f93eb\") " pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:41.123920 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.123894    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:28:41.160325 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.160289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:41.414775 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.414748    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"]
Sep 10 22:28:41.416453 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:28:41.416429    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29a67be_dda6_4095_bf1b_2fc8adfed5d6.slice/crio-b1e4d54cbac6cdd236267ed7a8066097097fc7e115b20468e0cdadd53d5dd973 WatchSource:0}: Error finding container b1e4d54cbac6cdd236267ed7a8066097097fc7e115b20468e0cdadd53d5dd973: Status 404 returned error can't find the container with id b1e4d54cbac6cdd236267ed7a8066097097fc7e115b20468e0cdadd53d5dd973
Sep 10 22:28:41.459526 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:41.459499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"]
Sep 10 22:28:41.460151 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:28:41.460125    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad679d4_bc0e_42e4_b982_98fd311f93eb.slice/crio-51f8ab916636589b05712519dd298bd40dd88a64a3d1421e9e5c5831f47f85ef WatchSource:0}: Error finding container 51f8ab916636589b05712519dd298bd40dd88a64a3d1421e9e5c5831f47f85ef: Status 404 returned error can't find the container with id 51f8ab916636589b05712519dd298bd40dd88a64a3d1421e9e5c5831f47f85ef
Sep 10 22:28:42.283833 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:42.283798    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq" event={"ID":"dad679d4-bc0e-42e4-b982-98fd311f93eb","Type":"ContainerStarted","Data":"f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58"}
Sep 10 22:28:42.284483 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:42.283872    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:42.284483 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:42.283901    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq" event={"ID":"dad679d4-bc0e-42e4-b982-98fd311f93eb","Type":"ContainerStarted","Data":"51f8ab916636589b05712519dd298bd40dd88a64a3d1421e9e5c5831f47f85ef"}
Sep 10 22:28:42.285342 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:42.285319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2" event={"ID":"c29a67be-dda6-4095-bf1b-2fc8adfed5d6","Type":"ContainerStarted","Data":"40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65"}
Sep 10 22:28:42.285436 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:42.285355    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2" event={"ID":"c29a67be-dda6-4095-bf1b-2fc8adfed5d6","Type":"ContainerStarted","Data":"b1e4d54cbac6cdd236267ed7a8066097097fc7e115b20468e0cdadd53d5dd973"}
Sep 10 22:28:42.285474 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:42.285451    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:28:42.301330 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:42.301242    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq" podStartSLOduration=2.301229318 podStartE2EDuration="2.301229318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:28:42.298481282 +0000 UTC m=+1402.180965685" watchObservedRunningTime="2026-09-10 22:28:42.301229318 +0000 UTC m=+1402.183713684"
Sep 10 22:28:42.314928 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:42.314886    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2" podStartSLOduration=2.31487337 podStartE2EDuration="2.31487337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:28:42.313636084 +0000 UTC m=+1402.196120464" watchObservedRunningTime="2026-09-10 22:28:42.31487337 +0000 UTC m=+1402.197357735"
Sep 10 22:28:53.292722 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:53.292691    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:28:53.293155 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:28:53.292781    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:29:03.691328 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:03.691266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:04.166267 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:04.166226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:04.461820 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:04.461748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:04.688005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:04.687946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:07.879935 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:07.879901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:07.977636 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:07.977602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:09.208187 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.208148    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:09.307290 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.307255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:09.407989 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.407959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:09.692041 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.692003    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:09.796242 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.796208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:09.797957 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.797930    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"]
Sep 10 22:29:09.802110 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.802093    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:09.804581 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.804561    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ad8659\""
Sep 10 22:29:09.815210 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.815180    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"]
Sep 10 22:29:09.950968 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.950893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5af0576-597e-42da-9e7a-24126b52ebd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k\" (UID: \"b5af0576-597e-42da-9e7a-24126b52ebd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:09.950968 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:09.950936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncn7s\" (UniqueName: \"kubernetes.io/projected/b5af0576-597e-42da-9e7a-24126b52ebd1-kube-api-access-ncn7s\") pod \"payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k\" (UID: \"b5af0576-597e-42da-9e7a-24126b52ebd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:10.052337 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:10.052310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5af0576-597e-42da-9e7a-24126b52ebd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k\" (UID: \"b5af0576-597e-42da-9e7a-24126b52ebd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:10.052490 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:10.052344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncn7s\" (UniqueName: \"kubernetes.io/projected/b5af0576-597e-42da-9e7a-24126b52ebd1-kube-api-access-ncn7s\") pod \"payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k\" (UID: \"b5af0576-597e-42da-9e7a-24126b52ebd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:10.053044 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:10.053012    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5af0576-597e-42da-9e7a-24126b52ebd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k\" (UID: \"b5af0576-597e-42da-9e7a-24126b52ebd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:10.060529 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:10.060505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncn7s\" (UniqueName: \"kubernetes.io/projected/b5af0576-597e-42da-9e7a-24126b52ebd1-kube-api-access-ncn7s\") pod \"payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k\" (UID: \"b5af0576-597e-42da-9e7a-24126b52ebd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:10.114344 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:10.114318    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:10.387875 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:10.387828    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"]
Sep 10 22:29:10.388942 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:29:10.388904    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5af0576_597e_42da_9e7a_24126b52ebd1.slice/crio-ebb2c1ed74d460b99fbbf6af4e920d070b7676d7184cf8bda717165ca77ddfc5 WatchSource:0}: Error finding container ebb2c1ed74d460b99fbbf6af4e920d070b7676d7184cf8bda717165ca77ddfc5: Status 404 returned error can't find the container with id ebb2c1ed74d460b99fbbf6af4e920d070b7676d7184cf8bda717165ca77ddfc5
Sep 10 22:29:10.446545 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:10.446520    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k" event={"ID":"b5af0576-597e-42da-9e7a-24126b52ebd1","Type":"ContainerStarted","Data":"ebb2c1ed74d460b99fbbf6af4e920d070b7676d7184cf8bda717165ca77ddfc5"}
Sep 10 22:29:11.454565 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:11.454533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k" event={"ID":"b5af0576-597e-42da-9e7a-24126b52ebd1","Type":"ContainerStarted","Data":"3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323"}
Sep 10 22:29:11.454943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:11.454665    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:11.471453 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:11.471409    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k" podStartSLOduration=2.4713945920000002 podStartE2EDuration="2.471394592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:29:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:29:11.46962006 +0000 UTC m=+1431.352104449" watchObservedRunningTime="2026-09-10 22:29:11.471394592 +0000 UTC m=+1431.353878959"
Sep 10 22:29:19.813672 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:19.813598    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"]
Sep 10 22:29:19.833176 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:19.833139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:20.775043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:20.775011    2573 scope.go:117] "RemoveContainer" containerID="8f3b7d1b64c39f56171f27f9f0469e2edd8b58e4cd75671ded544c35a0073e65"
Sep 10 22:29:20.811010 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:20.810963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:22.462914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:22.462886    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:29:29.726300 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:29.726264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:32.837611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:32.837580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:34.833090 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:34.833056    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg" podUID="fe2b5a19-ebd5-441a-8a69-f99c9487696c" containerName="main" containerID="cri-o://8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65" gracePeriod=45
Sep 10 22:29:35.071263 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.071236    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:29:35.193064 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.192995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-model-cache\") pod \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") "
Sep 10 22:29:35.193064 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193031    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-home\") pod \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") "
Sep 10 22:29:35.193064 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193058    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tmp-dir\") pod \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") "
Sep 10 22:29:35.193331 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193094    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-dshm\") pod \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") "
Sep 10 22:29:35.193331 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193178    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tls-certs\") pod \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") "
Sep 10 22:29:35.193331 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193218    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6rd9\" (UniqueName: \"kubernetes.io/projected/fe2b5a19-ebd5-441a-8a69-f99c9487696c-kube-api-access-q6rd9\") pod \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\" (UID: \"fe2b5a19-ebd5-441a-8a69-f99c9487696c\") "
Sep 10 22:29:35.193331 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193250    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-home" (OuterVolumeSpecName: "home") pod "fe2b5a19-ebd5-441a-8a69-f99c9487696c" (UID: "fe2b5a19-ebd5-441a-8a69-f99c9487696c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:29:35.193331 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193264    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe2b5a19-ebd5-441a-8a69-f99c9487696c" (UID: "fe2b5a19-ebd5-441a-8a69-f99c9487696c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:29:35.193521 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193330    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe2b5a19-ebd5-441a-8a69-f99c9487696c" (UID: "fe2b5a19-ebd5-441a-8a69-f99c9487696c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:29:35.193521 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193482    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-model-cache\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:35.193521 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193494    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-home\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:35.193521 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.193503    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tmp-dir\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:35.195364 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.195337    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2b5a19-ebd5-441a-8a69-f99c9487696c-kube-api-access-q6rd9" (OuterVolumeSpecName: "kube-api-access-q6rd9") pod "fe2b5a19-ebd5-441a-8a69-f99c9487696c" (UID: "fe2b5a19-ebd5-441a-8a69-f99c9487696c"). InnerVolumeSpecName "kube-api-access-q6rd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:29:35.195470 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.195338    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe2b5a19-ebd5-441a-8a69-f99c9487696c" (UID: "fe2b5a19-ebd5-441a-8a69-f99c9487696c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:29:35.195470 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.195342    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-dshm" (OuterVolumeSpecName: "dshm") pod "fe2b5a19-ebd5-441a-8a69-f99c9487696c" (UID: "fe2b5a19-ebd5-441a-8a69-f99c9487696c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:29:35.294256 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.294237    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2b5a19-ebd5-441a-8a69-f99c9487696c-dshm\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:35.294256 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.294257    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2b5a19-ebd5-441a-8a69-f99c9487696c-tls-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:35.294387 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.294267    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6rd9\" (UniqueName: \"kubernetes.io/projected/fe2b5a19-ebd5-441a-8a69-f99c9487696c-kube-api-access-q6rd9\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:35.597795 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.597764    2573 generic.go:356] "Generic (PLEG): container finished" podID="fe2b5a19-ebd5-441a-8a69-f99c9487696c" containerID="8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65" exitCode=0
Sep 10 22:29:35.597962 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.597804    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"
Sep 10 22:29:35.597962 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.597856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg" event={"ID":"fe2b5a19-ebd5-441a-8a69-f99c9487696c","Type":"ContainerDied","Data":"8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65"}
Sep 10 22:29:35.597962 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.597900    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg" event={"ID":"fe2b5a19-ebd5-441a-8a69-f99c9487696c","Type":"ContainerDied","Data":"9b07871d837ea3b54c4d1387245ef70cd7ba3dcfc9d6850a4828a453d1ee4f60"}
Sep 10 22:29:35.597962 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.597920    2573 scope.go:117] "RemoveContainer" containerID="8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65"
Sep 10 22:29:35.608257 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.608242    2573 scope.go:117] "RemoveContainer" containerID="8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65"
Sep 10 22:29:35.608502 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:29:35.608483    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65\": container with ID starting with 8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65 not found: ID does not exist" containerID="8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65"
Sep 10 22:29:35.608552 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.608509    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65"} err="failed to get container status \"8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65\": rpc error: code = NotFound desc = could not find container \"8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65\": container with ID starting with 8b97601c62aa1bd21317fc213a43a7156226efbb4bbcf746f4b8c6853678cc65 not found: ID does not exist"
Sep 10 22:29:35.620159 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.620134    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"]
Sep 10 22:29:35.622481 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.622462    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-e367c1/sub-test-model-e367c1-kserve-56cb8dbc7c-8jphg"]
Sep 10 22:29:35.809991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.809968    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"]
Sep 10 22:29:35.810430 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.810412    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2b5a19-ebd5-441a-8a69-f99c9487696c" containerName="main"
Sep 10 22:29:35.810515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.810433    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2b5a19-ebd5-441a-8a69-f99c9487696c" containerName="main"
Sep 10 22:29:35.810576 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.810531    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe2b5a19-ebd5-441a-8a69-f99c9487696c" containerName="main"
Sep 10 22:29:35.815139 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.815121    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"
Sep 10 22:29:35.818208 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.818186    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:29:35.821819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.821799    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"]
Sep 10 22:29:35.898923 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.898848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b45481-4b04-4ce6-87d1-dad3cfd9f04f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-19922b-ftssl\" (UID: \"56b45481-4b04-4ce6-87d1-dad3cfd9f04f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"
Sep 10 22:29:35.999470 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:35.999444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b45481-4b04-4ce6-87d1-dad3cfd9f04f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-19922b-ftssl\" (UID: \"56b45481-4b04-4ce6-87d1-dad3cfd9f04f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"
Sep 10 22:29:36.000070 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:36.000052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b45481-4b04-4ce6-87d1-dad3cfd9f04f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-19922b-ftssl\" (UID: \"56b45481-4b04-4ce6-87d1-dad3cfd9f04f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"
Sep 10 22:29:36.017024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:36.016999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:36.128119 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:36.128085    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"
Sep 10 22:29:36.398460 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:36.398434    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"]
Sep 10 22:29:36.399533 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:29:36.399510    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b45481_4b04_4ce6_87d1_dad3cfd9f04f.slice/crio-5c9619eb54be64bd5c76c717f3acc049fc353167745ab0db6bd768e8a3177a8b WatchSource:0}: Error finding container 5c9619eb54be64bd5c76c717f3acc049fc353167745ab0db6bd768e8a3177a8b: Status 404 returned error can't find the container with id 5c9619eb54be64bd5c76c717f3acc049fc353167745ab0db6bd768e8a3177a8b
Sep 10 22:29:36.553203 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:36.553180    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe2b5a19-ebd5-441a-8a69-f99c9487696c" path="/var/lib/kubelet/pods/fe2b5a19-ebd5-441a-8a69-f99c9487696c/volumes"
Sep 10 22:29:36.605990 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:36.605966    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl" event={"ID":"56b45481-4b04-4ce6-87d1-dad3cfd9f04f","Type":"ContainerStarted","Data":"5c9619eb54be64bd5c76c717f3acc049fc353167745ab0db6bd768e8a3177a8b"}
Sep 10 22:29:37.614287 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:37.614261    2573 generic.go:356] "Generic (PLEG): container finished" podID="56b45481-4b04-4ce6-87d1-dad3cfd9f04f" containerID="c0a93a2a57c228fa9344d7d919080d69ece7583abc746d12d01bca34965ec5a0" exitCode=0
Sep 10 22:29:37.614678 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:37.614343    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl" event={"ID":"56b45481-4b04-4ce6-87d1-dad3cfd9f04f","Type":"ContainerDied","Data":"c0a93a2a57c228fa9344d7d919080d69ece7583abc746d12d01bca34965ec5a0"}
Sep 10 22:29:38.750411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:38.750389    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"
Sep 10 22:29:38.824216 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:38.824183    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b45481-4b04-4ce6-87d1-dad3cfd9f04f-maas-api-service-ca\") pod \"56b45481-4b04-4ce6-87d1-dad3cfd9f04f\" (UID: \"56b45481-4b04-4ce6-87d1-dad3cfd9f04f\") "
Sep 10 22:29:38.824501 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:38.824480    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56b45481-4b04-4ce6-87d1-dad3cfd9f04f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "56b45481-4b04-4ce6-87d1-dad3cfd9f04f" (UID: "56b45481-4b04-4ce6-87d1-dad3cfd9f04f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:29:38.925491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:38.925425    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b45481-4b04-4ce6-87d1-dad3cfd9f04f-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:39.631066 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:39.631035    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"
Sep 10 22:29:39.631266 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:39.631073    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl" event={"ID":"56b45481-4b04-4ce6-87d1-dad3cfd9f04f","Type":"ContainerDied","Data":"5c9619eb54be64bd5c76c717f3acc049fc353167745ab0db6bd768e8a3177a8b"}
Sep 10 22:29:39.631266 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:39.631164    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c9619eb54be64bd5c76c717f3acc049fc353167745ab0db6bd768e8a3177a8b"
Sep 10 22:29:41.295831 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:41.295800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:45.938962 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:45.938928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:51.250370 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:51.250336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:51.896648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:51.896620    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:51.927193 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:51.927152    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"]
Sep 10 22:29:51.927446 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:51.927417    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq" podUID="dad679d4-bc0e-42e4-b982-98fd311f93eb" containerName="payload-processing" containerID="cri-o://f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58" gracePeriod=30
Sep 10 22:29:51.931361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:51.931326    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"]
Sep 10 22:29:51.931790 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:51.931761    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2" podUID="c29a67be-dda6-4095-bf1b-2fc8adfed5d6" containerName="payload-pre-processing" containerID="cri-o://40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65" gracePeriod=30
Sep 10 22:29:51.965050 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:51.965021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:52.025897 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.025872    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:52.080579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.080542    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"]
Sep 10 22:29:52.082197 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.082165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:52.083440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.083418    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-19922b-ftssl"]
Sep 10 22:29:52.138891 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.138864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:52.208476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.208453    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:29:52.211118 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.211089    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:29:52.335453 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.335421    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrk52\" (UniqueName: \"kubernetes.io/projected/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-kube-api-access-rrk52\") pod \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\" (UID: \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\") "
Sep 10 22:29:52.335963 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.335465    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-plugins-config-volume\") pod \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\" (UID: \"c29a67be-dda6-4095-bf1b-2fc8adfed5d6\") "
Sep 10 22:29:52.335963 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.335513    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrvx9\" (UniqueName: \"kubernetes.io/projected/dad679d4-bc0e-42e4-b982-98fd311f93eb-kube-api-access-vrvx9\") pod \"dad679d4-bc0e-42e4-b982-98fd311f93eb\" (UID: \"dad679d4-bc0e-42e4-b982-98fd311f93eb\") "
Sep 10 22:29:52.335963 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.335538    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad679d4-bc0e-42e4-b982-98fd311f93eb-plugins-config-volume\") pod \"dad679d4-bc0e-42e4-b982-98fd311f93eb\" (UID: \"dad679d4-bc0e-42e4-b982-98fd311f93eb\") "
Sep 10 22:29:52.335963 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.335863    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c29a67be-dda6-4095-bf1b-2fc8adfed5d6" (UID: "c29a67be-dda6-4095-bf1b-2fc8adfed5d6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:29:52.336212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.336122    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad679d4-bc0e-42e4-b982-98fd311f93eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dad679d4-bc0e-42e4-b982-98fd311f93eb" (UID: "dad679d4-bc0e-42e4-b982-98fd311f93eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:29:52.337913 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.337874    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad679d4-bc0e-42e4-b982-98fd311f93eb-kube-api-access-vrvx9" (OuterVolumeSpecName: "kube-api-access-vrvx9") pod "dad679d4-bc0e-42e4-b982-98fd311f93eb" (UID: "dad679d4-bc0e-42e4-b982-98fd311f93eb"). InnerVolumeSpecName "kube-api-access-vrvx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:29:52.338153 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.338126    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-kube-api-access-rrk52" (OuterVolumeSpecName: "kube-api-access-rrk52") pod "c29a67be-dda6-4095-bf1b-2fc8adfed5d6" (UID: "c29a67be-dda6-4095-bf1b-2fc8adfed5d6"). InnerVolumeSpecName "kube-api-access-rrk52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:29:52.436240 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.436156    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:52.436240 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.436191    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrvx9\" (UniqueName: \"kubernetes.io/projected/dad679d4-bc0e-42e4-b982-98fd311f93eb-kube-api-access-vrvx9\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:52.436240 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.436202    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dad679d4-bc0e-42e4-b982-98fd311f93eb-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:52.436240 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.436211    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrk52\" (UniqueName: \"kubernetes.io/projected/c29a67be-dda6-4095-bf1b-2fc8adfed5d6-kube-api-access-rrk52\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:29:52.449107 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.449085    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:52.553174 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.553145    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56b45481-4b04-4ce6-87d1-dad3cfd9f04f" path="/var/lib/kubelet/pods/56b45481-4b04-4ce6-87d1-dad3cfd9f04f/volumes"
Sep 10 22:29:52.707394 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.707315    2573 generic.go:356] "Generic (PLEG): container finished" podID="dad679d4-bc0e-42e4-b982-98fd311f93eb" containerID="f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58" exitCode=0
Sep 10 22:29:52.707394 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.707363    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"
Sep 10 22:29:52.707586 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.707400    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq" event={"ID":"dad679d4-bc0e-42e4-b982-98fd311f93eb","Type":"ContainerDied","Data":"f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58"}
Sep 10 22:29:52.707586 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.707452    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq" event={"ID":"dad679d4-bc0e-42e4-b982-98fd311f93eb","Type":"ContainerDied","Data":"51f8ab916636589b05712519dd298bd40dd88a64a3d1421e9e5c5831f47f85ef"}
Sep 10 22:29:52.707586 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.707484    2573 scope.go:117] "RemoveContainer" containerID="f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58"
Sep 10 22:29:52.708853 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.708820    2573 generic.go:356] "Generic (PLEG): container finished" podID="c29a67be-dda6-4095-bf1b-2fc8adfed5d6" containerID="40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65" exitCode=0
Sep 10 22:29:52.708962 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.708881    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"
Sep 10 22:29:52.708962 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.708903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2" event={"ID":"c29a67be-dda6-4095-bf1b-2fc8adfed5d6","Type":"ContainerDied","Data":"40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65"}
Sep 10 22:29:52.708962 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.708949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2" event={"ID":"c29a67be-dda6-4095-bf1b-2fc8adfed5d6","Type":"ContainerDied","Data":"b1e4d54cbac6cdd236267ed7a8066097097fc7e115b20468e0cdadd53d5dd973"}
Sep 10 22:29:52.720318 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.720302    2573 scope.go:117] "RemoveContainer" containerID="f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58"
Sep 10 22:29:52.720606 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:29:52.720586    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58\": container with ID starting with f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58 not found: ID does not exist" containerID="f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58"
Sep 10 22:29:52.720677 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.720615    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58"} err="failed to get container status \"f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58\": rpc error: code = NotFound desc = could not find container \"f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58\": container with ID starting with f7098a95ec2ba7ef987e2f4a17fe34e78a52c332bbc34012a627d74332aece58 not found: ID does not exist"
Sep 10 22:29:52.720677 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.720633    2573 scope.go:117] "RemoveContainer" containerID="40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65"
Sep 10 22:29:52.729033 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.729018    2573 scope.go:117] "RemoveContainer" containerID="40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65"
Sep 10 22:29:52.729310 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:29:52.729291    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65\": container with ID starting with 40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65 not found: ID does not exist" containerID="40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65"
Sep 10 22:29:52.729373 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.729318    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65"} err="failed to get container status \"40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65\": rpc error: code = NotFound desc = could not find container \"40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65\": container with ID starting with 40c39a15c77acdb476ef5976454dbfe8594b90533f5db832f677ee2956418d65 not found: ID does not exist"
Sep 10 22:29:52.730476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.730457    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"]
Sep 10 22:29:52.733782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.733763    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-19922b-7bc4c89d5c-s9bbq"]
Sep 10 22:29:52.742826 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.742806    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"]
Sep 10 22:29:52.748496 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:52.748475    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-19922b-544b967bdb-cdjx2"]
Sep 10 22:29:54.552829 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:54.552798    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c29a67be-dda6-4095-bf1b-2fc8adfed5d6" path="/var/lib/kubelet/pods/c29a67be-dda6-4095-bf1b-2fc8adfed5d6/volumes"
Sep 10 22:29:54.553208 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:54.553157    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dad679d4-bc0e-42e4-b982-98fd311f93eb" path="/var/lib/kubelet/pods/dad679d4-bc0e-42e4-b982-98fd311f93eb/volumes"
Sep 10 22:29:58.181790 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.181756    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:58.236590 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.236556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:58.428870 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.428800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:58.753766 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.753731    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"]
Sep 10 22:29:58.754170 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.754156    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dad679d4-bc0e-42e4-b982-98fd311f93eb" containerName="payload-processing"
Sep 10 22:29:58.754230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.754172    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dad679d4-bc0e-42e4-b982-98fd311f93eb" containerName="payload-processing"
Sep 10 22:29:58.754230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.754186    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c29a67be-dda6-4095-bf1b-2fc8adfed5d6" containerName="payload-pre-processing"
Sep 10 22:29:58.754230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.754192    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c29a67be-dda6-4095-bf1b-2fc8adfed5d6" containerName="payload-pre-processing"
Sep 10 22:29:58.754230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.754213    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b45481-4b04-4ce6-87d1-dad3cfd9f04f" containerName="revoke-keys"
Sep 10 22:29:58.754230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.754219    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b45481-4b04-4ce6-87d1-dad3cfd9f04f" containerName="revoke-keys"
Sep 10 22:29:58.754400 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.754279    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56b45481-4b04-4ce6-87d1-dad3cfd9f04f" containerName="revoke-keys"
Sep 10 22:29:58.754400 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.754290    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c29a67be-dda6-4095-bf1b-2fc8adfed5d6" containerName="payload-pre-processing"
Sep 10 22:29:58.754400 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.754296    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dad679d4-bc0e-42e4-b982-98fd311f93eb" containerName="payload-processing"
Sep 10 22:29:58.757485 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.757466    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"
Sep 10 22:29:58.759597 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.759575    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:29:58.764255 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.764229    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"]
Sep 10 22:29:58.862024 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.861995    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:58.890021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.889994    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1657648-99ac-48c4-b57f-ec90596bef9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ad8659-44z6c\" (UID: \"a1657648-99ac-48c4-b57f-ec90596bef9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"
Sep 10 22:29:58.991509 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.991473    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1657648-99ac-48c4-b57f-ec90596bef9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ad8659-44z6c\" (UID: \"a1657648-99ac-48c4-b57f-ec90596bef9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"
Sep 10 22:29:58.992187 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:58.992166    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1657648-99ac-48c4-b57f-ec90596bef9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ad8659-44z6c\" (UID: \"a1657648-99ac-48c4-b57f-ec90596bef9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"
Sep 10 22:29:59.069516 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:59.069451    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"
Sep 10 22:29:59.339305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:59.339278    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"]
Sep 10 22:29:59.341195 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:29:59.341166    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1657648_99ac_48c4_b57f_ec90596bef9d.slice/crio-02c074ca08303f564d76df71a6c140eceb42d3ceab612b5e38eea2c940855a24 WatchSource:0}: Error finding container 02c074ca08303f564d76df71a6c140eceb42d3ceab612b5e38eea2c940855a24: Status 404 returned error can't find the container with id 02c074ca08303f564d76df71a6c140eceb42d3ceab612b5e38eea2c940855a24
Sep 10 22:29:59.752238 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:59.752204    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c" event={"ID":"a1657648-99ac-48c4-b57f-ec90596bef9d","Type":"ContainerStarted","Data":"209aa8de9383a68cc2b2b54cd5074ad1cc8d62238b0be1d4a8f9c0ba4a3db1cf"}
Sep 10 22:29:59.752424 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:59.752255    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c" event={"ID":"a1657648-99ac-48c4-b57f-ec90596bef9d","Type":"ContainerStarted","Data":"02c074ca08303f564d76df71a6c140eceb42d3ceab612b5e38eea2c940855a24"}
Sep 10 22:29:59.766701 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:29:59.766658    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c" podStartSLOduration=1.766642243 podStartE2EDuration="1.766642243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:29:59.765662116 +0000 UTC m=+1479.648146485" watchObservedRunningTime="2026-09-10 22:29:59.766642243 +0000 UTC m=+1479.649126609"
Sep 10 22:30:00.184230 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.184199    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q"]
Sep 10 22:30:00.187773 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.187750    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm"]
Sep 10 22:30:00.187932 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.187910    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q"
Sep 10 22:30:00.199233 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.198610    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q"
Sep 10 22:30:00.202253 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.200669    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm"
Sep 10 22:30:00.204719 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.204700    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q"]
Sep 10 22:30:00.206726 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.206705    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm"]
Sep 10 22:30:00.209534 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.209512    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb"]
Sep 10 22:30:00.213663 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.213641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb"
Sep 10 22:30:00.214716 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.214699    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm"
Sep 10 22:30:00.218713 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.218689    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb"]
Sep 10 22:30:00.256775 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.256513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb"
Sep 10 22:30:00.493405 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.493381    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q"]
Sep 10 22:30:00.494755 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:30:00.494722    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd97eae_a5cb_4642_b4db_ceff4bbd65c2.slice/crio-4e093cd84cfddf3002fe6d3986a98404a05c6b5b786d42603da461074b0ddf65 WatchSource:0}: Error finding container 4e093cd84cfddf3002fe6d3986a98404a05c6b5b786d42603da461074b0ddf65: Status 404 returned error can't find the container with id 4e093cd84cfddf3002fe6d3986a98404a05c6b5b786d42603da461074b0ddf65
Sep 10 22:30:00.510190 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.510168    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm"]
Sep 10 22:30:00.512600 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:30:00.512578    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6759aae3_6750_44ea_8ca2_bd4f1c4d5b6c.slice/crio-9f58515a7a04f11e15e6e72cdc3803b9be91dfcf177aaafc4cf0c30fe6757167 WatchSource:0}: Error finding container 9f58515a7a04f11e15e6e72cdc3803b9be91dfcf177aaafc4cf0c30fe6757167: Status 404 returned error can't find the container with id 9f58515a7a04f11e15e6e72cdc3803b9be91dfcf177aaafc4cf0c30fe6757167
Sep 10 22:30:00.557510 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.557485    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb"]
Sep 10 22:30:00.557794 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:30:00.557772    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280e1282_9db0_4e44_98cf_201d4372945c.slice/crio-aa57e71a59c43991568ca99ef6feaa3fe56595acd9b103d25827f9c27af7a3e9 WatchSource:0}: Error finding container aa57e71a59c43991568ca99ef6feaa3fe56595acd9b103d25827f9c27af7a3e9: Status 404 returned error can't find the container with id aa57e71a59c43991568ca99ef6feaa3fe56595acd9b103d25827f9c27af7a3e9
Sep 10 22:30:00.759083 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.759061    2573 generic.go:356] "Generic (PLEG): container finished" podID="a1657648-99ac-48c4-b57f-ec90596bef9d" containerID="209aa8de9383a68cc2b2b54cd5074ad1cc8d62238b0be1d4a8f9c0ba4a3db1cf" exitCode=0
Sep 10 22:30:00.759192 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.759140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c" event={"ID":"a1657648-99ac-48c4-b57f-ec90596bef9d","Type":"ContainerDied","Data":"209aa8de9383a68cc2b2b54cd5074ad1cc8d62238b0be1d4a8f9c0ba4a3db1cf"}
Sep 10 22:30:00.760628 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.760573    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm" event={"ID":"6759aae3-6750-44ea-8ca2-bd4f1c4d5b6c","Type":"ContainerStarted","Data":"e51a27143410c28a731f2e839de8c1979a4459e6b92f9f11d9bb21f733098009"}
Sep 10 22:30:00.760628 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.760623    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm" event={"ID":"6759aae3-6750-44ea-8ca2-bd4f1c4d5b6c","Type":"ContainerStarted","Data":"9f58515a7a04f11e15e6e72cdc3803b9be91dfcf177aaafc4cf0c30fe6757167"}
Sep 10 22:30:00.761909 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.761885    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q" event={"ID":"2bd97eae-a5cb-4642-b4db-ceff4bbd65c2","Type":"ContainerStarted","Data":"4e093cd84cfddf3002fe6d3986a98404a05c6b5b786d42603da461074b0ddf65"}
Sep 10 22:30:00.763149 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.763129    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb" event={"ID":"280e1282-9db0-4e44-98cf-201d4372945c","Type":"ContainerStarted","Data":"aa57e71a59c43991568ca99ef6feaa3fe56595acd9b103d25827f9c27af7a3e9"}
Sep 10 22:30:00.788185 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:00.788142    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm" podStartSLOduration=0.788127825 podStartE2EDuration="788.127825ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:00.785296905 +0000 UTC m=+1480.667781271" watchObservedRunningTime="2026-09-10 22:30:00.788127825 +0000 UTC m=+1480.670612188"
Sep 10 22:30:01.770719 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:01.770684    2573 generic.go:356] "Generic (PLEG): container finished" podID="280e1282-9db0-4e44-98cf-201d4372945c" containerID="0cf44a0f44b6ec09d828d966701eedb67b534a52012036abf1aa383d39137058" exitCode=0
Sep 10 22:30:01.771191 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:01.770777    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb" event={"ID":"280e1282-9db0-4e44-98cf-201d4372945c","Type":"ContainerDied","Data":"0cf44a0f44b6ec09d828d966701eedb67b534a52012036abf1aa383d39137058"}
Sep 10 22:30:01.772440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:01.772414    2573 generic.go:356] "Generic (PLEG): container finished" podID="6759aae3-6750-44ea-8ca2-bd4f1c4d5b6c" containerID="e51a27143410c28a731f2e839de8c1979a4459e6b92f9f11d9bb21f733098009" exitCode=0
Sep 10 22:30:01.772548 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:01.772499    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm" event={"ID":"6759aae3-6750-44ea-8ca2-bd4f1c4d5b6c","Type":"ContainerDied","Data":"e51a27143410c28a731f2e839de8c1979a4459e6b92f9f11d9bb21f733098009"}
Sep 10 22:30:01.774083 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:01.774059    2573 generic.go:356] "Generic (PLEG): container finished" podID="2bd97eae-a5cb-4642-b4db-ceff4bbd65c2" containerID="0d78fb0066615b81077b322ba87e9b81bdfb1d7a69c90a83c5b86ee89804b7f8" exitCode=0
Sep 10 22:30:01.774196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:01.774119    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q" event={"ID":"2bd97eae-a5cb-4642-b4db-ceff4bbd65c2","Type":"ContainerDied","Data":"0d78fb0066615b81077b322ba87e9b81bdfb1d7a69c90a83c5b86ee89804b7f8"}
Sep 10 22:30:01.907946 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:01.907920    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"
Sep 10 22:30:02.023261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:02.023159    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1657648-99ac-48c4-b57f-ec90596bef9d-maas-api-service-ca\") pod \"a1657648-99ac-48c4-b57f-ec90596bef9d\" (UID: \"a1657648-99ac-48c4-b57f-ec90596bef9d\") "
Sep 10 22:30:02.023535 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:02.023510    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1657648-99ac-48c4-b57f-ec90596bef9d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1657648-99ac-48c4-b57f-ec90596bef9d" (UID: "a1657648-99ac-48c4-b57f-ec90596bef9d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:02.124646 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:02.124601    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1657648-99ac-48c4-b57f-ec90596bef9d-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:02.782087 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:02.782055    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"
Sep 10 22:30:02.782548 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:02.782094    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c" event={"ID":"a1657648-99ac-48c4-b57f-ec90596bef9d","Type":"ContainerDied","Data":"02c074ca08303f564d76df71a6c140eceb42d3ceab612b5e38eea2c940855a24"}
Sep 10 22:30:02.782548 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:02.782150    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02c074ca08303f564d76df71a6c140eceb42d3ceab612b5e38eea2c940855a24"
Sep 10 22:30:02.950460 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:02.950438    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q"
Sep 10 22:30:02.979747 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:02.979722    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm"
Sep 10 22:30:02.983428 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:02.983400    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb"
Sep 10 22:30:03.790212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:03.790184    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb"
Sep 10 22:30:03.790663 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:03.790214    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb" event={"ID":"280e1282-9db0-4e44-98cf-201d4372945c","Type":"ContainerDied","Data":"aa57e71a59c43991568ca99ef6feaa3fe56595acd9b103d25827f9c27af7a3e9"}
Sep 10 22:30:03.790663 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:03.790264    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa57e71a59c43991568ca99ef6feaa3fe56595acd9b103d25827f9c27af7a3e9"
Sep 10 22:30:03.791753 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:03.791734    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm"
Sep 10 22:30:03.791946 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:03.791762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817990-4h9tm" event={"ID":"6759aae3-6750-44ea-8ca2-bd4f1c4d5b6c","Type":"ContainerDied","Data":"9f58515a7a04f11e15e6e72cdc3803b9be91dfcf177aaafc4cf0c30fe6757167"}
Sep 10 22:30:03.791946 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:03.791798    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f58515a7a04f11e15e6e72cdc3803b9be91dfcf177aaafc4cf0c30fe6757167"
Sep 10 22:30:03.793235 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:03.793215    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q"
Sep 10 22:30:03.793355 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:03.793227    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q" event={"ID":"2bd97eae-a5cb-4642-b4db-ceff4bbd65c2","Type":"ContainerDied","Data":"4e093cd84cfddf3002fe6d3986a98404a05c6b5b786d42603da461074b0ddf65"}
Sep 10 22:30:03.793355 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:03.793272    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e093cd84cfddf3002fe6d3986a98404a05c6b5b786d42603da461074b0ddf65"
Sep 10 22:30:08.614628 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:08.614594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:09.317667 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:09.317629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:09.418673 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:09.418638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:12.078478 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:12.078441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:13.053251 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:13.053210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.212104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.212071    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb"]
Sep 10 22:30:14.212708 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.212688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.214654 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.214633    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-ad8659-29817990-npqwb"]
Sep 10 22:30:14.246300 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.246264    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"]
Sep 10 22:30:14.246595 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.246563    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k" podUID="b5af0576-597e-42da-9e7a-24126b52ebd1" containerName="payload-pre-processing" containerID="cri-o://3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323" gracePeriod=30
Sep 10 22:30:14.312523 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.312476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.396592 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.396554    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"]
Sep 10 22:30:14.400774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.400746    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.401049 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.401026    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad8659-44z6c"]
Sep 10 22:30:14.459686 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.459655    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.513612 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.513581    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:30:14.538011 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.537973    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncn7s\" (UniqueName: \"kubernetes.io/projected/b5af0576-597e-42da-9e7a-24126b52ebd1-kube-api-access-ncn7s\") pod \"b5af0576-597e-42da-9e7a-24126b52ebd1\" (UID: \"b5af0576-597e-42da-9e7a-24126b52ebd1\") "
Sep 10 22:30:14.538212 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.538025    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5af0576-597e-42da-9e7a-24126b52ebd1-plugins-config-volume\") pod \"b5af0576-597e-42da-9e7a-24126b52ebd1\" (UID: \"b5af0576-597e-42da-9e7a-24126b52ebd1\") "
Sep 10 22:30:14.538452 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.538427    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5af0576-597e-42da-9e7a-24126b52ebd1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5af0576-597e-42da-9e7a-24126b52ebd1" (UID: "b5af0576-597e-42da-9e7a-24126b52ebd1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:14.540100 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.540072    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5af0576-597e-42da-9e7a-24126b52ebd1-kube-api-access-ncn7s" (OuterVolumeSpecName: "kube-api-access-ncn7s") pod "b5af0576-597e-42da-9e7a-24126b52ebd1" (UID: "b5af0576-597e-42da-9e7a-24126b52ebd1"). InnerVolumeSpecName "kube-api-access-ncn7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:14.554409 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.554379    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="280e1282-9db0-4e44-98cf-201d4372945c" path="/var/lib/kubelet/pods/280e1282-9db0-4e44-98cf-201d4372945c/volumes"
Sep 10 22:30:14.554700 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.554685    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1657648-99ac-48c4-b57f-ec90596bef9d" path="/var/lib/kubelet/pods/a1657648-99ac-48c4-b57f-ec90596bef9d/volumes"
Sep 10 22:30:14.639926 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.639884    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5af0576-597e-42da-9e7a-24126b52ebd1-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:14.639926 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.639921    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncn7s\" (UniqueName: \"kubernetes.io/projected/b5af0576-597e-42da-9e7a-24126b52ebd1-kube-api-access-ncn7s\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:14.778133 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.778054    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.861492 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.861461    2573 generic.go:356] "Generic (PLEG): container finished" podID="b5af0576-597e-42da-9e7a-24126b52ebd1" containerID="3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323" exitCode=0
Sep 10 22:30:14.861689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.861500    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"
Sep 10 22:30:14.861689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.861549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k" event={"ID":"b5af0576-597e-42da-9e7a-24126b52ebd1","Type":"ContainerDied","Data":"3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323"}
Sep 10 22:30:14.861689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.861600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k" event={"ID":"b5af0576-597e-42da-9e7a-24126b52ebd1","Type":"ContainerDied","Data":"ebb2c1ed74d460b99fbbf6af4e920d070b7676d7184cf8bda717165ca77ddfc5"}
Sep 10 22:30:14.861689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.861626    2573 scope.go:117] "RemoveContainer" containerID="3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323"
Sep 10 22:30:14.871223 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.871204    2573 scope.go:117] "RemoveContainer" containerID="3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323"
Sep 10 22:30:14.871488 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:30:14.871465    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323\": container with ID starting with 3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323 not found: ID does not exist" containerID="3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323"
Sep 10 22:30:14.871563 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.871496    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323"} err="failed to get container status \"3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323\": rpc error: code = NotFound desc = could not find container \"3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323\": container with ID starting with 3f3bfa3ebce5e780121138a6cf9bbf62315144badfb2cb33c1f919e82d081323 not found: ID does not exist"
Sep 10 22:30:14.877936 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.877914    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"]
Sep 10 22:30:14.881786 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:14.881764    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ad8659-6d95d756db-mvk7k"]
Sep 10 22:30:16.552924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:16.552891    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5af0576-597e-42da-9e7a-24126b52ebd1" path="/var/lib/kubelet/pods/b5af0576-597e-42da-9e7a-24126b52ebd1/volumes"
Sep 10 22:30:20.626990 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:20.626947    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:30:20.629115 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:20.629090    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:30:20.801013 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:20.800977    2573 scope.go:117] "RemoveContainer" containerID="9269d7ecb0f33cc2a238c69da15da8fa96b68d3b53f9792374b28b911ff72eb3"
Sep 10 22:30:20.810216 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:20.810192    2573 scope.go:117] "RemoveContainer" containerID="763a51f4faa6c3974b017036342e885addb413a91a0edc65be23b376e526193b"
Sep 10 22:30:21.117455 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.117393    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"]
Sep 10 22:30:21.117955 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.117938    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6759aae3-6750-44ea-8ca2-bd4f1c4d5b6c" containerName="cleanup"
Sep 10 22:30:21.117955 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.117956    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6759aae3-6750-44ea-8ca2-bd4f1c4d5b6c" containerName="cleanup"
Sep 10 22:30:21.118051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.117968    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1657648-99ac-48c4-b57f-ec90596bef9d" containerName="revoke-keys"
Sep 10 22:30:21.118051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.117975    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1657648-99ac-48c4-b57f-ec90596bef9d" containerName="revoke-keys"
Sep 10 22:30:21.118051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.117989    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5af0576-597e-42da-9e7a-24126b52ebd1" containerName="payload-pre-processing"
Sep 10 22:30:21.118051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.117994    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5af0576-597e-42da-9e7a-24126b52ebd1" containerName="payload-pre-processing"
Sep 10 22:30:21.118051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.118002    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280e1282-9db0-4e44-98cf-201d4372945c" containerName="cleanup"
Sep 10 22:30:21.118051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.118011    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="280e1282-9db0-4e44-98cf-201d4372945c" containerName="cleanup"
Sep 10 22:30:21.118051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.118022    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd97eae-a5cb-4642-b4db-ceff4bbd65c2" containerName="cleanup"
Sep 10 22:30:21.118051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.118028    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd97eae-a5cb-4642-b4db-ceff4bbd65c2" containerName="cleanup"
Sep 10 22:30:21.118308 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.118095    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="280e1282-9db0-4e44-98cf-201d4372945c" containerName="cleanup"
Sep 10 22:30:21.118308 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.118107    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6759aae3-6750-44ea-8ca2-bd4f1c4d5b6c" containerName="cleanup"
Sep 10 22:30:21.118308 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.118113    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bd97eae-a5cb-4642-b4db-ceff4bbd65c2" containerName="cleanup"
Sep 10 22:30:21.118308 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.118119    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5af0576-597e-42da-9e7a-24126b52ebd1" containerName="payload-pre-processing"
Sep 10 22:30:21.118308 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.118124    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1657648-99ac-48c4-b57f-ec90596bef9d" containerName="revoke-keys"
Sep 10 22:30:21.121217 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.121198    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"
Sep 10 22:30:21.124057 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.124034    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:30:21.127452 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.127427    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"]
Sep 10 22:30:21.204404 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.204361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1ab042-9500-4009-a21a-8677ddc722fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l\" (UID: \"8f1ab042-9500-4009-a21a-8677ddc722fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"
Sep 10 22:30:21.230519 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.230474    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:21.305964 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.305915    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1ab042-9500-4009-a21a-8677ddc722fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l\" (UID: \"8f1ab042-9500-4009-a21a-8677ddc722fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"
Sep 10 22:30:21.306628 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.306604    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1ab042-9500-4009-a21a-8677ddc722fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l\" (UID: \"8f1ab042-9500-4009-a21a-8677ddc722fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"
Sep 10 22:30:21.332369 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.332329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:21.434138 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.434045    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"
Sep 10 22:30:21.489824 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.488640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:21.595342 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.595302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:21.709367 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.709331    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"]
Sep 10 22:30:21.711184 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:30:21.711154    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1ab042_9500_4009_a21a_8677ddc722fc.slice/crio-049afeefd7cde1fe125a5e104d7c8fb8b13698524d4e5df2fe1b14ca5f193872 WatchSource:0}: Error finding container 049afeefd7cde1fe125a5e104d7c8fb8b13698524d4e5df2fe1b14ca5f193872: Status 404 returned error can't find the container with id 049afeefd7cde1fe125a5e104d7c8fb8b13698524d4e5df2fe1b14ca5f193872
Sep 10 22:30:21.911109 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:21.911066    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l" event={"ID":"8f1ab042-9500-4009-a21a-8677ddc722fc","Type":"ContainerStarted","Data":"049afeefd7cde1fe125a5e104d7c8fb8b13698524d4e5df2fe1b14ca5f193872"}
Sep 10 22:30:22.918634 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:22.918600    2573 generic.go:356] "Generic (PLEG): container finished" podID="8f1ab042-9500-4009-a21a-8677ddc722fc" containerID="bab66b1314b9913dafb9b3cff446cdeebf82e4d7ecc6d8b62307ecfd4991f1b3" exitCode=0
Sep 10 22:30:22.919052 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:22.918683    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l" event={"ID":"8f1ab042-9500-4009-a21a-8677ddc722fc","Type":"ContainerDied","Data":"bab66b1314b9913dafb9b3cff446cdeebf82e4d7ecc6d8b62307ecfd4991f1b3"}
Sep 10 22:30:24.064898 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:24.064826    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"
Sep 10 22:30:24.132532 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:24.132482    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1ab042-9500-4009-a21a-8677ddc722fc-maas-api-service-ca\") pod \"8f1ab042-9500-4009-a21a-8677ddc722fc\" (UID: \"8f1ab042-9500-4009-a21a-8677ddc722fc\") "
Sep 10 22:30:24.132894 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:24.132871    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f1ab042-9500-4009-a21a-8677ddc722fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8f1ab042-9500-4009-a21a-8677ddc722fc" (UID: "8f1ab042-9500-4009-a21a-8677ddc722fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:24.233648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:24.233615    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f1ab042-9500-4009-a21a-8677ddc722fc-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:24.932076 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:24.931981    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"
Sep 10 22:30:24.932076 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:24.932002    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l" event={"ID":"8f1ab042-9500-4009-a21a-8677ddc722fc","Type":"ContainerDied","Data":"049afeefd7cde1fe125a5e104d7c8fb8b13698524d4e5df2fe1b14ca5f193872"}
Sep 10 22:30:24.932076 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:24.932045    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="049afeefd7cde1fe125a5e104d7c8fb8b13698524d4e5df2fe1b14ca5f193872"
Sep 10 22:30:31.560261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.560220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:31.594416 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.594373    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"]
Sep 10 22:30:31.597861 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.594724    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v" podUID="c3f014ea-4c63-4b5a-b330-e5179ced0be0" containerName="payload-processing" containerID="cri-o://6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a" gracePeriod=30
Sep 10 22:30:31.660535 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.660493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:31.742179 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.742141    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"]
Sep 10 22:30:31.743181 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.743149    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:31.744798 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.744772    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-4a864c-txs6l"]
Sep 10 22:30:31.804419 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.804353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:31.854705 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.854679    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:30:31.910063 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.910027    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f014ea-4c63-4b5a-b330-e5179ced0be0-plugins-config-volume\") pod \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\" (UID: \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\") "
Sep 10 22:30:31.910287 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.910162    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w44sw\" (UniqueName: \"kubernetes.io/projected/c3f014ea-4c63-4b5a-b330-e5179ced0be0-kube-api-access-w44sw\") pod \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\" (UID: \"c3f014ea-4c63-4b5a-b330-e5179ced0be0\") "
Sep 10 22:30:31.910526 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.910490    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f014ea-4c63-4b5a-b330-e5179ced0be0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3f014ea-4c63-4b5a-b330-e5179ced0be0" (UID: "c3f014ea-4c63-4b5a-b330-e5179ced0be0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:31.912565 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.912538    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f014ea-4c63-4b5a-b330-e5179ced0be0-kube-api-access-w44sw" (OuterVolumeSpecName: "kube-api-access-w44sw") pod "c3f014ea-4c63-4b5a-b330-e5179ced0be0" (UID: "c3f014ea-4c63-4b5a-b330-e5179ced0be0"). InnerVolumeSpecName "kube-api-access-w44sw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:31.978727 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.978691    2573 generic.go:356] "Generic (PLEG): container finished" podID="c3f014ea-4c63-4b5a-b330-e5179ced0be0" containerID="6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a" exitCode=0
Sep 10 22:30:31.978906 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.978737    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"
Sep 10 22:30:31.978906 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.978775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v" event={"ID":"c3f014ea-4c63-4b5a-b330-e5179ced0be0","Type":"ContainerDied","Data":"6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a"}
Sep 10 22:30:31.978906 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.978827    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v" event={"ID":"c3f014ea-4c63-4b5a-b330-e5179ced0be0","Type":"ContainerDied","Data":"4c324763c1e12d1a3800e40af2499caec9bf9d6de67642dbfaeb092ed984ca2d"}
Sep 10 22:30:31.978906 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.978864    2573 scope.go:117] "RemoveContainer" containerID="6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a"
Sep 10 22:30:31.989308 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.989288    2573 scope.go:117] "RemoveContainer" containerID="6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a"
Sep 10 22:30:31.989656 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:30:31.989620    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a\": container with ID starting with 6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a not found: ID does not exist" containerID="6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a"
Sep 10 22:30:31.989723 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:31.989663    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a"} err="failed to get container status \"6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a\": rpc error: code = NotFound desc = could not find container \"6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a\": container with ID starting with 6be69912872cd7f46841add7de0bffd1f047d5481ccc04d3e6d3e9e89a96ec7a not found: ID does not exist"
Sep 10 22:30:32.001411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:32.001380    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"]
Sep 10 22:30:32.004886 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:32.004857    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4a864c-79f9f85cb9-c954v"]
Sep 10 22:30:32.011272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:32.011243    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f014ea-4c63-4b5a-b330-e5179ced0be0-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:32.011272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:32.011273    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w44sw\" (UniqueName: \"kubernetes.io/projected/c3f014ea-4c63-4b5a-b330-e5179ced0be0-kube-api-access-w44sw\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:32.095163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:32.095069    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:32.553226 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:32.553191    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f1ab042-9500-4009-a21a-8677ddc722fc" path="/var/lib/kubelet/pods/8f1ab042-9500-4009-a21a-8677ddc722fc/volumes"
Sep 10 22:30:32.553576 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:32.553564    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f014ea-4c63-4b5a-b330-e5179ced0be0" path="/var/lib/kubelet/pods/c3f014ea-4c63-4b5a-b330-e5179ced0be0/volumes"
Sep 10 22:30:37.777999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:37.777962    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:37.877823 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:37.877791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:38.018244 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.018214    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"]
Sep 10 22:30:38.018453 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.018418    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy" containerID="cri-o://818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3" gracePeriod=30
Sep 10 22:30:38.046391 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.046297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:38.368735 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.368655    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"]
Sep 10 22:30:38.369095 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.369075    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f1ab042-9500-4009-a21a-8677ddc722fc" containerName="revoke-keys"
Sep 10 22:30:38.369156 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.369096    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f1ab042-9500-4009-a21a-8677ddc722fc" containerName="revoke-keys"
Sep 10 22:30:38.369156 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.369114    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f014ea-4c63-4b5a-b330-e5179ced0be0" containerName="payload-processing"
Sep 10 22:30:38.369156 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.369119    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f014ea-4c63-4b5a-b330-e5179ced0be0" containerName="payload-processing"
Sep 10 22:30:38.369250 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.369208    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f014ea-4c63-4b5a-b330-e5179ced0be0" containerName="payload-processing"
Sep 10 22:30:38.369250 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.369217    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f1ab042-9500-4009-a21a-8677ddc722fc" containerName="revoke-keys"
Sep 10 22:30:38.373292 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.373272    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"
Sep 10 22:30:38.375306 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.375285    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:30:38.379744 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.379695    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"]
Sep 10 22:30:38.480689 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.480656    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc7befe-0a0d-41c8-9f46-42fa8b5c479f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z\" (UID: \"9dc7befe-0a0d-41c8-9f46-42fa8b5c479f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"
Sep 10 22:30:38.581625 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.581584    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc7befe-0a0d-41c8-9f46-42fa8b5c479f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z\" (UID: \"9dc7befe-0a0d-41c8-9f46-42fa8b5c479f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"
Sep 10 22:30:38.582244 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.582223    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc7befe-0a0d-41c8-9f46-42fa8b5c479f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z\" (UID: \"9dc7befe-0a0d-41c8-9f46-42fa8b5c479f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"
Sep 10 22:30:38.631419 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.631320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:38.685507 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.685468    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"
Sep 10 22:30:38.963392 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:38.963369    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"]
Sep 10 22:30:38.966225 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:30:38.966188    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc7befe_0a0d_41c8_9f46_42fa8b5c479f.slice/crio-cd9a5c419c28d17b8a990e357f2c0586e6086e315cc22bc0afcd77b9212214d5 WatchSource:0}: Error finding container cd9a5c419c28d17b8a990e357f2c0586e6086e315cc22bc0afcd77b9212214d5: Status 404 returned error can't find the container with id cd9a5c419c28d17b8a990e357f2c0586e6086e315cc22bc0afcd77b9212214d5
Sep 10 22:30:39.021273 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:39.021243    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z" event={"ID":"9dc7befe-0a0d-41c8-9f46-42fa8b5c479f","Type":"ContainerStarted","Data":"cd9a5c419c28d17b8a990e357f2c0586e6086e315cc22bc0afcd77b9212214d5"}
Sep 10 22:30:40.029102 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:40.029070    2573 generic.go:356] "Generic (PLEG): container finished" podID="9dc7befe-0a0d-41c8-9f46-42fa8b5c479f" containerID="3b69b224b425d73125130b844afab9028c4189386878c159825d181d2541bd7f" exitCode=0
Sep 10 22:30:40.029451 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:40.029154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z" event={"ID":"9dc7befe-0a0d-41c8-9f46-42fa8b5c479f","Type":"ContainerDied","Data":"3b69b224b425d73125130b844afab9028c4189386878c159825d181d2541bd7f"}
Sep 10 22:30:41.164902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:41.164876    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"
Sep 10 22:30:41.306804 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:41.306731    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc7befe-0a0d-41c8-9f46-42fa8b5c479f-maas-api-service-ca\") pod \"9dc7befe-0a0d-41c8-9f46-42fa8b5c479f\" (UID: \"9dc7befe-0a0d-41c8-9f46-42fa8b5c479f\") "
Sep 10 22:30:41.307618 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:41.307585    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc7befe-0a0d-41c8-9f46-42fa8b5c479f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9dc7befe-0a0d-41c8-9f46-42fa8b5c479f" (UID: "9dc7befe-0a0d-41c8-9f46-42fa8b5c479f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:41.408021 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:41.407994    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc7befe-0a0d-41c8-9f46-42fa8b5c479f-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:42.043239 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:42.043209    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"
Sep 10 22:30:42.043418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:42.043252    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z" event={"ID":"9dc7befe-0a0d-41c8-9f46-42fa8b5c479f","Type":"ContainerDied","Data":"cd9a5c419c28d17b8a990e357f2c0586e6086e315cc22bc0afcd77b9212214d5"}
Sep 10 22:30:42.043418 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:42.043297    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd9a5c419c28d17b8a990e357f2c0586e6086e315cc22bc0afcd77b9212214d5"
Sep 10 22:30:43.266144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.266118    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:30:43.427799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.427707    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-data\") pod \"f102dafb-e6c8-44e6-b494-c40d1223bfca\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") "
Sep 10 22:30:43.427799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.427787    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-certs\") pod \"f102dafb-e6c8-44e6-b494-c40d1223bfca\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") "
Sep 10 22:30:43.428042 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.427809    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-credential-socket\") pod \"f102dafb-e6c8-44e6-b494-c40d1223bfca\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") "
Sep 10 22:30:43.428042 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.427892    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5lrw\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-kube-api-access-p5lrw\") pod \"f102dafb-e6c8-44e6-b494-c40d1223bfca\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") "
Sep 10 22:30:43.428042 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.427925    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-podinfo\") pod \"f102dafb-e6c8-44e6-b494-c40d1223bfca\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") "
Sep 10 22:30:43.428042 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.427959    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-envoy\") pod \"f102dafb-e6c8-44e6-b494-c40d1223bfca\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") "
Sep 10 22:30:43.428042 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428007    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-socket\") pod \"f102dafb-e6c8-44e6-b494-c40d1223bfca\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") "
Sep 10 22:30:43.428292 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428050    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-token\") pod \"f102dafb-e6c8-44e6-b494-c40d1223bfca\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") "
Sep 10 22:30:43.428292 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428075    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f102dafb-e6c8-44e6-b494-c40d1223bfca-istiod-ca-cert\") pod \"f102dafb-e6c8-44e6-b494-c40d1223bfca\" (UID: \"f102dafb-e6c8-44e6-b494-c40d1223bfca\") "
Sep 10 22:30:43.428292 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428041    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-data" (OuterVolumeSpecName: "istio-data") pod "f102dafb-e6c8-44e6-b494-c40d1223bfca" (UID: "f102dafb-e6c8-44e6-b494-c40d1223bfca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:43.428292 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428091    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f102dafb-e6c8-44e6-b494-c40d1223bfca" (UID: "f102dafb-e6c8-44e6-b494-c40d1223bfca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:43.428292 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428228    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f102dafb-e6c8-44e6-b494-c40d1223bfca" (UID: "f102dafb-e6c8-44e6-b494-c40d1223bfca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:43.428292 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428278    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f102dafb-e6c8-44e6-b494-c40d1223bfca" (UID: "f102dafb-e6c8-44e6-b494-c40d1223bfca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:43.428515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428468    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:43.428515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428488    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:43.428515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428502    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:43.428515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428515    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:43.428687 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.428531    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f102dafb-e6c8-44e6-b494-c40d1223bfca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f102dafb-e6c8-44e6-b494-c40d1223bfca" (UID: "f102dafb-e6c8-44e6-b494-c40d1223bfca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:43.430121 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.430098    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-token" (OuterVolumeSpecName: "istio-token") pod "f102dafb-e6c8-44e6-b494-c40d1223bfca" (UID: "f102dafb-e6c8-44e6-b494-c40d1223bfca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:43.430339 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.430322    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f102dafb-e6c8-44e6-b494-c40d1223bfca" (UID: "f102dafb-e6c8-44e6-b494-c40d1223bfca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:30:43.430541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.430524    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f102dafb-e6c8-44e6-b494-c40d1223bfca" (UID: "f102dafb-e6c8-44e6-b494-c40d1223bfca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:30:43.430600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.430542    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-kube-api-access-p5lrw" (OuterVolumeSpecName: "kube-api-access-p5lrw") pod "f102dafb-e6c8-44e6-b494-c40d1223bfca" (UID: "f102dafb-e6c8-44e6-b494-c40d1223bfca"). InnerVolumeSpecName "kube-api-access-p5lrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:43.530007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.529972    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5lrw\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-kube-api-access-p5lrw\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:43.530007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.530003    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:43.530007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.530013    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:43.530245 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.530022    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f102dafb-e6c8-44e6-b494-c40d1223bfca-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:43.530245 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:43.530030    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f102dafb-e6c8-44e6-b494-c40d1223bfca-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:30:44.056252 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.056218    2573 generic.go:356] "Generic (PLEG): container finished" podID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerID="818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3" exitCode=0
Sep 10 22:30:44.056493 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.056271    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"
Sep 10 22:30:44.056493 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.056305    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" event={"ID":"f102dafb-e6c8-44e6-b494-c40d1223bfca","Type":"ContainerDied","Data":"818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3"}
Sep 10 22:30:44.056493 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.056365    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h" event={"ID":"f102dafb-e6c8-44e6-b494-c40d1223bfca","Type":"ContainerDied","Data":"007f14f8e218afbe35e4f1fa15b35cf751c14c801aa6847e81d739f01d47698f"}
Sep 10 22:30:44.056493 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.056395    2573 scope.go:117] "RemoveContainer" containerID="818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3"
Sep 10 22:30:44.066674 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.066657    2573 scope.go:117] "RemoveContainer" containerID="cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee"
Sep 10 22:30:44.074821 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.074802    2573 scope.go:117] "RemoveContainer" containerID="818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3"
Sep 10 22:30:44.075233 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:30:44.075178    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3\": container with ID starting with 818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3 not found: ID does not exist" containerID="818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3"
Sep 10 22:30:44.075233 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.075215    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3"} err="failed to get container status \"818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3\": rpc error: code = NotFound desc = could not find container \"818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3\": container with ID starting with 818e769a422fde077d0676f2a2c1e9278fd8223ba2f5122c548fd0a5d51173c3 not found: ID does not exist"
Sep 10 22:30:44.075496 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.075237    2573 scope.go:117] "RemoveContainer" containerID="cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee"
Sep 10 22:30:44.075595 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:30:44.075566    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee\": container with ID starting with cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee not found: ID does not exist" containerID="cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee"
Sep 10 22:30:44.075655 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.075606    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee"} err="failed to get container status \"cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee\": rpc error: code = NotFound desc = could not find container \"cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee\": container with ID starting with cae23034b63318ce4328fbda4e2934b6587268671f0e3019eed4f779d49de4ee not found: ID does not exist"
Sep 10 22:30:44.078729 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.078708    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"]
Sep 10 22:30:44.082022 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.082002    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4a864c-openshift-default-57f54c4fd-5xj5h"]
Sep 10 22:30:44.552944 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:44.552914    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" path="/var/lib/kubelet/pods/f102dafb-e6c8-44e6-b494-c40d1223bfca/volumes"
Sep 10 22:30:48.915538 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:48.915498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:48.920157 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:48.920126    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q"]
Sep 10 22:30:48.922438 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:48.922416    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-32343f-29817990-xq76q"]
Sep 10 22:30:48.986038 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:48.986008    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:49.048372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:49.048345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:49.103585 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:49.103540    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"]
Sep 10 22:30:49.105942 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:49.105917    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-32343f-c867z"]
Sep 10 22:30:49.150007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:49.149972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:49.488311 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:49.488278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:50.553515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:50.553477    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bd97eae-a5cb-4642-b4db-ceff4bbd65c2" path="/var/lib/kubelet/pods/2bd97eae-a5cb-4642-b4db-ceff4bbd65c2/volumes"
Sep 10 22:30:50.553936 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:50.553865    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dc7befe-0a0d-41c8-9f46-42fa8b5c479f" path="/var/lib/kubelet/pods/9dc7befe-0a0d-41c8-9f46-42fa8b5c479f/volumes"
Sep 10 22:30:55.630127 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:55.630086    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:55.699430 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:55.699396    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:55.871609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:55.871576    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"]
Sep 10 22:30:55.871810 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:55.871787    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy" containerID="cri-o://6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97" gracePeriod=30
Sep 10 22:30:55.892781 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:30:55.892693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:01.120541 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.120512    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:31:01.160402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.160317    2573 generic.go:356] "Generic (PLEG): container finished" podID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerID="6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97" exitCode=0
Sep 10 22:31:01.160402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.160378    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"
Sep 10 22:31:01.160402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.160395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" event={"ID":"dfa4609b-9840-4d69-81eb-9645e64da5b1","Type":"ContainerDied","Data":"6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97"}
Sep 10 22:31:01.160722 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.160453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w" event={"ID":"dfa4609b-9840-4d69-81eb-9645e64da5b1","Type":"ContainerDied","Data":"3c4f30a93ac9e6e9206550db5ccc42a4b083b1fc0027dbc92a8f676743803fbd"}
Sep 10 22:31:01.160722 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.160489    2573 scope.go:117] "RemoveContainer" containerID="6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97"
Sep 10 22:31:01.169943 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.169923    2573 scope.go:117] "RemoveContainer" containerID="6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a"
Sep 10 22:31:01.178120 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.178105    2573 scope.go:117] "RemoveContainer" containerID="6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97"
Sep 10 22:31:01.178421 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:31:01.178398    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97\": container with ID starting with 6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97 not found: ID does not exist" containerID="6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97"
Sep 10 22:31:01.178468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.178431    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97"} err="failed to get container status \"6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97\": rpc error: code = NotFound desc = could not find container \"6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97\": container with ID starting with 6d628fad0a14d0b8fc4a963bd27293115e8f135459532ec0464b5c4e9b238e97 not found: ID does not exist"
Sep 10 22:31:01.178468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.178448    2573 scope.go:117] "RemoveContainer" containerID="6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a"
Sep 10 22:31:01.178700 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:31:01.178681    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a\": container with ID starting with 6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a not found: ID does not exist" containerID="6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a"
Sep 10 22:31:01.178743 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.178706    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a"} err="failed to get container status \"6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a\": rpc error: code = NotFound desc = could not find container \"6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a\": container with ID starting with 6ff82021cbe3f2bb07b41e115cb03595066ec685e97c8caeef6d9d524be0f29a not found: ID does not exist"
Sep 10 22:31:01.199084 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199056    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-envoy\") pod \"dfa4609b-9840-4d69-81eb-9645e64da5b1\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") "
Sep 10 22:31:01.199161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199096    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-token\") pod \"dfa4609b-9840-4d69-81eb-9645e64da5b1\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") "
Sep 10 22:31:01.199161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199121    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4609b-9840-4d69-81eb-9645e64da5b1-istiod-ca-cert\") pod \"dfa4609b-9840-4d69-81eb-9645e64da5b1\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") "
Sep 10 22:31:01.199161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199146    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-certs\") pod \"dfa4609b-9840-4d69-81eb-9645e64da5b1\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") "
Sep 10 22:31:01.199289 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199267    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-data\") pod \"dfa4609b-9840-4d69-81eb-9645e64da5b1\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") "
Sep 10 22:31:01.199350 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199334    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfxnc\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-kube-api-access-qfxnc\") pod \"dfa4609b-9840-4d69-81eb-9645e64da5b1\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") "
Sep 10 22:31:01.199414 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199393    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfa4609b-9840-4d69-81eb-9645e64da5b1" (UID: "dfa4609b-9840-4d69-81eb-9645e64da5b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.199414 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199408    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-podinfo\") pod \"dfa4609b-9840-4d69-81eb-9645e64da5b1\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") "
Sep 10 22:31:01.199529 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199443    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-socket\") pod \"dfa4609b-9840-4d69-81eb-9645e64da5b1\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") "
Sep 10 22:31:01.199529 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199482    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-credential-socket\") pod \"dfa4609b-9840-4d69-81eb-9645e64da5b1\" (UID: \"dfa4609b-9840-4d69-81eb-9645e64da5b1\") "
Sep 10 22:31:01.199646 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199527    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfa4609b-9840-4d69-81eb-9645e64da5b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfa4609b-9840-4d69-81eb-9645e64da5b1" (UID: "dfa4609b-9840-4d69-81eb-9645e64da5b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:31:01.199646 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199534    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfa4609b-9840-4d69-81eb-9645e64da5b1" (UID: "dfa4609b-9840-4d69-81eb-9645e64da5b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.199772 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199744    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfa4609b-9840-4d69-81eb-9645e64da5b1" (UID: "dfa4609b-9840-4d69-81eb-9645e64da5b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.199868 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199816    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfa4609b-9840-4d69-81eb-9645e64da5b1" (UID: "dfa4609b-9840-4d69-81eb-9645e64da5b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.199922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199891    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa4609b-9840-4d69-81eb-9645e64da5b1-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.199922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199903    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.199922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199911    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.199922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.199918    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.201400 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.201369    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-kube-api-access-qfxnc" (OuterVolumeSpecName: "kube-api-access-qfxnc") pod "dfa4609b-9840-4d69-81eb-9645e64da5b1" (UID: "dfa4609b-9840-4d69-81eb-9645e64da5b1"). InnerVolumeSpecName "kube-api-access-qfxnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:01.201495 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.201446    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfa4609b-9840-4d69-81eb-9645e64da5b1" (UID: "dfa4609b-9840-4d69-81eb-9645e64da5b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:31:01.201600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.201580    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfa4609b-9840-4d69-81eb-9645e64da5b1" (UID: "dfa4609b-9840-4d69-81eb-9645e64da5b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:01.201690 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.201667    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfa4609b-9840-4d69-81eb-9645e64da5b1" (UID: "dfa4609b-9840-4d69-81eb-9645e64da5b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.301129 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.301083    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.301129 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.301122    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.301129 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.301132    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfxnc\" (UniqueName: \"kubernetes.io/projected/dfa4609b-9840-4d69-81eb-9645e64da5b1-kube-api-access-qfxnc\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.301129 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.301142    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa4609b-9840-4d69-81eb-9645e64da5b1-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.301399 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.301151    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa4609b-9840-4d69-81eb-9645e64da5b1-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.483099 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.483056    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"]
Sep 10 22:31:01.487403 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:01.487379    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32343f-openshift-default-7cf664c866-nwh4w"]
Sep 10 22:31:02.552629 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:02.552598    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" path="/var/lib/kubelet/pods/dfa4609b-9840-4d69-81eb-9645e64da5b1/volumes"
Sep 10 22:31:09.536344 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:09.536312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:12.118747 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:12.118714    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:12.762532 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:12.762506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:13.185911 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.185820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:13.488043 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488014    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"]
Sep 10 22:31:13.488401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488389    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy"
Sep 10 22:31:13.488472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488402    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy"
Sep 10 22:31:13.488472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488420    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy"
Sep 10 22:31:13.488472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488427    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy"
Sep 10 22:31:13.488472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488433    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy"
Sep 10 22:31:13.488472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488438    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy"
Sep 10 22:31:13.488472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488452    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy"
Sep 10 22:31:13.488472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488457    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy"
Sep 10 22:31:13.488472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488467    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dc7befe-0a0d-41c8-9f46-42fa8b5c479f" containerName="revoke-keys"
Sep 10 22:31:13.488472 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488473    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dc7befe-0a0d-41c8-9f46-42fa8b5c479f" containerName="revoke-keys"
Sep 10 22:31:13.488782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488526    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy"
Sep 10 22:31:13.488782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488533    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy"
Sep 10 22:31:13.488782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488538    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dc7befe-0a0d-41c8-9f46-42fa8b5c479f" containerName="revoke-keys"
Sep 10 22:31:13.488782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488546    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f102dafb-e6c8-44e6-b494-c40d1223bfca" containerName="istio-proxy"
Sep 10 22:31:13.488782 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.488551    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa4609b-9840-4d69-81eb-9645e64da5b1" containerName="istio-proxy"
Sep 10 22:31:13.493152 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.493130    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.495537 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.495513    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-25241d-openshift-default-dockercfg-z7rwl\""
Sep 10 22:31:13.502223 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.502198    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"]
Sep 10 22:31:13.516490 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.516468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:13.614487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.614456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-certs\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.614648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.614505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-socket\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.614648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.614543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-credential-socket\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.614648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.614599    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-podinfo\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.614648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.614626    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdpvc\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-kube-api-access-xdpvc\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.614792 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.614750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istiod-ca-cert\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.614865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.614796    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-token\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.614865 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.614829    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-data\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.614952 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.614928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-envoy\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.616801 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.616777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:13.716258 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-podinfo\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716258 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdpvc\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-kube-api-access-xdpvc\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716480 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istiod-ca-cert\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716480 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-token\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716480 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716341    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-data\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716480 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716366    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-envoy\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716480 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-certs\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716480 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716456    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-socket\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716789 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-credential-socket\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716874 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-data\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716936 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716884    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-socket\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.716981 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.716953    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-credential-socket\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.717120 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.717102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istiod-ca-cert\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.717189 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.717144    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-certs\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.718778 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.718758    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-envoy\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.718946 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.718927    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-podinfo\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.724150 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.724120    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdpvc\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-kube-api-access-xdpvc\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.725020 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.725001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-token\") pod \"e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") " pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:13.803969 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:13.803897    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:14.077966 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:14.077937    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"]
Sep 10 22:31:14.080112 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:31:14.080086    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7fbbda_a4d7_4968_adce_4e6c25ff0951.slice/crio-e945593202fc50bc9c462c8d25b59aabb8eaec2262aae44d304db0fe3fa6f262 WatchSource:0}: Error finding container e945593202fc50bc9c462c8d25b59aabb8eaec2262aae44d304db0fe3fa6f262: Status 404 returned error can't find the container with id e945593202fc50bc9c462c8d25b59aabb8eaec2262aae44d304db0fe3fa6f262
Sep 10 22:31:14.082368 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:14.082336    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:31:14.082464 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:14.082401    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:31:14.082464 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:14.082429    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:31:14.235728 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:14.235692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" event={"ID":"bc7fbbda-a4d7-4968-adce-4e6c25ff0951","Type":"ContainerStarted","Data":"692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8"}
Sep 10 22:31:14.236228 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:14.235753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" event={"ID":"bc7fbbda-a4d7-4968-adce-4e6c25ff0951","Type":"ContainerStarted","Data":"e945593202fc50bc9c462c8d25b59aabb8eaec2262aae44d304db0fe3fa6f262"}
Sep 10 22:31:14.252925 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:14.252870    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" podStartSLOduration=1.252819546 podStartE2EDuration="1.252819546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:14.251006234 +0000 UTC m=+1554.133490610" watchObservedRunningTime="2026-09-10 22:31:14.252819546 +0000 UTC m=+1554.135303934"
Sep 10 22:31:14.805007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:14.804973    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:15.809581 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:15.809550    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:16.135683 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:16.135562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:16.233326 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:16.233293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:16.247331 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:16.247302    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:16.248149 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:16.248128    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:17.284181 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.284153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:17.384688 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.384657    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:17.484288 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.484258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:17.773165 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.773136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:17.876875 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.872927    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:17.877558 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.877524    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"]
Sep 10 22:31:17.882810 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.882786    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:17.886912 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.886894    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-25241d\""
Sep 10 22:31:17.887588 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.887572    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-25241d-dockercfg-5754c\""
Sep 10 22:31:17.898754 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.898734    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"]
Sep 10 22:31:17.912822 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.912795    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"]
Sep 10 22:31:17.916139 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.916120    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:17.929673 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.929649    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"]
Sep 10 22:31:17.956400 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.956372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvpcn\" (UniqueName: \"kubernetes.io/projected/679bce86-6ba8-4ac0-af36-c38035af5630-kube-api-access-jvpcn\") pod \"payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq\" (UID: \"679bce86-6ba8-4ac0-af36-c38035af5630\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:17.956523 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:17.956423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/679bce86-6ba8-4ac0-af36-c38035af5630-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq\" (UID: \"679bce86-6ba8-4ac0-af36-c38035af5630\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:18.057279 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.057189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvpcn\" (UniqueName: \"kubernetes.io/projected/679bce86-6ba8-4ac0-af36-c38035af5630-kube-api-access-jvpcn\") pod \"payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq\" (UID: \"679bce86-6ba8-4ac0-af36-c38035af5630\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:18.057279 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.057237    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/679bce86-6ba8-4ac0-af36-c38035af5630-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq\" (UID: \"679bce86-6ba8-4ac0-af36-c38035af5630\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:18.057519 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.057348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be20c194-53f8-4fcf-841a-b0944cc681c6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf\" (UID: \"be20c194-53f8-4fcf-841a-b0944cc681c6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:18.057519 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.057388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-799hd\" (UniqueName: \"kubernetes.io/projected/be20c194-53f8-4fcf-841a-b0944cc681c6-kube-api-access-799hd\") pod \"payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf\" (UID: \"be20c194-53f8-4fcf-841a-b0944cc681c6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:18.058029 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.058009    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/679bce86-6ba8-4ac0-af36-c38035af5630-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq\" (UID: \"679bce86-6ba8-4ac0-af36-c38035af5630\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:18.064463 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.064439    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvpcn\" (UniqueName: \"kubernetes.io/projected/679bce86-6ba8-4ac0-af36-c38035af5630-kube-api-access-jvpcn\") pod \"payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq\" (UID: \"679bce86-6ba8-4ac0-af36-c38035af5630\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:18.158439 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.158403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be20c194-53f8-4fcf-841a-b0944cc681c6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf\" (UID: \"be20c194-53f8-4fcf-841a-b0944cc681c6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:18.158604 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.158462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-799hd\" (UniqueName: \"kubernetes.io/projected/be20c194-53f8-4fcf-841a-b0944cc681c6-kube-api-access-799hd\") pod \"payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf\" (UID: \"be20c194-53f8-4fcf-841a-b0944cc681c6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:18.159114 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.159094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be20c194-53f8-4fcf-841a-b0944cc681c6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf\" (UID: \"be20c194-53f8-4fcf-841a-b0944cc681c6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:18.165914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.165890    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-799hd\" (UniqueName: \"kubernetes.io/projected/be20c194-53f8-4fcf-841a-b0944cc681c6-kube-api-access-799hd\") pod \"payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf\" (UID: \"be20c194-53f8-4fcf-841a-b0944cc681c6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:18.192815 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.192789    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:18.226918 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.226891    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:18.464571 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.464541    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"]
Sep 10 22:31:18.466165 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:31:18.466139    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679bce86_6ba8_4ac0_af36_c38035af5630.slice/crio-97b6ef413a8175e050a0884bc848366272d64a383680b35dd28ca32f15c34325 WatchSource:0}: Error finding container 97b6ef413a8175e050a0884bc848366272d64a383680b35dd28ca32f15c34325: Status 404 returned error can't find the container with id 97b6ef413a8175e050a0884bc848366272d64a383680b35dd28ca32f15c34325
Sep 10 22:31:18.507391 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:18.507369    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"]
Sep 10 22:31:18.509578 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:31:18.509555    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe20c194_53f8_4fcf_841a_b0944cc681c6.slice/crio-a72ba44e4462bf4f16ed251bdda1d6229479e0f867f0d103a8ca1e1e08121083 WatchSource:0}: Error finding container a72ba44e4462bf4f16ed251bdda1d6229479e0f867f0d103a8ca1e1e08121083: Status 404 returned error can't find the container with id a72ba44e4462bf4f16ed251bdda1d6229479e0f867f0d103a8ca1e1e08121083
Sep 10 22:31:19.272586 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:19.272548    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq" event={"ID":"679bce86-6ba8-4ac0-af36-c38035af5630","Type":"ContainerStarted","Data":"d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555"}
Sep 10 22:31:19.272773 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:19.272615    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq" event={"ID":"679bce86-6ba8-4ac0-af36-c38035af5630","Type":"ContainerStarted","Data":"97b6ef413a8175e050a0884bc848366272d64a383680b35dd28ca32f15c34325"}
Sep 10 22:31:19.272773 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:19.272648    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:19.274173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:19.274145    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf" event={"ID":"be20c194-53f8-4fcf-841a-b0944cc681c6","Type":"ContainerStarted","Data":"6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d"}
Sep 10 22:31:19.274314 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:19.274191    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf" event={"ID":"be20c194-53f8-4fcf-841a-b0944cc681c6","Type":"ContainerStarted","Data":"a72ba44e4462bf4f16ed251bdda1d6229479e0f867f0d103a8ca1e1e08121083"}
Sep 10 22:31:19.274314 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:19.274217    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:19.289077 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:19.289033    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq" podStartSLOduration=2.28901803 podStartE2EDuration="2.28901803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:19.287577204 +0000 UTC m=+1559.170061572" watchObservedRunningTime="2026-09-10 22:31:19.28901803 +0000 UTC m=+1559.171502395"
Sep 10 22:31:19.303030 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:19.302988    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf" podStartSLOduration=2.3029725340000002 podStartE2EDuration="2.302972534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:19.301537103 +0000 UTC m=+1559.184021471" watchObservedRunningTime="2026-09-10 22:31:19.302972534 +0000 UTC m=+1559.185456900"
Sep 10 22:31:30.282097 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:30.282063    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:31:30.282590 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:30.282568    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:31:31.249020 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:31.248994    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 22:31:31.249158 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:31.249048    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 22:31:31.356601 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:31.356568    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerID="692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8" exitCode=0
Sep 10 22:31:31.356985 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:31.356641    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" event={"ID":"bc7fbbda-a4d7-4968-adce-4e6c25ff0951","Type":"ContainerDied","Data":"692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8"}
Sep 10 22:31:31.357064 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:31.357029    2573 scope.go:117] "RemoveContainer" containerID="692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8"
Sep 10 22:31:31.358066 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:31.358041    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:31:31.358132 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:31.358102    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:31:31.358170 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:31.358133    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:31:32.364755 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:32.364723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" event={"ID":"bc7fbbda-a4d7-4968-adce-4e6c25ff0951","Type":"ContainerStarted","Data":"cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a"}
Sep 10 22:31:32.804543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:32.804508    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:32.804963 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:32.804866    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 22:31:32.805157 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:32.805130    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 22:31:33.804639 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:33.804602    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 22:31:33.805655 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:33.805254    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 22:31:34.804973 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:34.804930    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 22:31:34.805489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:34.804998    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 22:31:35.805342 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:35.805300    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 22:31:35.805866 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:35.805385    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 22:31:36.805098 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:36.805059    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 10 22:31:36.805297 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:36.805126    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 10 22:31:37.808137 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:37.808108    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:37.808607 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:37.808503    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:37.809257 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:37.809239    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:31:41.142921 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:41.142874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:41.815776 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:41.815717    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:42.176636 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:42.176559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:42.282528 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:42.282482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:44.800360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:44.800324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:44.898289 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:44.898257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:45.943207 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:45.943172    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:46.051046 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.051012    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:46.409914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.409884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:46.504035 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.504002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:46.509967 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.509941    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"]
Sep 10 22:31:46.514554 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.514536    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:31:46.516630 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.516604    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-9b2092\""
Sep 10 22:31:46.516735 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.516682    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-9b2092-dockercfg-fxhb6\""
Sep 10 22:31:46.525522 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.525495    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"]
Sep 10 22:31:46.627658 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.627618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b\" (UID: \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:31:46.627875 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.627787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8cjd\" (UniqueName: \"kubernetes.io/projected/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-kube-api-access-d8cjd\") pod \"payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b\" (UID: \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:31:46.729113 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.729075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cjd\" (UniqueName: \"kubernetes.io/projected/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-kube-api-access-d8cjd\") pod \"payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b\" (UID: \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:31:46.729296 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.729178    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b\" (UID: \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:31:46.729874 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.729822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b\" (UID: \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:31:46.736334 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.736311    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8cjd\" (UniqueName: \"kubernetes.io/projected/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-kube-api-access-d8cjd\") pod \"payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b\" (UID: \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:31:46.826440 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:46.826417    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:31:47.098808 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:47.098778    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"]
Sep 10 22:31:47.100436 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:31:47.100407    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7157d9_87ff_4bb9_ae3e_af78adb44f45.slice/crio-3c9a7d7a730931d9dcc7934fe6d2f2d60115fac657b86e6aea9acd9fa20d31ad WatchSource:0}: Error finding container 3c9a7d7a730931d9dcc7934fe6d2f2d60115fac657b86e6aea9acd9fa20d31ad: Status 404 returned error can't find the container with id 3c9a7d7a730931d9dcc7934fe6d2f2d60115fac657b86e6aea9acd9fa20d31ad
Sep 10 22:31:47.455213 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:47.455120    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b" event={"ID":"fe7157d9-87ff-4bb9-ae3e-af78adb44f45","Type":"ContainerStarted","Data":"bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b"}
Sep 10 22:31:47.455213 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:47.455170    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b" event={"ID":"fe7157d9-87ff-4bb9-ae3e-af78adb44f45","Type":"ContainerStarted","Data":"3c9a7d7a730931d9dcc7934fe6d2f2d60115fac657b86e6aea9acd9fa20d31ad"}
Sep 10 22:31:47.455432 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:47.455268    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:31:47.469061 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:47.468997    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b" podStartSLOduration=1.468976239 podStartE2EDuration="1.468976239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:47.468399833 +0000 UTC m=+1587.350884200" watchObservedRunningTime="2026-09-10 22:31:47.468976239 +0000 UTC m=+1587.351460607"
Sep 10 22:31:58.463528 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:31:58.463500    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:32:09.769144 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:09.769109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:14.810060 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:14.809948    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2rcbw_630e1db1-b0aa-4af2-9a0b-428332191632/payload-processing/0.log"
Sep 10 22:32:20.317262 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:20.317222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:45.377681 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:45.377644    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf_be20c194-53f8-4fcf-841a-b0944cc681c6/payload-processing/0.log"
Sep 10 22:32:45.499137 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:45.499112    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2rcbw_630e1db1-b0aa-4af2-9a0b-428332191632/payload-processing/0.log"
Sep 10 22:32:45.887372 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:45.887333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:46.151819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.151725    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"]
Sep 10 22:32:46.155648 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.155623    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.158128 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.158107    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-5567cc-openshift-default-dockercfg-8gb54\""
Sep 10 22:32:46.167984 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.167961    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"]
Sep 10 22:32:46.180013 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.179989    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:46.276007 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.275967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-data\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.276358 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.276335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-envoy\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.276675 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.276611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5051646c-fe1a-47b2-a872-13c5a7745e15-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.276862 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.276831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-socket\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.276989 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.276976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-certs\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.277149 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.277135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-credential-socket\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.277293 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.277279    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-podinfo\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.277412 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.277399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-token\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.277539 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.277525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kptfd\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-kube-api-access-kptfd\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379143 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-credential-socket\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-podinfo\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379173    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-token\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kptfd\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-kube-api-access-kptfd\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-data\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-envoy\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5051646c-fe1a-47b2-a872-13c5a7745e15-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-socket\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-certs\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.379577 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-credential-socket\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.380005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.379770    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-certs\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.380354 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.380320    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-data\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.380465 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.380357    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-socket\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.380529 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.380500    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5051646c-fe1a-47b2-a872-13c5a7745e15-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.382411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.382385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-podinfo\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.382581 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.382556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-envoy\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.387223 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.387126    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-token\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.387815 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.387788    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kptfd\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-kube-api-access-kptfd\") pod \"e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") " pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.462492 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.462431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:46.468434 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.468408    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:46.747369 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.747345    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"]
Sep 10 22:32:46.748675 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:32:46.748649    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5051646c_fe1a_47b2_a872_13c5a7745e15.slice/crio-709f9138d11d5a32239d3254f10704bacc3a182f431a66cebc7a4d2fb193fe9b WatchSource:0}: Error finding container 709f9138d11d5a32239d3254f10704bacc3a182f431a66cebc7a4d2fb193fe9b: Status 404 returned error can't find the container with id 709f9138d11d5a32239d3254f10704bacc3a182f431a66cebc7a4d2fb193fe9b
Sep 10 22:32:46.750813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.750780    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:32:46.750914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.750860    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:32:46.750914 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.750894    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:32:46.820426 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.820394    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" event={"ID":"5051646c-fe1a-47b2-a872-13c5a7745e15","Type":"ContainerStarted","Data":"2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456"}
Sep 10 22:32:46.820560 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.820448    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" event={"ID":"5051646c-fe1a-47b2-a872-13c5a7745e15","Type":"ContainerStarted","Data":"709f9138d11d5a32239d3254f10704bacc3a182f431a66cebc7a4d2fb193fe9b"}
Sep 10 22:32:46.839550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:46.839499    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" podStartSLOduration=0.839483013 podStartE2EDuration="839.483013ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:32:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:32:46.83732683 +0000 UTC m=+1646.719811197" watchObservedRunningTime="2026-09-10 22:32:46.839483013 +0000 UTC m=+1646.721967434"
Sep 10 22:32:47.468595 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:47.468560    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:47.473690 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:47.473664    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:47.826759 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:47.826731    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:47.827829 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:47.827805    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:32:48.738481 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:48.738450    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:48.835976 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:48.835944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:50.048896 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.048862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:50.108333 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.108302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:50.298606 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.298570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:50.512803 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.512769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:50.614331 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.614283    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:50.661738 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.661708    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"]
Sep 10 22:32:50.665260 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.665241    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:32:50.667296 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.667277    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-5567cc\""
Sep 10 22:32:50.667402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.667313    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-5567cc-dockercfg-7f542\""
Sep 10 22:32:50.678111 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.678086    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"]
Sep 10 22:32:50.818554 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.818471    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx\" (UID: \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:32:50.818554 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.818543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htshn\" (UniqueName: \"kubernetes.io/projected/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-kube-api-access-htshn\") pod \"payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx\" (UID: \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:32:50.919530 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.919496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htshn\" (UniqueName: \"kubernetes.io/projected/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-kube-api-access-htshn\") pod \"payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx\" (UID: \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:32:50.919682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.919587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx\" (UID: \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:32:50.920236 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.920218    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx\" (UID: \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:32:50.926935 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.926913    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htshn\" (UniqueName: \"kubernetes.io/projected/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-kube-api-access-htshn\") pod \"payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx\" (UID: \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:32:50.977063 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:50.977037    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:32:51.252961 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:51.252911    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"]
Sep 10 22:32:51.255264 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:32:51.255240    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2588a4_ba21_4065_b2f1_8f0f223a48ab.slice/crio-102f2e39787cd1ef80bb86a747a7048366707f0d08c22493ca2d84ec67240ccf WatchSource:0}: Error finding container 102f2e39787cd1ef80bb86a747a7048366707f0d08c22493ca2d84ec67240ccf: Status 404 returned error can't find the container with id 102f2e39787cd1ef80bb86a747a7048366707f0d08c22493ca2d84ec67240ccf
Sep 10 22:32:51.851883 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:51.851833    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx" event={"ID":"9c2588a4-ba21-4065-b2f1-8f0f223a48ab","Type":"ContainerStarted","Data":"44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9"}
Sep 10 22:32:51.852092 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:51.851908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx" event={"ID":"9c2588a4-ba21-4065-b2f1-8f0f223a48ab","Type":"ContainerStarted","Data":"102f2e39787cd1ef80bb86a747a7048366707f0d08c22493ca2d84ec67240ccf"}
Sep 10 22:32:51.852092 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:51.851933    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:32:51.870438 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:51.870387    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx" podStartSLOduration=1.8703734650000001 podStartE2EDuration="1.870373465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:32:51.867102644 +0000 UTC m=+1651.749587016" watchObservedRunningTime="2026-09-10 22:32:51.870373465 +0000 UTC m=+1651.752857834"
Sep 10 22:32:58.004055 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:58.004023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:58.056370 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:32:58.056344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:02.859967 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:02.859925    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:33:08.968653 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:08.968615    2573 generic.go:356] "Generic (PLEG): container finished" podID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerID="2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456" exitCode=0
Sep 10 22:33:08.969096 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:08.968665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" event={"ID":"5051646c-fe1a-47b2-a872-13c5a7745e15","Type":"ContainerDied","Data":"2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456"}
Sep 10 22:33:08.969096 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:08.969089    2573 scope.go:117] "RemoveContainer" containerID="2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456"
Sep 10 22:33:08.970322 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:08.970295    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:33:08.970389 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:08.970363    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:33:08.970426 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:08.970393    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 22:33:09.024570 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:09.024539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:09.125427 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:09.125391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:09.976718 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:09.976680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" event={"ID":"5051646c-fe1a-47b2-a872-13c5a7745e15","Type":"ContainerStarted","Data":"5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e"}
Sep 10 22:33:10.469163 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:10.469058    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:33:10.469360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:10.469249    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 10 22:33:10.469360 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:10.469309    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 10 22:33:11.469065 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:11.469026    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 10 22:33:11.469543 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:11.469093    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 10 22:33:12.469536 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:12.469495    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 10 22:33:12.469986 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:12.469569    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 10 22:33:13.469159 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:13.469119    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 10 22:33:13.469327 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:13.469188    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 10 22:33:13.716368 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:13.716331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:14.468916 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:14.468880    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 10 22:33:14.469096 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:14.468933    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 10 22:33:15.472932 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:15.472900    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:33:15.473365 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:15.473187    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:33:15.473721 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:15.473700    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:33:20.568427 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:20.568375    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:20.597636 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:20.597593    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"]
Sep 10 22:33:20.597954 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:20.597922    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx" podUID="9c2588a4-ba21-4065-b2f1-8f0f223a48ab" containerName="payload-processing" containerID="cri-o://44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9" gracePeriod=30
Sep 10 22:33:20.668188 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:20.668147    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:20.758064 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:20.758030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:20.827284 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:20.827254    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:20.847981 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:20.847955    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:33:20.894239 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:20.894207    2573 scope.go:117] "RemoveContainer" containerID="3bad528d8bc4ce7439231a08b0a275df5503aefc9e43aa8c367c1ded5ffc5d32"
Sep 10 22:33:21.013639 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.013602    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-plugins-config-volume\") pod \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\" (UID: \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\") "
Sep 10 22:33:21.013639 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.013641    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htshn\" (UniqueName: \"kubernetes.io/projected/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-kube-api-access-htshn\") pod \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\" (UID: \"9c2588a4-ba21-4065-b2f1-8f0f223a48ab\") "
Sep 10 22:33:21.014036 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.014001    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c2588a4-ba21-4065-b2f1-8f0f223a48ab" (UID: "9c2588a4-ba21-4065-b2f1-8f0f223a48ab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:33:21.016045 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.016021    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-kube-api-access-htshn" (OuterVolumeSpecName: "kube-api-access-htshn") pod "9c2588a4-ba21-4065-b2f1-8f0f223a48ab" (UID: "9c2588a4-ba21-4065-b2f1-8f0f223a48ab"). InnerVolumeSpecName "kube-api-access-htshn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:33:21.053857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.053801    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c2588a4-ba21-4065-b2f1-8f0f223a48ab" containerID="44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9" exitCode=0
Sep 10 22:33:21.053857 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.053855    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"
Sep 10 22:33:21.054072 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.053888    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx" event={"ID":"9c2588a4-ba21-4065-b2f1-8f0f223a48ab","Type":"ContainerDied","Data":"44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9"}
Sep 10 22:33:21.054072 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.053944    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx" event={"ID":"9c2588a4-ba21-4065-b2f1-8f0f223a48ab","Type":"ContainerDied","Data":"102f2e39787cd1ef80bb86a747a7048366707f0d08c22493ca2d84ec67240ccf"}
Sep 10 22:33:21.054072 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.053976    2573 scope.go:117] "RemoveContainer" containerID="44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9"
Sep 10 22:33:21.071751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.071730    2573 scope.go:117] "RemoveContainer" containerID="44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9"
Sep 10 22:33:21.072114 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:33:21.072093    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9\": container with ID starting with 44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9 not found: ID does not exist" containerID="44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9"
Sep 10 22:33:21.072169 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.072140    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9"} err="failed to get container status \"44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9\": rpc error: code = NotFound desc = could not find container \"44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9\": container with ID starting with 44057b1f97bfa544c2fd49087b243f3411a0d52acf8a496c4ca98525da8ec9f9 not found: ID does not exist"
Sep 10 22:33:21.083615 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.083533    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"]
Sep 10 22:33:21.086967 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.086939    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-5567cc-6c84bc747c-lsvcx"]
Sep 10 22:33:21.115508 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.115468    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:21.115508 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.115503    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htshn\" (UniqueName: \"kubernetes.io/projected/9c2588a4-ba21-4065-b2f1-8f0f223a48ab-kube-api-access-htshn\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:21.143784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:21.143751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:22.554174 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:22.554139    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c2588a4-ba21-4065-b2f1-8f0f223a48ab" path="/var/lib/kubelet/pods/9c2588a4-ba21-4065-b2f1-8f0f223a48ab/volumes"
Sep 10 22:33:26.927157 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:26.927125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:26.998245 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:26.998211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:27.179327 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:27.179237    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"]
Sep 10 22:33:27.179516 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:27.179448    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy" containerID="cri-o://5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e" gracePeriod=30
Sep 10 22:33:27.255059 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:27.255018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:30.476600 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.476561    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:33:30.476999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.476636    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:33:30.845100 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.845016    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"]
Sep 10 22:33:30.845452 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.845439    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c2588a4-ba21-4065-b2f1-8f0f223a48ab" containerName="payload-processing"
Sep 10 22:33:30.845501 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.845453    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2588a4-ba21-4065-b2f1-8f0f223a48ab" containerName="payload-processing"
Sep 10 22:33:30.845536 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.845530    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c2588a4-ba21-4065-b2f1-8f0f223a48ab" containerName="payload-processing"
Sep 10 22:33:30.848976 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.848956    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"
Sep 10 22:33:30.851283 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.851263    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:33:30.856178 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.856135    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"]
Sep 10 22:33:30.937726 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:30.937672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:31.016881 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:31.016831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168e512f-5caf-4b75-aee8-9648ead31ed4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7\" (UID: \"168e512f-5caf-4b75-aee8-9648ead31ed4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"
Sep 10 22:33:31.118169 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:31.118062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168e512f-5caf-4b75-aee8-9648ead31ed4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7\" (UID: \"168e512f-5caf-4b75-aee8-9648ead31ed4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"
Sep 10 22:33:31.118708 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:31.118686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168e512f-5caf-4b75-aee8-9648ead31ed4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7\" (UID: \"168e512f-5caf-4b75-aee8-9648ead31ed4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"
Sep 10 22:33:31.161040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:31.160984    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"
Sep 10 22:33:31.442340 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:31.442312    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"]
Sep 10 22:33:31.444161 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:33:31.444131    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168e512f_5caf_4b75_aee8_9648ead31ed4.slice/crio-222438f20910924a6a5b6d7f129a7ae2edce02eba03e09cac8e205f20c9d795b WatchSource:0}: Error finding container 222438f20910924a6a5b6d7f129a7ae2edce02eba03e09cac8e205f20c9d795b: Status 404 returned error can't find the container with id 222438f20910924a6a5b6d7f129a7ae2edce02eba03e09cac8e205f20c9d795b
Sep 10 22:33:32.130737 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:33:32.130703    2573 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168e512f_5caf_4b75_aee8_9648ead31ed4.slice/crio-conmon-edb5de2b2bdd7ebe2ddfef2dbf3cde339b01915916b33893a1fdddc79ac7b692.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:33:32.134045 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.134015    2573 generic.go:356] "Generic (PLEG): container finished" podID="168e512f-5caf-4b75-aee8-9648ead31ed4" containerID="edb5de2b2bdd7ebe2ddfef2dbf3cde339b01915916b33893a1fdddc79ac7b692" exitCode=0
Sep 10 22:33:32.134200 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.134097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7" event={"ID":"168e512f-5caf-4b75-aee8-9648ead31ed4","Type":"ContainerDied","Data":"edb5de2b2bdd7ebe2ddfef2dbf3cde339b01915916b33893a1fdddc79ac7b692"}
Sep 10 22:33:32.134200 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.134193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7" event={"ID":"168e512f-5caf-4b75-aee8-9648ead31ed4","Type":"ContainerStarted","Data":"222438f20910924a6a5b6d7f129a7ae2edce02eba03e09cac8e205f20c9d795b"}
Sep 10 22:33:32.431170 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.431139    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:33:32.529950 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.529910    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-envoy\") pod \"5051646c-fe1a-47b2-a872-13c5a7745e15\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") "
Sep 10 22:33:32.529950 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.529958    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-token\") pod \"5051646c-fe1a-47b2-a872-13c5a7745e15\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") "
Sep 10 22:33:32.530209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.529976    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-data\") pod \"5051646c-fe1a-47b2-a872-13c5a7745e15\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") "
Sep 10 22:33:32.530209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530003    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-socket\") pod \"5051646c-fe1a-47b2-a872-13c5a7745e15\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") "
Sep 10 22:33:32.530209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530021    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kptfd\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-kube-api-access-kptfd\") pod \"5051646c-fe1a-47b2-a872-13c5a7745e15\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") "
Sep 10 22:33:32.530209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530062    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-certs\") pod \"5051646c-fe1a-47b2-a872-13c5a7745e15\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") "
Sep 10 22:33:32.530209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-podinfo\") pod \"5051646c-fe1a-47b2-a872-13c5a7745e15\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") "
Sep 10 22:33:32.530209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530121    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5051646c-fe1a-47b2-a872-13c5a7745e15-istiod-ca-cert\") pod \"5051646c-fe1a-47b2-a872-13c5a7745e15\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") "
Sep 10 22:33:32.530209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530154    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-credential-socket\") pod \"5051646c-fe1a-47b2-a872-13c5a7745e15\" (UID: \"5051646c-fe1a-47b2-a872-13c5a7745e15\") "
Sep 10 22:33:32.530568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530318    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-data" (OuterVolumeSpecName: "istio-data") pod "5051646c-fe1a-47b2-a872-13c5a7745e15" (UID: "5051646c-fe1a-47b2-a872-13c5a7745e15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:32.530568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530383    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5051646c-fe1a-47b2-a872-13c5a7745e15" (UID: "5051646c-fe1a-47b2-a872-13c5a7745e15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:32.530568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530400    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5051646c-fe1a-47b2-a872-13c5a7745e15" (UID: "5051646c-fe1a-47b2-a872-13c5a7745e15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:32.530568 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530556    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:32.530780 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530567    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5051646c-fe1a-47b2-a872-13c5a7745e15" (UID: "5051646c-fe1a-47b2-a872-13c5a7745e15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:32.530780 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530574    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:32.530780 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530641    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:32.530780 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.530747    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5051646c-fe1a-47b2-a872-13c5a7745e15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5051646c-fe1a-47b2-a872-13c5a7745e15" (UID: "5051646c-fe1a-47b2-a872-13c5a7745e15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:33:32.532302 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.532276    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-kube-api-access-kptfd" (OuterVolumeSpecName: "kube-api-access-kptfd") pod "5051646c-fe1a-47b2-a872-13c5a7745e15" (UID: "5051646c-fe1a-47b2-a872-13c5a7745e15"). InnerVolumeSpecName "kube-api-access-kptfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:33:32.532412 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.532317    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-token" (OuterVolumeSpecName: "istio-token") pod "5051646c-fe1a-47b2-a872-13c5a7745e15" (UID: "5051646c-fe1a-47b2-a872-13c5a7745e15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:33:32.532579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.532562    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5051646c-fe1a-47b2-a872-13c5a7745e15" (UID: "5051646c-fe1a-47b2-a872-13c5a7745e15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:33:32.532621 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.532561    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5051646c-fe1a-47b2-a872-13c5a7745e15" (UID: "5051646c-fe1a-47b2-a872-13c5a7745e15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:32.631671 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.631636    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:32.631671 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.631667    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5051646c-fe1a-47b2-a872-13c5a7745e15-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:32.631907 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.631700    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:32.631907 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.631710    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:32.631907 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.631718    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:32.631907 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:32.631726    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kptfd\" (UniqueName: \"kubernetes.io/projected/5051646c-fe1a-47b2-a872-13c5a7745e15-kube-api-access-kptfd\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:33.141835 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.141795    2573 generic.go:356] "Generic (PLEG): container finished" podID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerID="5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e" exitCode=0
Sep 10 22:33:33.142338 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.141876    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"
Sep 10 22:33:33.142338 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.141881    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" event={"ID":"5051646c-fe1a-47b2-a872-13c5a7745e15","Type":"ContainerDied","Data":"5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e"}
Sep 10 22:33:33.142338 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.141948    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m" event={"ID":"5051646c-fe1a-47b2-a872-13c5a7745e15","Type":"ContainerDied","Data":"709f9138d11d5a32239d3254f10704bacc3a182f431a66cebc7a4d2fb193fe9b"}
Sep 10 22:33:33.142338 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.141984    2573 scope.go:117] "RemoveContainer" containerID="5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e"
Sep 10 22:33:33.152196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.152176    2573 scope.go:117] "RemoveContainer" containerID="2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456"
Sep 10 22:33:33.162088 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.162056    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"]
Sep 10 22:33:33.164651 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.164615    2573 scope.go:117] "RemoveContainer" containerID="5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e"
Sep 10 22:33:33.164805 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.164714    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5567cc-openshift-default-566c94c85d-cg74m"]
Sep 10 22:33:33.165034 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:33:33.165014    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e\": container with ID starting with 5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e not found: ID does not exist" containerID="5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e"
Sep 10 22:33:33.165098 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.165041    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e"} err="failed to get container status \"5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e\": rpc error: code = NotFound desc = could not find container \"5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e\": container with ID starting with 5d8bbeae9dd646c717fc2c4abecb9e93280f8dd79422cbabbcd90062759e961e not found: ID does not exist"
Sep 10 22:33:33.165098 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.165060    2573 scope.go:117] "RemoveContainer" containerID="2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456"
Sep 10 22:33:33.165358 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:33:33.165339    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456\": container with ID starting with 2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456 not found: ID does not exist" containerID="2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456"
Sep 10 22:33:33.165420 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.165363    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456"} err="failed to get container status \"2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456\": rpc error: code = NotFound desc = could not find container \"2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456\": container with ID starting with 2de113d63159da64ceb89828ed99ef20c59a81a0789cfffc5a5200a4a8844456 not found: ID does not exist"
Sep 10 22:33:33.281386 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.281358    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"
Sep 10 22:33:33.338298 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.338265    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168e512f-5caf-4b75-aee8-9648ead31ed4-maas-api-service-ca\") pod \"168e512f-5caf-4b75-aee8-9648ead31ed4\" (UID: \"168e512f-5caf-4b75-aee8-9648ead31ed4\") "
Sep 10 22:33:33.338724 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.338696    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/168e512f-5caf-4b75-aee8-9648ead31ed4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "168e512f-5caf-4b75-aee8-9648ead31ed4" (UID: "168e512f-5caf-4b75-aee8-9648ead31ed4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:33:33.439106 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:33.439000    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168e512f-5caf-4b75-aee8-9648ead31ed4-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:34.150476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:34.150441    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"
Sep 10 22:33:34.150476 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:34.150471    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7" event={"ID":"168e512f-5caf-4b75-aee8-9648ead31ed4","Type":"ContainerDied","Data":"222438f20910924a6a5b6d7f129a7ae2edce02eba03e09cac8e205f20c9d795b"}
Sep 10 22:33:34.151054 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:34.150523    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="222438f20910924a6a5b6d7f129a7ae2edce02eba03e09cac8e205f20c9d795b"
Sep 10 22:33:34.552995 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:34.552956    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" path="/var/lib/kubelet/pods/5051646c-fe1a-47b2-a872-13c5a7745e15/volumes"
Sep 10 22:33:46.350383 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.350290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:46.373402 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.373366    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"]
Sep 10 22:33:46.373688 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.373633    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf" podUID="be20c194-53f8-4fcf-841a-b0944cc681c6" containerName="payload-processing" containerID="cri-o://6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d" gracePeriod=30
Sep 10 22:33:46.381979 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.381946    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"]
Sep 10 22:33:46.382188 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.382167    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq" podUID="679bce86-6ba8-4ac0-af36-c38035af5630" containerName="payload-pre-processing" containerID="cri-o://d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555" gracePeriod=30
Sep 10 22:33:46.411227 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.411194    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:46.469625 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.469599    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:46.539113 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.539079    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"]
Sep 10 22:33:46.542574 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.542540    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-25241d-sfbw7"]
Sep 10 22:33:46.543765 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.543740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:46.554934 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.554905    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="168e512f-5caf-4b75-aee8-9648ead31ed4" path="/var/lib/kubelet/pods/168e512f-5caf-4b75-aee8-9648ead31ed4/volumes"
Sep 10 22:33:46.614652 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.614391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:46.651949 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.651923    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:33:46.687034 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.687008    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:33:46.757325 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.757288    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/679bce86-6ba8-4ac0-af36-c38035af5630-plugins-config-volume\") pod \"679bce86-6ba8-4ac0-af36-c38035af5630\" (UID: \"679bce86-6ba8-4ac0-af36-c38035af5630\") "
Sep 10 22:33:46.757523 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.757344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-799hd\" (UniqueName: \"kubernetes.io/projected/be20c194-53f8-4fcf-841a-b0944cc681c6-kube-api-access-799hd\") pod \"be20c194-53f8-4fcf-841a-b0944cc681c6\" (UID: \"be20c194-53f8-4fcf-841a-b0944cc681c6\") "
Sep 10 22:33:46.757523 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.757381    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvpcn\" (UniqueName: \"kubernetes.io/projected/679bce86-6ba8-4ac0-af36-c38035af5630-kube-api-access-jvpcn\") pod \"679bce86-6ba8-4ac0-af36-c38035af5630\" (UID: \"679bce86-6ba8-4ac0-af36-c38035af5630\") "
Sep 10 22:33:46.757523 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.757397    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be20c194-53f8-4fcf-841a-b0944cc681c6-plugins-config-volume\") pod \"be20c194-53f8-4fcf-841a-b0944cc681c6\" (UID: \"be20c194-53f8-4fcf-841a-b0944cc681c6\") "
Sep 10 22:33:46.757885 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.757819    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/679bce86-6ba8-4ac0-af36-c38035af5630-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "679bce86-6ba8-4ac0-af36-c38035af5630" (UID: "679bce86-6ba8-4ac0-af36-c38035af5630"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:33:46.757967 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.757864    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be20c194-53f8-4fcf-841a-b0944cc681c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be20c194-53f8-4fcf-841a-b0944cc681c6" (UID: "be20c194-53f8-4fcf-841a-b0944cc681c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:33:46.759579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.759559    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be20c194-53f8-4fcf-841a-b0944cc681c6-kube-api-access-799hd" (OuterVolumeSpecName: "kube-api-access-799hd") pod "be20c194-53f8-4fcf-841a-b0944cc681c6" (UID: "be20c194-53f8-4fcf-841a-b0944cc681c6"). InnerVolumeSpecName "kube-api-access-799hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:33:46.759770 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.759596    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/679bce86-6ba8-4ac0-af36-c38035af5630-kube-api-access-jvpcn" (OuterVolumeSpecName: "kube-api-access-jvpcn") pod "679bce86-6ba8-4ac0-af36-c38035af5630" (UID: "679bce86-6ba8-4ac0-af36-c38035af5630"). InnerVolumeSpecName "kube-api-access-jvpcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:33:46.858726 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.858669    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-799hd\" (UniqueName: \"kubernetes.io/projected/be20c194-53f8-4fcf-841a-b0944cc681c6-kube-api-access-799hd\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:46.858726 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.858718    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvpcn\" (UniqueName: \"kubernetes.io/projected/679bce86-6ba8-4ac0-af36-c38035af5630-kube-api-access-jvpcn\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:46.858726 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.858729    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be20c194-53f8-4fcf-841a-b0944cc681c6-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:46.858726 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.858737    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/679bce86-6ba8-4ac0-af36-c38035af5630-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:33:46.916574 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:46.916491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:47.227639 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.227605    2573 generic.go:356] "Generic (PLEG): container finished" podID="679bce86-6ba8-4ac0-af36-c38035af5630" containerID="d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555" exitCode=0
Sep 10 22:33:47.227870 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.227674    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"
Sep 10 22:33:47.227870 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.227675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq" event={"ID":"679bce86-6ba8-4ac0-af36-c38035af5630","Type":"ContainerDied","Data":"d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555"}
Sep 10 22:33:47.227870 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.227778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq" event={"ID":"679bce86-6ba8-4ac0-af36-c38035af5630","Type":"ContainerDied","Data":"97b6ef413a8175e050a0884bc848366272d64a383680b35dd28ca32f15c34325"}
Sep 10 22:33:47.227870 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.227809    2573 scope.go:117] "RemoveContainer" containerID="d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555"
Sep 10 22:33:47.229340 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.229323    2573 generic.go:356] "Generic (PLEG): container finished" podID="be20c194-53f8-4fcf-841a-b0944cc681c6" containerID="6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d" exitCode=0
Sep 10 22:33:47.229435 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.229372    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"
Sep 10 22:33:47.229501 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.229367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf" event={"ID":"be20c194-53f8-4fcf-841a-b0944cc681c6","Type":"ContainerDied","Data":"6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d"}
Sep 10 22:33:47.229501 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.229484    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf" event={"ID":"be20c194-53f8-4fcf-841a-b0944cc681c6","Type":"ContainerDied","Data":"a72ba44e4462bf4f16ed251bdda1d6229479e0f867f0d103a8ca1e1e08121083"}
Sep 10 22:33:47.243215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.243193    2573 scope.go:117] "RemoveContainer" containerID="d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555"
Sep 10 22:33:47.243507 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:33:47.243490    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555\": container with ID starting with d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555 not found: ID does not exist" containerID="d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555"
Sep 10 22:33:47.243550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.243517    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555"} err="failed to get container status \"d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555\": rpc error: code = NotFound desc = could not find container \"d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555\": container with ID starting with d76623f629fdb3a23b17b70444fde42d0e70d3cf80848548d5a2e6a31f365555 not found: ID does not exist"
Sep 10 22:33:47.243550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.243533    2573 scope.go:117] "RemoveContainer" containerID="6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d"
Sep 10 22:33:47.251850 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.251820    2573 scope.go:117] "RemoveContainer" containerID="6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d"
Sep 10 22:33:47.252126 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:33:47.252101    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d\": container with ID starting with 6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d not found: ID does not exist" containerID="6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d"
Sep 10 22:33:47.252177 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.252122    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d"} err="failed to get container status \"6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d\": rpc error: code = NotFound desc = could not find container \"6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d\": container with ID starting with 6d7779a86f3ef014ed00a62bf5cfe565763fa66183212b8b436bd43d9bbb001d not found: ID does not exist"
Sep 10 22:33:47.255862 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.255827    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"]
Sep 10 22:33:47.260513 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.260492    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-25241d-5f7759c6fd-hqmpq"]
Sep 10 22:33:47.270438 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.270414    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"]
Sep 10 22:33:47.273294 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:47.273274    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-25241d-74fdc89d89-vxtnf"]
Sep 10 22:33:48.553701 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:48.553669    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="679bce86-6ba8-4ac0-af36-c38035af5630" path="/var/lib/kubelet/pods/679bce86-6ba8-4ac0-af36-c38035af5630/volumes"
Sep 10 22:33:48.554102 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:48.554063    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be20c194-53f8-4fcf-841a-b0944cc681c6" path="/var/lib/kubelet/pods/be20c194-53f8-4fcf-841a-b0944cc681c6/volumes"
Sep 10 22:33:51.939594 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:33:51.939558    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:28.669363 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:34:28.669331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:28.892098 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:34:28.892066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:34.397468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:34:34.397437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:42.005361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:34:42.005325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:04.943769 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:04.943732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:09.408439 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:09.408399    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:17.181877 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.181781    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"]
Sep 10 22:35:17.182256 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.182002    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy" containerID="cri-o://cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a" gracePeriod=30
Sep 10 22:35:17.204983 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.204946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:17.564406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564369    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"]
Sep 10 22:35:17.564748 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564735    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168e512f-5caf-4b75-aee8-9648ead31ed4" containerName="revoke-keys"
Sep 10 22:35:17.564799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564749    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="168e512f-5caf-4b75-aee8-9648ead31ed4" containerName="revoke-keys"
Sep 10 22:35:17.564799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564761    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be20c194-53f8-4fcf-841a-b0944cc681c6" containerName="payload-processing"
Sep 10 22:35:17.564799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564768    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="be20c194-53f8-4fcf-841a-b0944cc681c6" containerName="payload-processing"
Sep 10 22:35:17.564799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564781    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="679bce86-6ba8-4ac0-af36-c38035af5630" containerName="payload-pre-processing"
Sep 10 22:35:17.564799 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564787    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="679bce86-6ba8-4ac0-af36-c38035af5630" containerName="payload-pre-processing"
Sep 10 22:35:17.565005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564803    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy"
Sep 10 22:35:17.565005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564808    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy"
Sep 10 22:35:17.565005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564814    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy"
Sep 10 22:35:17.565005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564819    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy"
Sep 10 22:35:17.565005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564897    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="be20c194-53f8-4fcf-841a-b0944cc681c6" containerName="payload-processing"
Sep 10 22:35:17.565005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564906    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy"
Sep 10 22:35:17.565005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564913    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="679bce86-6ba8-4ac0-af36-c38035af5630" containerName="payload-pre-processing"
Sep 10 22:35:17.565005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564920    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5051646c-fe1a-47b2-a872-13c5a7745e15" containerName="istio-proxy"
Sep 10 22:35:17.565005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.564925    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="168e512f-5caf-4b75-aee8-9648ead31ed4" containerName="revoke-keys"
Sep 10 22:35:17.568209 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.568192    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"
Sep 10 22:35:17.570506 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.570488    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:35:17.576104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.576084    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"]
Sep 10 22:35:17.674719 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.674685    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:17.691989 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.691961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e26e839-b503-4193-9adb-a322a2d511c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk\" (UID: \"9e26e839-b503-4193-9adb-a322a2d511c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"
Sep 10 22:35:17.793222 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.793183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e26e839-b503-4193-9adb-a322a2d511c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk\" (UID: \"9e26e839-b503-4193-9adb-a322a2d511c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"
Sep 10 22:35:17.793884 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.793828    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e26e839-b503-4193-9adb-a322a2d511c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk\" (UID: \"9e26e839-b503-4193-9adb-a322a2d511c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"
Sep 10 22:35:17.879320 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:17.879242    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"
Sep 10 22:35:18.150370 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:18.150343    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"]
Sep 10 22:35:18.151915 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:35:18.151889    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e26e839_b503_4193_9adb_a322a2d511c5.slice/crio-98640201d151df18396caeeb9e30f63fa15cfccfeaf2ef8453f729912565a0a8 WatchSource:0}: Error finding container 98640201d151df18396caeeb9e30f63fa15cfccfeaf2ef8453f729912565a0a8: Status 404 returned error can't find the container with id 98640201d151df18396caeeb9e30f63fa15cfccfeaf2ef8453f729912565a0a8
Sep 10 22:35:18.763437 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:18.763409    2573 generic.go:356] "Generic (PLEG): container finished" podID="9e26e839-b503-4193-9adb-a322a2d511c5" containerID="ba1f5d876ce25d6937aa2dce9240f8dc479b55744330491e8d3785c3dc09292f" exitCode=0
Sep 10 22:35:18.763751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:18.763486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk" event={"ID":"9e26e839-b503-4193-9adb-a322a2d511c5","Type":"ContainerDied","Data":"ba1f5d876ce25d6937aa2dce9240f8dc479b55744330491e8d3785c3dc09292f"}
Sep 10 22:35:18.763751 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:18.763534    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk" event={"ID":"9e26e839-b503-4193-9adb-a322a2d511c5","Type":"ContainerStarted","Data":"98640201d151df18396caeeb9e30f63fa15cfccfeaf2ef8453f729912565a0a8"}
Sep 10 22:35:19.905399 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:19.905377    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"
Sep 10 22:35:20.010861 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:20.010818    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e26e839-b503-4193-9adb-a322a2d511c5-maas-api-service-ca\") pod \"9e26e839-b503-4193-9adb-a322a2d511c5\" (UID: \"9e26e839-b503-4193-9adb-a322a2d511c5\") "
Sep 10 22:35:20.011161 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:20.011139    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e26e839-b503-4193-9adb-a322a2d511c5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9e26e839-b503-4193-9adb-a322a2d511c5" (UID: "9e26e839-b503-4193-9adb-a322a2d511c5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:20.112246 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:20.112180    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e26e839-b503-4193-9adb-a322a2d511c5-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:20.681303 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:20.681272    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:35:20.683776 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:20.683752    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:35:20.775809 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:20.775784    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"
Sep 10 22:35:20.775980 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:20.775827    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk" event={"ID":"9e26e839-b503-4193-9adb-a322a2d511c5","Type":"ContainerDied","Data":"98640201d151df18396caeeb9e30f63fa15cfccfeaf2ef8453f729912565a0a8"}
Sep 10 22:35:20.775980 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:20.775898    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98640201d151df18396caeeb9e30f63fa15cfccfeaf2ef8453f729912565a0a8"
Sep 10 22:35:22.435562 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.435540    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:35:22.534131 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534105    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-token\") pod \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") "
Sep 10 22:35:22.534298 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534147    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-envoy\") pod \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") "
Sep 10 22:35:22.534298 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534195    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-socket\") pod \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") "
Sep 10 22:35:22.534298 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534212    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-data\") pod \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") "
Sep 10 22:35:22.534298 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534238    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istiod-ca-cert\") pod \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") "
Sep 10 22:35:22.534298 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534276    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdpvc\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-kube-api-access-xdpvc\") pod \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") "
Sep 10 22:35:22.534653 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534306    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-certs\") pod \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") "
Sep 10 22:35:22.534653 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534464    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc7fbbda-a4d7-4968-adce-4e6c25ff0951" (UID: "bc7fbbda-a4d7-4968-adce-4e6c25ff0951"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.534653 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534532    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc7fbbda-a4d7-4968-adce-4e6c25ff0951" (UID: "bc7fbbda-a4d7-4968-adce-4e6c25ff0951"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.534653 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534631    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-credential-socket\") pod \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") "
Sep 10 22:35:22.534902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534679    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-podinfo\") pod \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\" (UID: \"bc7fbbda-a4d7-4968-adce-4e6c25ff0951\") "
Sep 10 22:35:22.534902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534711    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc7fbbda-a4d7-4968-adce-4e6c25ff0951" (UID: "bc7fbbda-a4d7-4968-adce-4e6c25ff0951"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.534902 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534832    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc7fbbda-a4d7-4968-adce-4e6c25ff0951" (UID: "bc7fbbda-a4d7-4968-adce-4e6c25ff0951"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:22.535077 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.534980    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc7fbbda-a4d7-4968-adce-4e6c25ff0951" (UID: "bc7fbbda-a4d7-4968-adce-4e6c25ff0951"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.535156 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.535130    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.535215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.535158    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.535215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.535190    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.535215 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.535204    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.535382 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.535217    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.536560 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.536537    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc7fbbda-a4d7-4968-adce-4e6c25ff0951" (UID: "bc7fbbda-a4d7-4968-adce-4e6c25ff0951"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:22.536872 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.536829    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc7fbbda-a4d7-4968-adce-4e6c25ff0951" (UID: "bc7fbbda-a4d7-4968-adce-4e6c25ff0951"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.536990 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.536868    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-kube-api-access-xdpvc" (OuterVolumeSpecName: "kube-api-access-xdpvc") pod "bc7fbbda-a4d7-4968-adce-4e6c25ff0951" (UID: "bc7fbbda-a4d7-4968-adce-4e6c25ff0951"). InnerVolumeSpecName "kube-api-access-xdpvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:22.537051 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.537012    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc7fbbda-a4d7-4968-adce-4e6c25ff0951" (UID: "bc7fbbda-a4d7-4968-adce-4e6c25ff0951"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:35:22.636253 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.636226    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.636253 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.636249    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.636410 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.636276    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdpvc\" (UniqueName: \"kubernetes.io/projected/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-kube-api-access-xdpvc\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.636410 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.636285    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc7fbbda-a4d7-4968-adce-4e6c25ff0951-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.789429 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.789360    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerID="cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a" exitCode=0
Sep 10 22:35:22.789429 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.789405    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" event={"ID":"bc7fbbda-a4d7-4968-adce-4e6c25ff0951","Type":"ContainerDied","Data":"cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a"}
Sep 10 22:35:22.789591 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.789443    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf" event={"ID":"bc7fbbda-a4d7-4968-adce-4e6c25ff0951","Type":"ContainerDied","Data":"e945593202fc50bc9c462c8d25b59aabb8eaec2262aae44d304db0fe3fa6f262"}
Sep 10 22:35:22.789591 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.789464    2573 scope.go:117] "RemoveContainer" containerID="cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a"
Sep 10 22:35:22.789591 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.789406    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"
Sep 10 22:35:22.798917 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.798893    2573 scope.go:117] "RemoveContainer" containerID="692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8"
Sep 10 22:35:22.805866 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.805829    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"]
Sep 10 22:35:22.808637 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.808625    2573 scope.go:117] "RemoveContainer" containerID="cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a"
Sep 10 22:35:22.808938 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:35:22.808919    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a\": container with ID starting with cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a not found: ID does not exist" containerID="cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a"
Sep 10 22:35:22.808999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.808946    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a"} err="failed to get container status \"cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a\": rpc error: code = NotFound desc = could not find container \"cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a\": container with ID starting with cfaf7c08a5e2569af857668f9617aee7ec4d791a2bd9431027c44f26e6e6f28a not found: ID does not exist"
Sep 10 22:35:22.808999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.808962    2573 scope.go:117] "RemoveContainer" containerID="692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8"
Sep 10 22:35:22.809089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.809050    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-25241d-openshift-default-6b466fbf8b-pxndf"]
Sep 10 22:35:22.809231 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:35:22.809215    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8\": container with ID starting with 692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8 not found: ID does not exist" containerID="692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8"
Sep 10 22:35:22.809282 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:22.809237    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8"} err="failed to get container status \"692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8\": rpc error: code = NotFound desc = could not find container \"692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8\": container with ID starting with 692b4edcc9d5ed41a14d1e03ad3fd3f2d394fc22121806b2b359804041286bd8 not found: ID does not exist"
Sep 10 22:35:24.553151 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:24.553115    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" path="/var/lib/kubelet/pods/bc7fbbda-a4d7-4968-adce-4e6c25ff0951/volumes"
Sep 10 22:35:28.145273 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.145239    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:28.174767 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.174733    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"]
Sep 10 22:35:28.175032 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.175006    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b" podUID="fe7157d9-87ff-4bb9-ae3e-af78adb44f45" containerName="payload-pre-processing" containerID="cri-o://bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b" gracePeriod=30
Sep 10 22:35:28.245893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.245834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:28.336946 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.336915    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"]
Sep 10 22:35:28.338546 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.338350    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:28.340401 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.340375    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9b2092-dznmk"]
Sep 10 22:35:28.402588 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.402463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:28.429511 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.429488    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:35:28.553561 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.553528    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e26e839-b503-4193-9adb-a322a2d511c5" path="/var/lib/kubelet/pods/9e26e839-b503-4193-9adb-a322a2d511c5/volumes"
Sep 10 22:35:28.589148 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.589121    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-plugins-config-volume\") pod \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\" (UID: \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\") "
Sep 10 22:35:28.589254 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.589238    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8cjd\" (UniqueName: \"kubernetes.io/projected/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-kube-api-access-d8cjd\") pod \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\" (UID: \"fe7157d9-87ff-4bb9-ae3e-af78adb44f45\") "
Sep 10 22:35:28.589460 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.589438    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe7157d9-87ff-4bb9-ae3e-af78adb44f45" (UID: "fe7157d9-87ff-4bb9-ae3e-af78adb44f45"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:28.591310 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.591283    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-kube-api-access-d8cjd" (OuterVolumeSpecName: "kube-api-access-d8cjd") pod "fe7157d9-87ff-4bb9-ae3e-af78adb44f45" (UID: "fe7157d9-87ff-4bb9-ae3e-af78adb44f45"). InnerVolumeSpecName "kube-api-access-d8cjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:28.691040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.690951    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8cjd\" (UniqueName: \"kubernetes.io/projected/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-kube-api-access-d8cjd\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:28.691040 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.690987    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7157d9-87ff-4bb9-ae3e-af78adb44f45-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:28.702052 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.702024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:28.825205 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.825177    2573 generic.go:356] "Generic (PLEG): container finished" podID="fe7157d9-87ff-4bb9-ae3e-af78adb44f45" containerID="bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b" exitCode=0
Sep 10 22:35:28.825349 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.825222    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"
Sep 10 22:35:28.825349 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.825269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b" event={"ID":"fe7157d9-87ff-4bb9-ae3e-af78adb44f45","Type":"ContainerDied","Data":"bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b"}
Sep 10 22:35:28.825349 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.825320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b" event={"ID":"fe7157d9-87ff-4bb9-ae3e-af78adb44f45","Type":"ContainerDied","Data":"3c9a7d7a730931d9dcc7934fe6d2f2d60115fac657b86e6aea9acd9fa20d31ad"}
Sep 10 22:35:28.825349 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.825345    2573 scope.go:117] "RemoveContainer" containerID="bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b"
Sep 10 22:35:28.834760 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.834742    2573 scope.go:117] "RemoveContainer" containerID="bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b"
Sep 10 22:35:28.835040 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:35:28.835022    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b\": container with ID starting with bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b not found: ID does not exist" containerID="bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b"
Sep 10 22:35:28.835100 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.835046    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b"} err="failed to get container status \"bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b\": rpc error: code = NotFound desc = could not find container \"bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b\": container with ID starting with bda6f9c7cdfdbce896ac4a278c809904ea865e1ffb65c7c55447d210b78afe5b not found: ID does not exist"
Sep 10 22:35:28.846280 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.846259    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"]
Sep 10 22:35:28.850701 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:28.850681    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9b2092-6f8954b5cd-n4v9b"]
Sep 10 22:35:30.558774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:30.558738    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe7157d9-87ff-4bb9-ae3e-af78adb44f45" path="/var/lib/kubelet/pods/fe7157d9-87ff-4bb9-ae3e-af78adb44f45/volumes"
Sep 10 22:35:34.429560 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:34.429525    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:34.529201 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:34.529169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:34.689238 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:34.689163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:35.011598 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.011567    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"]
Sep 10 22:35:35.011989 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.011965    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy"
Sep 10 22:35:35.011989 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.011993    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy"
Sep 10 22:35:35.012089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012008    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7157d9-87ff-4bb9-ae3e-af78adb44f45" containerName="payload-pre-processing"
Sep 10 22:35:35.012089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012015    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7157d9-87ff-4bb9-ae3e-af78adb44f45" containerName="payload-pre-processing"
Sep 10 22:35:35.012089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012024    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e26e839-b503-4193-9adb-a322a2d511c5" containerName="revoke-keys"
Sep 10 22:35:35.012089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012029    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e26e839-b503-4193-9adb-a322a2d511c5" containerName="revoke-keys"
Sep 10 22:35:35.012089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012043    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy"
Sep 10 22:35:35.012089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012049    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy"
Sep 10 22:35:35.012272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012113    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe7157d9-87ff-4bb9-ae3e-af78adb44f45" containerName="payload-pre-processing"
Sep 10 22:35:35.012272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012122    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy"
Sep 10 22:35:35.012272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012127    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e26e839-b503-4193-9adb-a322a2d511c5" containerName="revoke-keys"
Sep 10 22:35:35.012272 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.012134    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7fbbda-a4d7-4968-adce-4e6c25ff0951" containerName="istio-proxy"
Sep 10 22:35:35.016523 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.016506    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"
Sep 10 22:35:35.019159 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.019139    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:35:35.021156 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.021135    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"]
Sep 10 22:35:35.117956 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.117887    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:35.147197 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.147173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc23c91-0711-40ca-bb4a-c85e6e892b4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4\" (UID: \"5cc23c91-0711-40ca-bb4a-c85e6e892b4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"
Sep 10 22:35:35.248404 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.248366    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc23c91-0711-40ca-bb4a-c85e6e892b4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4\" (UID: \"5cc23c91-0711-40ca-bb4a-c85e6e892b4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"
Sep 10 22:35:35.249035 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.249016    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc23c91-0711-40ca-bb4a-c85e6e892b4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4\" (UID: \"5cc23c91-0711-40ca-bb4a-c85e6e892b4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"
Sep 10 22:35:35.329501 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.329419    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"
Sep 10 22:35:35.597891 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.597864    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"]
Sep 10 22:35:35.599484 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:35:35.599457    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc23c91_0711_40ca_bb4a_c85e6e892b4f.slice/crio-65f970c1af5f1259ce349ac7f5ccdd4bf90dbd2fda3969413b3a12d7b6b24eb1 WatchSource:0}: Error finding container 65f970c1af5f1259ce349ac7f5ccdd4bf90dbd2fda3969413b3a12d7b6b24eb1: Status 404 returned error can't find the container with id 65f970c1af5f1259ce349ac7f5ccdd4bf90dbd2fda3969413b3a12d7b6b24eb1
Sep 10 22:35:35.868537 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.868476    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4" event={"ID":"5cc23c91-0711-40ca-bb4a-c85e6e892b4f","Type":"ContainerStarted","Data":"11c09f32e123cd29e0174e7882bb7d215afd7051df7ea9fc8227c47232a2dc61"}
Sep 10 22:35:35.868719 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.868549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4" event={"ID":"5cc23c91-0711-40ca-bb4a-c85e6e892b4f","Type":"ContainerStarted","Data":"65f970c1af5f1259ce349ac7f5ccdd4bf90dbd2fda3969413b3a12d7b6b24eb1"}
Sep 10 22:35:35.884692 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:35.884641    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4" podStartSLOduration=1.8846260959999999 podStartE2EDuration="1.884626096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:35.882513096 +0000 UTC m=+1815.764997465" watchObservedRunningTime="2026-09-10 22:35:35.884626096 +0000 UTC m=+1815.767110461"
Sep 10 22:35:36.876358 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:36.876323    2573 generic.go:356] "Generic (PLEG): container finished" podID="5cc23c91-0711-40ca-bb4a-c85e6e892b4f" containerID="11c09f32e123cd29e0174e7882bb7d215afd7051df7ea9fc8227c47232a2dc61" exitCode=0
Sep 10 22:35:36.876755 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:36.876403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4" event={"ID":"5cc23c91-0711-40ca-bb4a-c85e6e892b4f","Type":"ContainerDied","Data":"11c09f32e123cd29e0174e7882bb7d215afd7051df7ea9fc8227c47232a2dc61"}
Sep 10 22:35:38.011411 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:38.011387    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"
Sep 10 22:35:38.176519 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:38.176442    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc23c91-0711-40ca-bb4a-c85e6e892b4f-maas-api-service-ca\") pod \"5cc23c91-0711-40ca-bb4a-c85e6e892b4f\" (UID: \"5cc23c91-0711-40ca-bb4a-c85e6e892b4f\") "
Sep 10 22:35:38.176800 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:38.176774    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cc23c91-0711-40ca-bb4a-c85e6e892b4f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5cc23c91-0711-40ca-bb4a-c85e6e892b4f" (UID: "5cc23c91-0711-40ca-bb4a-c85e6e892b4f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:38.277904 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:38.277881    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc23c91-0711-40ca-bb4a-c85e6e892b4f-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:38.888671 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:38.888596    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"
Sep 10 22:35:38.888805 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:38.888595    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4" event={"ID":"5cc23c91-0711-40ca-bb4a-c85e6e892b4f","Type":"ContainerDied","Data":"65f970c1af5f1259ce349ac7f5ccdd4bf90dbd2fda3969413b3a12d7b6b24eb1"}
Sep 10 22:35:38.888805 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:38.888713    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65f970c1af5f1259ce349ac7f5ccdd4bf90dbd2fda3969413b3a12d7b6b24eb1"
Sep 10 22:35:45.453013 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.452979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:45.490444 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.490399    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"]
Sep 10 22:35:45.490775 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.490717    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w" podUID="121111cb-b35b-4860-aa57-d856cc314ea0" containerName="payload-pre-processing" containerID="cri-o://0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b" gracePeriod=30
Sep 10 22:35:45.552340 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.552307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:45.637987 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.637951    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"]
Sep 10 22:35:45.640381 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.640350    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e367c1-fsgx4"]
Sep 10 22:35:45.640924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.640899    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:45.704690 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.704618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:45.746821 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.746796    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:35:45.839570 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.839544    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4tnn\" (UniqueName: \"kubernetes.io/projected/121111cb-b35b-4860-aa57-d856cc314ea0-kube-api-access-w4tnn\") pod \"121111cb-b35b-4860-aa57-d856cc314ea0\" (UID: \"121111cb-b35b-4860-aa57-d856cc314ea0\") "
Sep 10 22:35:45.839780 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.839602    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/121111cb-b35b-4860-aa57-d856cc314ea0-plugins-config-volume\") pod \"121111cb-b35b-4860-aa57-d856cc314ea0\" (UID: \"121111cb-b35b-4860-aa57-d856cc314ea0\") "
Sep 10 22:35:45.839991 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.839968    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/121111cb-b35b-4860-aa57-d856cc314ea0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "121111cb-b35b-4860-aa57-d856cc314ea0" (UID: "121111cb-b35b-4860-aa57-d856cc314ea0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:45.841578 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.841558    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/121111cb-b35b-4860-aa57-d856cc314ea0-kube-api-access-w4tnn" (OuterVolumeSpecName: "kube-api-access-w4tnn") pod "121111cb-b35b-4860-aa57-d856cc314ea0" (UID: "121111cb-b35b-4860-aa57-d856cc314ea0"). InnerVolumeSpecName "kube-api-access-w4tnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:45.930105 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.930076    2573 generic.go:356] "Generic (PLEG): container finished" podID="121111cb-b35b-4860-aa57-d856cc314ea0" containerID="0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b" exitCode=0
Sep 10 22:35:45.930261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.930126    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"
Sep 10 22:35:45.930261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.930162    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w" event={"ID":"121111cb-b35b-4860-aa57-d856cc314ea0","Type":"ContainerDied","Data":"0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b"}
Sep 10 22:35:45.930261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.930216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w" event={"ID":"121111cb-b35b-4860-aa57-d856cc314ea0","Type":"ContainerDied","Data":"0e8736abc7f1b23d739ddb9a1f8b0f86b100b5d6eeb92a383350536bac36dc5e"}
Sep 10 22:35:45.930261 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.930239    2573 scope.go:117] "RemoveContainer" containerID="0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b"
Sep 10 22:35:45.939527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.939504    2573 scope.go:117] "RemoveContainer" containerID="0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b"
Sep 10 22:35:45.939815 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:35:45.939796    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b\": container with ID starting with 0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b not found: ID does not exist" containerID="0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b"
Sep 10 22:35:45.939894 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.939829    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b"} err="failed to get container status \"0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b\": rpc error: code = NotFound desc = could not find container \"0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b\": container with ID starting with 0fb7542cc564027323487d5317aedb81629ff3334695cc7e7b123c7b4f13023b not found: ID does not exist"
Sep 10 22:35:45.940352 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.940332    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4tnn\" (UniqueName: \"kubernetes.io/projected/121111cb-b35b-4860-aa57-d856cc314ea0-kube-api-access-w4tnn\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:45.940393 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.940359    2573 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/121111cb-b35b-4860-aa57-d856cc314ea0-plugins-config-volume\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:45.951927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.951900    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"]
Sep 10 22:35:45.956115 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.956067    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e367c1-78dbd5bbdb-wd24w"]
Sep 10 22:35:45.998224 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:45.998202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:46.552711 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:46.552681    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="121111cb-b35b-4860-aa57-d856cc314ea0" path="/var/lib/kubelet/pods/121111cb-b35b-4860-aa57-d856cc314ea0/volumes"
Sep 10 22:35:46.553098 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:46.553034    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc23c91-0711-40ca-bb4a-c85e6e892b4f" path="/var/lib/kubelet/pods/5cc23c91-0711-40ca-bb4a-c85e6e892b4f/volumes"
Sep 10 22:35:49.535084 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:49.535037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:49.607059 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:49.607020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:52.277784 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.277749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:52.372489 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.372454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:52.531164 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.531090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:52.860156 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.860075    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"]
Sep 10 22:35:52.860443 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.860430    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc23c91-0711-40ca-bb4a-c85e6e892b4f" containerName="revoke-keys"
Sep 10 22:35:52.860487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.860444    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc23c91-0711-40ca-bb4a-c85e6e892b4f" containerName="revoke-keys"
Sep 10 22:35:52.860487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.860452    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121111cb-b35b-4860-aa57-d856cc314ea0" containerName="payload-pre-processing"
Sep 10 22:35:52.860487 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.860459    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="121111cb-b35b-4860-aa57-d856cc314ea0" containerName="payload-pre-processing"
Sep 10 22:35:52.860579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.860525    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc23c91-0711-40ca-bb4a-c85e6e892b4f" containerName="revoke-keys"
Sep 10 22:35:52.860579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.860535    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="121111cb-b35b-4860-aa57-d856cc314ea0" containerName="payload-pre-processing"
Sep 10 22:35:52.864999 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.864982    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"
Sep 10 22:35:52.867282 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.867261    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlfhj\""
Sep 10 22:35:52.871754 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.871732    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"]
Sep 10 22:35:52.899813 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.899783    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07137a0c-9a4a-42cf-8037-c6afa52d128c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9\" (UID: \"07137a0c-9a4a-42cf-8037-c6afa52d128c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"
Sep 10 22:35:52.960295 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:52.960258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:53.001123 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:53.001090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07137a0c-9a4a-42cf-8037-c6afa52d128c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9\" (UID: \"07137a0c-9a4a-42cf-8037-c6afa52d128c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"
Sep 10 22:35:53.001747 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:53.001726    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07137a0c-9a4a-42cf-8037-c6afa52d128c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9\" (UID: \"07137a0c-9a4a-42cf-8037-c6afa52d128c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"
Sep 10 22:35:53.177093 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:53.177005    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"
Sep 10 22:35:53.460567 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:53.460534    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"]
Sep 10 22:35:53.461731 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:35:53.461704    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07137a0c_9a4a_42cf_8037_c6afa52d128c.slice/crio-5aa4cd121fffaec976c90025bdf76b6417fe098a17cbce66912ad82aa9d7aa50 WatchSource:0}: Error finding container 5aa4cd121fffaec976c90025bdf76b6417fe098a17cbce66912ad82aa9d7aa50: Status 404 returned error can't find the container with id 5aa4cd121fffaec976c90025bdf76b6417fe098a17cbce66912ad82aa9d7aa50
Sep 10 22:35:53.978826 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:53.978791    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9" event={"ID":"07137a0c-9a4a-42cf-8037-c6afa52d128c","Type":"ContainerStarted","Data":"9e46edc060be0720d1d7242c44beb3567d16ab9af665abc903c6b14a290d26cf"}
Sep 10 22:35:53.979018 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:53.978858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9" event={"ID":"07137a0c-9a4a-42cf-8037-c6afa52d128c","Type":"ContainerStarted","Data":"5aa4cd121fffaec976c90025bdf76b6417fe098a17cbce66912ad82aa9d7aa50"}
Sep 10 22:35:53.993721 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:53.993674    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9" podStartSLOduration=1.9936587879999998 podStartE2EDuration="1.993658788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:53.992498088 +0000 UTC m=+1833.874982480" watchObservedRunningTime="2026-09-10 22:35:53.993658788 +0000 UTC m=+1833.876143153"
Sep 10 22:35:54.986404 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:54.986370    2573 generic.go:356] "Generic (PLEG): container finished" podID="07137a0c-9a4a-42cf-8037-c6afa52d128c" containerID="9e46edc060be0720d1d7242c44beb3567d16ab9af665abc903c6b14a290d26cf" exitCode=0
Sep 10 22:35:54.986812 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:54.986460    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9" event={"ID":"07137a0c-9a4a-42cf-8037-c6afa52d128c","Type":"ContainerDied","Data":"9e46edc060be0720d1d7242c44beb3567d16ab9af665abc903c6b14a290d26cf"}
Sep 10 22:35:56.123893 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:56.123833    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"
Sep 10 22:35:56.225486 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:56.225455    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07137a0c-9a4a-42cf-8037-c6afa52d128c-maas-api-service-ca\") pod \"07137a0c-9a4a-42cf-8037-c6afa52d128c\" (UID: \"07137a0c-9a4a-42cf-8037-c6afa52d128c\") "
Sep 10 22:35:56.225780 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:56.225757    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07137a0c-9a4a-42cf-8037-c6afa52d128c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "07137a0c-9a4a-42cf-8037-c6afa52d128c" (UID: "07137a0c-9a4a-42cf-8037-c6afa52d128c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:56.327119 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:56.327051    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07137a0c-9a4a-42cf-8037-c6afa52d128c-maas-api-service-ca\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:35:57.000018 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:56.999985    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"
Sep 10 22:35:57.000190 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:57.000022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9" event={"ID":"07137a0c-9a4a-42cf-8037-c6afa52d128c","Type":"ContainerDied","Data":"5aa4cd121fffaec976c90025bdf76b6417fe098a17cbce66912ad82aa9d7aa50"}
Sep 10 22:35:57.000190 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:35:57.000076    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5aa4cd121fffaec976c90025bdf76b6417fe098a17cbce66912ad82aa9d7aa50"
Sep 10 22:36:03.361041 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:03.360953    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:03.459068 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:03.459030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:03.546099 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:03.546072    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"]
Sep 10 22:36:03.551796 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:03.551771    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:03.552752 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:03.552733    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0ada08-9nlw9"]
Sep 10 22:36:03.627149 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:03.627083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:03.945708 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:03.945620    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:04.553186 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:04.553157    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07137a0c-9a4a-42cf-8037-c6afa52d128c" path="/var/lib/kubelet/pods/07137a0c-9a4a-42cf-8037-c6afa52d128c/volumes"
Sep 10 22:36:10.009391 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:10.009360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:10.075098 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:10.075062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:10.214229 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:10.214200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:10.262330 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:10.262247    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"]
Sep 10 22:36:10.262495 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:10.262448    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy" containerID="cri-o://1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4" gracePeriod=30
Sep 10 22:36:10.314853 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:10.314811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:15.504554 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.504529    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:36:15.587199 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587131    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4877045f-5025-4810-888f-c4833c227701-istiod-ca-cert\") pod \"4877045f-5025-4810-888f-c4833c227701\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") "
Sep 10 22:36:15.587199 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587181    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-socket\") pod \"4877045f-5025-4810-888f-c4833c227701\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") "
Sep 10 22:36:15.587367 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587201    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-envoy\") pod \"4877045f-5025-4810-888f-c4833c227701\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") "
Sep 10 22:36:15.587367 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587220    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-data\") pod \"4877045f-5025-4810-888f-c4833c227701\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") "
Sep 10 22:36:15.587367 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587331    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-credential-socket\") pod \"4877045f-5025-4810-888f-c4833c227701\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") "
Sep 10 22:36:15.587533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587390    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4877045f-5025-4810-888f-c4833c227701-istio-podinfo\") pod \"4877045f-5025-4810-888f-c4833c227701\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") "
Sep 10 22:36:15.587533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587433    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-certs\") pod \"4877045f-5025-4810-888f-c4833c227701\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") "
Sep 10 22:36:15.587533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587462    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4877045f-5025-4810-888f-c4833c227701" (UID: "4877045f-5025-4810-888f-c4833c227701"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:36:15.587533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587478    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-data" (OuterVolumeSpecName: "istio-data") pod "4877045f-5025-4810-888f-c4833c227701" (UID: "4877045f-5025-4810-888f-c4833c227701"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:36:15.587533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587474    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99vtm\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-kube-api-access-99vtm\") pod \"4877045f-5025-4810-888f-c4833c227701\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") "
Sep 10 22:36:15.587533 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587529    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4877045f-5025-4810-888f-c4833c227701-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4877045f-5025-4810-888f-c4833c227701" (UID: "4877045f-5025-4810-888f-c4833c227701"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:36:15.587834 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587614    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-istio-token\") pod \"4877045f-5025-4810-888f-c4833c227701\" (UID: \"4877045f-5025-4810-888f-c4833c227701\") "
Sep 10 22:36:15.587834 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587636    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4877045f-5025-4810-888f-c4833c227701" (UID: "4877045f-5025-4810-888f-c4833c227701"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:36:15.587834 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587712    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4877045f-5025-4810-888f-c4833c227701" (UID: "4877045f-5025-4810-888f-c4833c227701"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:36:15.588023 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587967    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4877045f-5025-4810-888f-c4833c227701-istiod-ca-cert\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:36:15.588023 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.587988    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:36:15.588023 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.588003    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-data\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:36:15.588023 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.588017    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-credential-socket\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:36:15.588238 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.588029    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-workload-certs\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:36:15.589507 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.589482    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4877045f-5025-4810-888f-c4833c227701" (UID: "4877045f-5025-4810-888f-c4833c227701"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:36:15.589601 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.589521    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4877045f-5025-4810-888f-c4833c227701-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4877045f-5025-4810-888f-c4833c227701" (UID: "4877045f-5025-4810-888f-c4833c227701"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:36:15.589601 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.589556    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-kube-api-access-99vtm" (OuterVolumeSpecName: "kube-api-access-99vtm") pod "4877045f-5025-4810-888f-c4833c227701" (UID: "4877045f-5025-4810-888f-c4833c227701"). InnerVolumeSpecName "kube-api-access-99vtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:36:15.589675 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.589605    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-istio-token" (OuterVolumeSpecName: "istio-token") pod "4877045f-5025-4810-888f-c4833c227701" (UID: "4877045f-5025-4810-888f-c4833c227701"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:36:15.689173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.689137    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4877045f-5025-4810-888f-c4833c227701-istio-envoy\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:36:15.689173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.689170    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4877045f-5025-4810-888f-c4833c227701-istio-podinfo\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:36:15.689173 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.689180    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99vtm\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-kube-api-access-99vtm\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:36:15.689387 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:15.689190    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4877045f-5025-4810-888f-c4833c227701-istio-token\") on node \"ip-10-0-143-165.ec2.internal\" DevicePath \"\""
Sep 10 22:36:16.112732 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.112699    2573 generic.go:356] "Generic (PLEG): container finished" podID="4877045f-5025-4810-888f-c4833c227701" containerID="1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4" exitCode=0
Sep 10 22:36:16.112898 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.112745    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"
Sep 10 22:36:16.112898 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.112782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" event={"ID":"4877045f-5025-4810-888f-c4833c227701","Type":"ContainerDied","Data":"1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4"}
Sep 10 22:36:16.112898 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.112833    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f" event={"ID":"4877045f-5025-4810-888f-c4833c227701","Type":"ContainerDied","Data":"a3d8678328854efd8b0af4d7994fa7275e13cdad3e6b5364b7e322e2420654c1"}
Sep 10 22:36:16.112898 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.112868    2573 scope.go:117] "RemoveContainer" containerID="1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4"
Sep 10 22:36:16.122694 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.122677    2573 scope.go:117] "RemoveContainer" containerID="763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425"
Sep 10 22:36:16.131519 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.131497    2573 scope.go:117] "RemoveContainer" containerID="1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4"
Sep 10 22:36:16.131937 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:36:16.131914    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4\": container with ID starting with 1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4 not found: ID does not exist" containerID="1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4"
Sep 10 22:36:16.132014 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.131943    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4"} err="failed to get container status \"1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4\": rpc error: code = NotFound desc = could not find container \"1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4\": container with ID starting with 1fcaff746119aa81eb0162a8c646bcf915f1ea995e9afb720b271e8fb8a239f4 not found: ID does not exist"
Sep 10 22:36:16.132014 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.131960    2573 scope.go:117] "RemoveContainer" containerID="763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425"
Sep 10 22:36:16.132270 ip-10-0-143-165 kubenswrapper[2573]: E0910 22:36:16.132249    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425\": container with ID starting with 763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425 not found: ID does not exist" containerID="763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425"
Sep 10 22:36:16.132327 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.132279    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425"} err="failed to get container status \"763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425\": rpc error: code = NotFound desc = could not find container \"763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425\": container with ID starting with 763a675baa3fb0de424ecac11ae6d29ffec65dd78d45e2d61d24116aafb48425 not found: ID does not exist"
Sep 10 22:36:16.134224 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.134200    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"]
Sep 10 22:36:16.136445 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.136424    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0ada08-openshift-default-568bd48b7d-bjs8f"]
Sep 10 22:36:16.553553 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:16.553528    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4877045f-5025-4810-888f-c4833c227701" path="/var/lib/kubelet/pods/4877045f-5025-4810-888f-c4833c227701/volumes"
Sep 10 22:36:20.953911 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:20.953883    2573 scope.go:117] "RemoveContainer" containerID="0d78fb0066615b81077b322ba87e9b81bdfb1d7a69c90a83c5b86ee89804b7f8"
Sep 10 22:36:20.961994 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:20.961975    2573 scope.go:117] "RemoveContainer" containerID="209aa8de9383a68cc2b2b54cd5074ad1cc8d62238b0be1d4a8f9c0ba4a3db1cf"
Sep 10 22:36:20.969253 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:20.969236    2573 scope.go:117] "RemoveContainer" containerID="c0a93a2a57c228fa9344d7d919080d69ece7583abc746d12d01bca34965ec5a0"
Sep 10 22:36:20.976361 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:36:20.976345    2573 scope.go:117] "RemoveContainer" containerID="0cf44a0f44b6ec09d828d966701eedb67b534a52012036abf1aa383d39137058"
Sep 10 22:37:04.397481 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:37:04.397446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:37:21.021662 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:37:21.021625    2573 scope.go:117] "RemoveContainer" containerID="bab66b1314b9913dafb9b3cff446cdeebf82e4d7ecc6d8b62307ecfd4991f1b3"
Sep 10 22:37:21.029961 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:37:21.029941    2573 scope.go:117] "RemoveContainer" containerID="3b69b224b425d73125130b844afab9028c4189386878c159825d181d2541bd7f"
Sep 10 22:37:36.978996 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:37:36.978959    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:37:38.513104 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:37:38.513077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:37:53.895604 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:37:53.895574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:38:27.225634 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:38:27.225559    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:06.907397 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:39:06.907358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:20.721562 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:40:20.721528    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:40:20.726659 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:40:20.726627    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:40:21.070044 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:40:21.069960    2573 scope.go:117] "RemoveContainer" containerID="edb5de2b2bdd7ebe2ddfef2dbf3cde339b01915916b33893a1fdddc79ac7b692"
Sep 10 22:40:23.545048 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:40:23.545015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:37.478044 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:40:37.478001    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:05.681631 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:05.681595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:06.916745 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:06.916715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:21.090819 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:21.090746    2573 scope.go:117] "RemoveContainer" containerID="ba1f5d876ce25d6937aa2dce9240f8dc479b55744330491e8d3785c3dc09292f"
Sep 10 22:41:31.943527 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.943495    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"]
Sep 10 22:41:31.943930 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.943915    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy"
Sep 10 22:41:31.943982 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.943932    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy"
Sep 10 22:41:31.943982 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.943946    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07137a0c-9a4a-42cf-8037-c6afa52d128c" containerName="revoke-keys"
Sep 10 22:41:31.943982 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.943951    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="07137a0c-9a4a-42cf-8037-c6afa52d128c" containerName="revoke-keys"
Sep 10 22:41:31.944078 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.944021    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy"
Sep 10 22:41:31.944078 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.944030    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="07137a0c-9a4a-42cf-8037-c6afa52d128c" containerName="revoke-keys"
Sep 10 22:41:31.944078 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.944040    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy"
Sep 10 22:41:31.947115 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.947093    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:31.952258 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.952236    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zvqzg\""
Sep 10 22:41:31.952406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.952315    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 22:41:31.952406 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.952343    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 22:41:31.962172 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.962144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b0f398-ee82-481a-ac6c-4124e4da4337-openshift-service-ca\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:31.962299 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.962196    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7b0f398-ee82-481a-ac6c-4124e4da4337-maas-api-tls\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:31.962366 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.962317    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6kcf\" (UniqueName: \"kubernetes.io/projected/d7b0f398-ee82-481a-ac6c-4124e4da4337-kube-api-access-c6kcf\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:31.962425 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.962369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7b0f398-ee82-481a-ac6c-4124e4da4337-metrics-certs\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:31.964065 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:31.964045    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"]
Sep 10 22:41:32.063320 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.063286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7b0f398-ee82-481a-ac6c-4124e4da4337-maas-api-tls\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:32.063477 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.063344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6kcf\" (UniqueName: \"kubernetes.io/projected/d7b0f398-ee82-481a-ac6c-4124e4da4337-kube-api-access-c6kcf\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:32.063477 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.063373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7b0f398-ee82-481a-ac6c-4124e4da4337-metrics-certs\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:32.063477 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.063444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b0f398-ee82-481a-ac6c-4124e4da4337-openshift-service-ca\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:32.064136 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.064116    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b0f398-ee82-481a-ac6c-4124e4da4337-openshift-service-ca\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:32.065811 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.065792    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7b0f398-ee82-481a-ac6c-4124e4da4337-metrics-certs\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:32.065946 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.065924    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7b0f398-ee82-481a-ac6c-4124e4da4337-maas-api-tls\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:32.075453 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.075430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6kcf\" (UniqueName: \"kubernetes.io/projected/d7b0f398-ee82-481a-ac6c-4124e4da4337-kube-api-access-c6kcf\") pod \"maas-api-65c67cbdfc-rs6k6\" (UID: \"d7b0f398-ee82-481a-ac6c-4124e4da4337\") " pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:32.257652 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.257625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:32.531045 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.531017    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"]
Sep 10 22:41:32.533241 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:41:32.533213    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b0f398_ee82_481a_ac6c_4124e4da4337.slice/crio-606d0f16d5d815b884323840e6c158d2c1a95eb9538c28f10fb4e9a5b056c6eb WatchSource:0}: Error finding container 606d0f16d5d815b884323840e6c158d2c1a95eb9538c28f10fb4e9a5b056c6eb: Status 404 returned error can't find the container with id 606d0f16d5d815b884323840e6c158d2c1a95eb9538c28f10fb4e9a5b056c6eb
Sep 10 22:41:32.534663 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.534643    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:41:32.832089 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:32.832008    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6" event={"ID":"d7b0f398-ee82-481a-ac6c-4124e4da4337","Type":"ContainerStarted","Data":"606d0f16d5d815b884323840e6c158d2c1a95eb9538c28f10fb4e9a5b056c6eb"}
Sep 10 22:41:34.847142 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:34.847102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6" event={"ID":"d7b0f398-ee82-481a-ac6c-4124e4da4337","Type":"ContainerStarted","Data":"d6689cec5fea54d6cca608fa73ce0ae8677d317e2307ebf45f7fba2f6ffe015f"}
Sep 10 22:41:34.847579 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:34.847228    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:34.866774 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:34.866727    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6" podStartSLOduration=1.720295108 podStartE2EDuration="3.866713518s" totalImagesPullingTime="2.14641841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:41:34.865331085 +0000 UTC m=+2174.747815450" watchObservedRunningTime="2026-09-10 22:41:34.866713518 +0000 UTC m=+2174.749197883"
Sep 10 22:41:40.859342 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:40.859314    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65c67cbdfc-rs6k6"
Sep 10 22:41:59.874005 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:59.873973    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8x68v_9bf6d489-fd48-4085-985a-1e5fe937a1e1/server/0.log"
Sep 10 22:41:59.993468 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:41:59.993442    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-krh5h_6bdce8c4-19ce-40a6-b655-4d553eb343f7/manager/0.log"
Sep 10 22:42:00.123956 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:00.123927    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-995c55587-gtrgf_f55faeca-5a5f-4513-ac52-ef9bb299bb84/copy-manifests/0.log"
Sep 10 22:42:00.131077 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:00.131020    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-995c55587-gtrgf_f55faeca-5a5f-4513-ac52-ef9bb299bb84/manager/0.log"
Sep 10 22:42:00.876809 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:00.876782    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65c67cbdfc-rs6k6_d7b0f398-ee82-481a-ac6c-4124e4da4337/maas-api/0.log"
Sep 10 22:42:00.988702 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:00.988676    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817990-4h9tm_6759aae3-6750-44ea-8ca2-bd4f1c4d5b6c/cleanup/0.log"
Sep 10 22:42:01.117680 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:01.117650    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-blgfr_cc8ab1c7-d052-4bd7-b30f-87df4d39d781/postgres/0.log"
Sep 10 22:42:03.003120 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:03.003081    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vhvfq_ea17a3f9-55d8-4052-aca0-14711fbe4fdd/discovery/0.log"
Sep 10 22:42:03.577199 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:03.577171    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2rcbw_630e1db1-b0aa-4af2-9a0b-428332191632/payload-processing/0.log"
Sep 10 22:42:03.689611 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:03.689589    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-667fd765fd-m6pm2_105f8943-255b-46e5-8c62-fcf108093fd6/router/0.log"
Sep 10 22:42:04.260515 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:04.260483    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-ftct2_7adfe3e6-0c9d-4365-aacb-93796704c633/main/0.log"
Sep 10 22:42:04.613347 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:04.613273    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-klhdb_d4292fcf-a830-4ab6-9cc0-227223859d87/main/0.log"
Sep 10 22:42:10.535457 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:10.535422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:11.793423 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:11.793387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:13.441606 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:13.441572    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-svkw5_16f500b5-5bb9-4835-aca8-27d68fbe830c/global-pull-secret-syncer/0.log"
Sep 10 22:42:13.494196 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:13.494172    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log"
Sep 10 22:42:13.650924 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:13.650894    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-165.ec2.internal_a3752174baf855d01c4a6df678c4937e/haproxy/0.log"
Sep 10 22:42:20.701829 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:20.701755    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-vqpml_50433e03-796a-4b4d-bfc0-a0efcbd83db3/kube-state-metrics/0.log"
Sep 10 22:42:20.720714 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:20.720693    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-vqpml_50433e03-796a-4b4d-bfc0-a0efcbd83db3/kube-rbac-proxy-main/0.log"
Sep 10 22:42:20.741717 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:20.741698    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-vqpml_50433e03-796a-4b4d-bfc0-a0efcbd83db3/kube-rbac-proxy-self/0.log"
Sep 10 22:42:20.945771 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:20.945745    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dbnnr_3b4162eb-a042-44d4-b112-7079a47e0197/node-exporter/0.log"
Sep 10 22:42:20.969066 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:20.969003    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dbnnr_3b4162eb-a042-44d4-b112-7079a47e0197/kube-rbac-proxy/0.log"
Sep 10 22:42:21.001290 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:21.001267    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dbnnr_3b4162eb-a042-44d4-b112-7079a47e0197/init-textfile/0.log"
Sep 10 22:42:21.110549 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:21.110522    2573 scope.go:117] "RemoveContainer" containerID="9e46edc060be0720d1d7242c44beb3567d16ab9af665abc903c6b14a290d26cf"
Sep 10 22:42:21.119046 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:21.119027    2573 scope.go:117] "RemoveContainer" containerID="11c09f32e123cd29e0174e7882bb7d215afd7051df7ea9fc8227c47232a2dc61"
Sep 10 22:42:21.125502 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:21.125484    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-5fgpq_16db36dc-8ad1-4a35-a222-503aab7c70fe/kube-rbac-proxy-main/0.log"
Sep 10 22:42:21.148793 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:21.148778    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-5fgpq_16db36dc-8ad1-4a35-a222-503aab7c70fe/kube-rbac-proxy-self/0.log"
Sep 10 22:42:21.174478 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:21.174457    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-5fgpq_16db36dc-8ad1-4a35-a222-503aab7c70fe/openshift-state-metrics/0.log"
Sep 10 22:42:21.409436 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:21.409405    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-8xrsp_82c184ce-0577-4bad-a662-624ce62bb9b3/prometheus-operator/0.log"
Sep 10 22:42:21.434229 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:21.434209    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-8xrsp_82c184ce-0577-4bad-a662-624ce62bb9b3/kube-rbac-proxy/0.log"
Sep 10 22:42:23.057885 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.057833    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"]
Sep 10 22:42:23.058407 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.058386    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy"
Sep 10 22:42:23.058491 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.058410    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4877045f-5025-4810-888f-c4833c227701" containerName="istio-proxy"
Sep 10 22:42:23.065274 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.065244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.067619 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.067595    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f4kkc\"/\"kube-root-ca.crt\""
Sep 10 22:42:23.067760 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.067743    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f4kkc\"/\"openshift-service-ca.crt\""
Sep 10 22:42:23.068267 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.068249    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f4kkc\"/\"default-dockercfg-8m4xn\""
Sep 10 22:42:23.073518 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.073499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"]
Sep 10 22:42:23.098525 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.098500    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-podres\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.098652 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.098548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-sys\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.098652 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.098605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-lib-modules\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.098652 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.098627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-proc\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.098652 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.098651    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqx6x\" (UniqueName: \"kubernetes.io/projected/f80008e4-3525-4f1a-99d1-b97030fbb38c-kube-api-access-cqx6x\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.200002 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.199972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-lib-modules\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.200141 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.200013    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-proc\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.200141 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.200052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqx6x\" (UniqueName: \"kubernetes.io/projected/f80008e4-3525-4f1a-99d1-b97030fbb38c-kube-api-access-cqx6x\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.200141 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.200098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-podres\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.200283 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.200152    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-lib-modules\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.200283 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.200160    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-sys\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.200283 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.200155    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-proc\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.200283 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.200217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-podres\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.200283 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.200241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f80008e4-3525-4f1a-99d1-b97030fbb38c-sys\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.208783 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.208757    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqx6x\" (UniqueName: \"kubernetes.io/projected/f80008e4-3525-4f1a-99d1-b97030fbb38c-kube-api-access-cqx6x\") pod \"perf-node-gather-daemonset-z6smc\" (UID: \"f80008e4-3525-4f1a-99d1-b97030fbb38c\") " pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.376447 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.376372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:23.402063 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.402035    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/1.log"
Sep 10 22:42:23.406609 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.406588    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dp2pn_655ef482-45b1-4d0d-9912-25381723f2f5/console-operator/2.log"
Sep 10 22:42:23.646682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.646660    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"]
Sep 10 22:42:23.649100 ip-10-0-143-165 kubenswrapper[2573]: W0910 22:42:23.649072    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf80008e4_3525_4f1a_99d1_b97030fbb38c.slice/crio-13e43b0042bbe3912941760322cce78f4fce29ecb16fcdc82d4690b9d05c59dc WatchSource:0}: Error finding container 13e43b0042bbe3912941760322cce78f4fce29ecb16fcdc82d4690b9d05c59dc: Status 404 returned error can't find the container with id 13e43b0042bbe3912941760322cce78f4fce29ecb16fcdc82d4690b9d05c59dc
Sep 10 22:42:23.935757 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:23.935682    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d8d48d9f4-ssjwc_64205144-82ee-4d29-934c-a7d88785ff6a/console/0.log"
Sep 10 22:42:24.112305 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:24.112271    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc" event={"ID":"f80008e4-3525-4f1a-99d1-b97030fbb38c","Type":"ContainerStarted","Data":"b511de01147f800e9700ca4a9ca6162a35009a0955603682c80e9f8aea2124ad"}
Sep 10 22:42:24.112682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:24.112352    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc" event={"ID":"f80008e4-3525-4f1a-99d1-b97030fbb38c","Type":"ContainerStarted","Data":"13e43b0042bbe3912941760322cce78f4fce29ecb16fcdc82d4690b9d05c59dc"}
Sep 10 22:42:24.112682 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:24.112374    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:24.127608 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:24.127565    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc" podStartSLOduration=1.127550102 podStartE2EDuration="1.127550102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:42:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:42:24.12566544 +0000 UTC m=+2224.008149806" watchObservedRunningTime="2026-09-10 22:42:24.127550102 +0000 UTC m=+2224.010034468"
Sep 10 22:42:24.629550 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:24.629521    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-ts2dr_34efec45-a4c2-4a2f-b496-337e64ae46f3/volume-data-source-validator/0.log"
Sep 10 22:42:25.744478 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:25.744448    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64wxb_84494055-3279-435f-b7c7-e85cb4753c2f/dns/0.log"
Sep 10 22:42:25.769226 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:25.769204    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64wxb_84494055-3279-435f-b7c7-e85cb4753c2f/kube-rbac-proxy/0.log"
Sep 10 22:42:25.918189 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:25.918160    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c47x8_4b00e522-ca7d-42f2-8ad1-cdc860c83856/dns-node-resolver/0.log"
Sep 10 22:42:26.450832 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:26.450800    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d88f9f94c-bcq7n_329b699d-4974-4555-995a-a28f6547dfa1/registry/0.log"
Sep 10 22:42:26.560022 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:26.559995    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zgbcm_401a84c5-0ae9-4eb7-80c1-f1b782c022ad/node-ca/0.log"
Sep 10 22:42:27.681172 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:27.681139    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vhvfq_ea17a3f9-55d8-4052-aca0-14711fbe4fdd/discovery/0.log"
Sep 10 22:42:27.838605 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:27.838577    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2rcbw_630e1db1-b0aa-4af2-9a0b-428332191632/payload-processing/0.log"
Sep 10 22:42:27.860966 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:27.860945    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-667fd765fd-m6pm2_105f8943-255b-46e5-8c62-fcf108093fd6/router/0.log"
Sep 10 22:42:28.776015 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:28.775984    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xw587_365134e3-4e3d-47e5-b6f2-43cfa412d5b6/serve-healthcheck-canary/0.log"
Sep 10 22:42:29.333789 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:29.333761    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-crgrg_3b26f5bb-0f72-47e9-88a4-6ed90846e8d8/kube-rbac-proxy/0.log"
Sep 10 22:42:29.360450 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:29.360425    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-crgrg_3b26f5bb-0f72-47e9-88a4-6ed90846e8d8/exporter/0.log"
Sep 10 22:42:29.383922 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:29.383900    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-crgrg_3b26f5bb-0f72-47e9-88a4-6ed90846e8d8/extractor/0.log"
Sep 10 22:42:30.048285 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:30.048252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zcsl_3e4a241f-3d98-46de-a331-337365b84c14/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:30.127641 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:30.127616    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f4kkc/perf-node-gather-daemonset-z6smc"
Sep 10 22:42:31.995998 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:31.995974    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8x68v_9bf6d489-fd48-4085-985a-1e5fe937a1e1/server/0.log"
Sep 10 22:42:32.079152 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:32.079125    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-krh5h_6bdce8c4-19ce-40a6-b655-4d553eb343f7/manager/0.log"
Sep 10 22:42:32.104696 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:32.104669    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-995c55587-gtrgf_f55faeca-5a5f-4513-ac52-ef9bb299bb84/manager/0.log"
Sep 10 22:42:32.134927 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:32.128728    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-995c55587-gtrgf_f55faeca-5a5f-4513-ac52-ef9bb299bb84/copy-manifests/0.log"
Sep 10 22:42:33.681222 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:33.681193    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-578b4977d8-qvlq5_4b888925-3e16-4a7b-94bf-d1b98c5a2b17/manager/0.log"
Sep 10 22:42:34.018636 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:34.018609    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vhvfq_ea17a3f9-55d8-4052-aca0-14711fbe4fdd/discovery/0.log"
Sep 10 22:42:34.128669 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:34.128644    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2rcbw_630e1db1-b0aa-4af2-9a0b-428332191632/payload-processing/0.log"
Sep 10 22:42:34.151010 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:34.150988    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-667fd765fd-m6pm2_105f8943-255b-46e5-8c62-fcf108093fd6/router/0.log"
Sep 10 22:42:35.859672 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:35.859645    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vhvfq_ea17a3f9-55d8-4052-aca0-14711fbe4fdd/discovery/0.log"
Sep 10 22:42:35.985825 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:35.985798    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2rcbw_630e1db1-b0aa-4af2-9a0b-428332191632/payload-processing/0.log"
Sep 10 22:42:36.000756 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:36.000724    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-667fd765fd-m6pm2_105f8943-255b-46e5-8c62-fcf108093fd6/router/0.log"
Sep 10 22:42:39.042092 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:39.042063    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-8c78r_b3dad17d-e969-4018-a4e2-972bb16cd582/kube-storage-version-migrator-operator/1.log"
Sep 10 22:42:39.043047 ip-10-0-143-165 kubenswrapper[2573]: I0910 22:42:39.043027    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-8c78r_b3dad17d-e969-4018-a4e2-972bb16cd582/kube-storage-version-migrator-operator/0.log"