Sep 16 11:58:36.712173 ip-10-0-134-254 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 11:58:36.712185 ip-10-0-134-254 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 11:58:36.712192 ip-10-0-134-254 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 11:58:36.712421 ip-10-0-134-254 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 11:58:46.940257 ip-10-0-134-254 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 11:58:46.940276 ip-10-0-134-254 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2318d8a99958433585d20a74d7624df0 --
Sep 16 12:00:43.448947 ip-10-0-134-254 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 12:00:43.816154 ip-10-0-134-254 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:00:43.816154 ip-10-0-134-254 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 12:00:43.816154 ip-10-0-134-254 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:00:43.816154 ip-10-0-134-254 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 12:00:43.816154 ip-10-0-134-254 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:00:43.817001 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.816931    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 12:00:43.821336 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821320    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:43.821336 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821336    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821341    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821345    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821348    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821351    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821354    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821357    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821360    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821363    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821366    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821369    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821372    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821375    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821378    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821380    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821383    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821386    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821388    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821392    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821394    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:43.821402 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821397    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821400    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821403    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821407    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821410    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821413    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821417    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821419    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821422    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821424    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821427    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821429    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821432    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821435    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821437    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821440    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821442    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821445    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:43.821898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821450    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821453    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821456    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821459    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821462    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821465    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821467    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821470    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821472    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821475    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821477    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821480    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821482    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821485    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821488    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821491    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821494    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821497    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821499    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821502    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:43.822361 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821504    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821507    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821510    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821513    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821515    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821518    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821520    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821523    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821525    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821528    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821530    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821533    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821536    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821538    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821541    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821543    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821546    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821548    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821551    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821554    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:43.822864 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821556    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821560    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821563    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821566    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821568    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821571    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821574    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821576    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821580    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821583    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821585    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821588    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821591    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821593    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821596    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821599    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821601    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821604    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821607    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.821609    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:43.823352 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822269    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822275    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822278    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822281    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822284    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822287    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822289    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822293    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822297    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822300    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822303    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822306    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822309    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822311    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822314    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822317    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822319    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822322    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822325    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:43.823856 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822328    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822331    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822334    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822336    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822339    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822342    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822344    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822348    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822352    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822355    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822358    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822361    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822364    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822367    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822369    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822372    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822375    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822378    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822380    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:43.824324 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822383    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822385    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822388    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822391    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822394    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822396    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822399    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822402    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822404    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822407    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822409    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822412    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822416    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822420    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822424    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822427    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822430    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822432    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822435    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:43.824836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822437    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822440    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822444    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822446    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822449    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822451    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822454    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822456    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822459    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822462    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822464    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822467    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822469    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822472    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822475    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822477    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822480    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822483    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822485    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822488    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:43.825303 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822490    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822493    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822495    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822498    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822501    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822505    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822508    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822510    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822514    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822517    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822519    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822522    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822524    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822527    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822530    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822532    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822535    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822537    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822540    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822542    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:43.825792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822545    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822548    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822889    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822894    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822897    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822900    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822903    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822905    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822908    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822910    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822913    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822917    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822919    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822922    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822925    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822927    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822930    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822934    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822937    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822940    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:43.826290 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822943    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822945    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822948    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822950    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822953    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822955    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822958    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822961    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822963    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822966    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822968    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822971    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822973    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822976    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822978    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822981    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822984    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822986    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822989    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:43.826795 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822992    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822994    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.822997    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823000    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823002    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823006    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823010    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823013    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823016    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823019    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823024    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823027    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823029    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823032    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823035    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823038    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823041    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823044    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823046    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:43.827258 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823049    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823051    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823054    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823058    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823061    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823064    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823067    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823070    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823072    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823075    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823078    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823080    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823082    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823085    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823088    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823090    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823093    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823095    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823098    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823100    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:43.827736 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823103    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823105    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823108    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823111    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823114    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823116    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823119    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823121    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823124    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823127    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823129    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823132    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823134    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823137    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823139    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823142    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823144    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823147    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823149    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823152    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:43.828215 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823154    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823157    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823159    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823223    2559 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823256    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823262    2559 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823266    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823270    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823273    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823277    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823280    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823284    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823287    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823290    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823293    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823298    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823301    2559 flags.go:64] FLAG: --cgroup-root=""
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823304    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823307    2559 flags.go:64] FLAG: --client-ca-file=""
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823309    2559 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823312    2559 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823316    2559 flags.go:64] FLAG: --cluster-domain=""
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823320    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823323    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 12:00:43.828725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823326    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823329    2559 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823333    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823336    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823339    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823342    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823345    2559 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823348    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823352    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823355    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823358    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823362    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823365    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823368    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823371    2559 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823374    2559 flags.go:64] FLAG: --enable-server="true"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823377    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823381    2559 flags.go:64] FLAG: --event-burst="100"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823384    2559 flags.go:64] FLAG: --event-qps="50"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823387    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823390    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823393    2559 flags.go:64] FLAG: --eviction-hard=""
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823396    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823399    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823402    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 12:00:43.829378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823405    2559 flags.go:64] FLAG: --eviction-soft=""
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823408    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823411    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823414    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823417    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823424    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823427    2559 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823430    2559 flags.go:64] FLAG: --feature-gates=""
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823437    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823440    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823443    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823446    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823449    2559 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823454    2559 flags.go:64] FLAG: --help="false"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823457    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-134-254.ec2.internal"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823460    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823463    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823465    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823468    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823472    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823475    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823478    2559 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823481    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 12:00:43.830022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823483    2559 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823486    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823489    2559 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823492    2559 flags.go:64] FLAG: --kube-reserved=""
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823495    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823498    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823501    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823504    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823507    2559 flags.go:64] FLAG: --lock-file=""
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823509    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823513    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823516    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823521    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823524    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823527    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823530    2559 flags.go:64] FLAG: --logging-format="text"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823533    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823536    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823539    2559 flags.go:64] FLAG: --manifest-url=""
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823542    2559 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823546    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823549    2559 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823555    2559 flags.go:64] FLAG: --max-pods="110"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823557    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823560    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 12:00:43.830948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823563    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823566    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823569    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823572    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823575    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823581    2559 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823584    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823587    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823590    2559 flags.go:64] FLAG: --pod-cidr=""
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823593    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823598    2559 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823601    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823604    2559 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823607    2559 flags.go:64] FLAG: --port="10250"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823610    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823613    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b6d60f6a96f933bd"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823617    2559 flags.go:64] FLAG: --qos-reserved=""
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823620    2559 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823622    2559 flags.go:64] FLAG: --register-node="true"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823626    2559 flags.go:64] FLAG: --register-with-taints=""
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823629    2559 flags.go:64] FLAG: --registry-burst="10"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823632    2559 flags.go:64] FLAG: --registry-qps="5"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823635    2559 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823638    2559 flags.go:64] FLAG: --reserved-memory=""
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823642    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 12:00:43.831806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823645    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823648    2559 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823651    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823653    2559 flags.go:64] FLAG: --runonce="false"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823657    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823660    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823664    2559 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823667    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823669    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823672    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823675    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823679    2559 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823682    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823684    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823687    2559 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823690    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823706    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823709    2559 flags.go:64] FLAG: --system-cgroups=""
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823712    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823717    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823720    2559 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823723    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823726    2559 flags.go:64] FLAG: --tls-min-version=""
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823729    2559 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823732    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 12:00:43.832425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823735    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823737    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823740    2559 flags.go:64] FLAG: --v="2"
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823744    2559 flags.go:64] FLAG: --version="false"
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823747    2559 flags.go:64] FLAG: --vmodule=""
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823751    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.823754    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823859    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823863    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823866    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823869    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823873    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823876    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823878    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823881    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823883    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823886    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823888    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823891    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823894    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823896    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823899    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:43.833044 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823901    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823903    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823906    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823909    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823911    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823915    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823918    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823922    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823926    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823929    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823932    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823935    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823938    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823940    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823943    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823945    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823948    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823951    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823953    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823956    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:43.833570 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823959    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823963    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823965    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823968    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823970    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823973    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823975    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823978    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823980    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823983    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823986    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823988    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823991    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823993    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823996    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.823999    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824001    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824005    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824007    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824010    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:43.834071 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824012    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824015    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824018    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824020    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824023    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824025    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824028    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824031    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824033    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824036    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824038    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824041    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824044    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824049    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824054    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824058    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824060    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824063    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824066    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:43.834582 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824068    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824070    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824073    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824075    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824078    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824081    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824083    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824086    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824088    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824091    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824095    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824097    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824100    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824102    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824105    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824110    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824113    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824116    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824119    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:43.835127 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824122    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824125    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824128    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824130    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824133    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.824136    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.824744    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.832962    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.832976    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.834862    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.834870    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834932    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834938    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834941    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834944    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:43.835600 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834947    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834950    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834953    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834957    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834959    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834962    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834965    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834967    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834970    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834973    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834976    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834979    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834982    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834984    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834987    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834990    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834992    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834995    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.834998    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835001    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:43.835990 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835004    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835006    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835009    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835012    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835015    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835018    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835021    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835024    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835026    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835029    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835032    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835034    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835037    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835040    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835042    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835045    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835048    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835050    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835053    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:43.836481 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835055    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835058    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835061    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835063    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835066    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835069    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835072    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835075    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835079    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835082    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835086    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835089    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835093    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835096    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835098    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835101    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835104    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835107    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835109    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835112    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:43.836958 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835115    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835117    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835120    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835123    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835125    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835128    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835131    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835133    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835136    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835139    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835141    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835144    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835147    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835150    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835152    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835155    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835158    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835162    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835164    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835167    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:43.837438 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835169    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835172    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835175    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835179    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835183    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835186    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835188    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835191    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835194    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835197    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835199    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835202    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835205    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835208    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835210    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:43.837960 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835214    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.835219    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835337    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835342    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835345    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835348    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835353    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835357    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835360    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835363    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835366    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835369    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835372    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835374    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:00:43.838326 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835378    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835381    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835384    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835386    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835389    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835391    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835394    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835396    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835399    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835402    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835404    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835407    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835409    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835412    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835415    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835417    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835420    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835424    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835427    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835430    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:00:43.838673 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835433    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835436    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835439    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835442    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835444    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835447    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835449    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835452    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835454    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835457    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835459    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835462    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835465    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835468    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835471    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835474    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835477    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835480    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835482    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835485    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:00:43.839214 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835487    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835490    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835494    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835497    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835501    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835503    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835506    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835509    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835511    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835514    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835516    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835519    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835521    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835524    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835527    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835529    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835532    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835535    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835537    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:00:43.839685 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835540    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835542    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835545    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835547    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835550    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835553    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835555    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835558    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835561    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835564    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835566    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835569    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835571    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835574    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835576    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835579    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835581    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835584    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835586    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835589    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:00:43.840165 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835591    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835594    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835596    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835599    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835602    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835605    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835607    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:43.835610    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.835615    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.835740    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.837999    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.838876    2559 server.go:1019] "Starting client certificate rotation"
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.838982    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:00:43.840665 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.839014    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:00:43.841811 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.841799    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:00:43.842976 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.842959    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:00:43.851063 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.851050    2559 log.go:25] "Validated CRI v1 runtime API"
Sep 16 12:00:43.854370 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.854354    2559 log.go:25] "Validated CRI v1 image API"
Sep 16 12:00:43.857915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.857899    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 12:00:43.860103 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.860084    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a986e10b-c97d-45d4-93c2-c8351de3c154:/dev/nvme0n1p4 b3c9b4b0-37b9-4328-b522-5252e76e742a:/dev/nvme0n1p3]
Sep 16 12:00:43.860190 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.860101    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 12:00:43.866624 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.866604    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:00:43.866801 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.866644    2559 manager.go:216] Machine: {Timestamp:2026-09-16 12:00:43.865479076 +0000 UTC m=+0.308513929 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3222529 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28da4c2cb7c0b2761e68c06e87b28e SystemUUID:ec28da4c-2cb7-c0b2-761e-68c06e87b28e BootID:2318d8a9-9958-4335-85d2-0a74d7624df0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d4:d5:b1:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d4:d5:b1:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:83:3b:0a:53:1b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 12:00:43.866886 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.866802    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 12:00:43.866932 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.866901    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 12:00:43.867922 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.867899    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 12:00:43.868067 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.867925    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-254.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 12:00:43.869425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.869415    2559 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 12:00:43.869459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.869428    2559 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 12:00:43.869459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.869436    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:00:43.870033 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.870023    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:00:43.871352 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.871342    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 12:00:43.874908 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.874896    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:00:43.875013 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.875004    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 12:00:43.875044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.875030    2559 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 12:00:43.875044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.875039    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 12:00:43.875094 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.875054    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 12:00:43.875094 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.875063    2559 kubelet.go:398] "Adding apiserver pod source"
Sep 16 12:00:43.875094 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.875075    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 12:00:43.875420 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.875408    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:00:43.875420 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.875426    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:00:43.877222 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.877205    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 12:00:43.879308 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.879295    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 12:00:43.879358 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.879325    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 12:00:43.881866 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881854    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 12:00:43.881913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881871    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 12:00:43.881913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881877    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 12:00:43.881913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881882    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 12:00:43.881913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881890    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 12:00:43.881913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881895    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 12:00:43.881913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881907    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 12:00:43.881913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881912    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 12:00:43.882088 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881918    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 12:00:43.882088 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881923    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 12:00:43.882088 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881932    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 12:00:43.882088 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.881937    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 12:00:43.882599 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.882590    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 12:00:43.882599 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.882598    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 12:00:43.884066 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:43.884035    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 12:00:43.884066 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:43.884037    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 12:00:43.884215 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.884203    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-254.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 12:00:43.886764 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.886749    2559 server.go:1268] "Started kubelet"
Sep 16 12:00:43.886942 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.886846    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 12:00:43.887034 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.886886    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 12:00:43.887107 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.887010    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 12:00:43.887712 ip-10-0-134-254 systemd[1]: Started Kubernetes Kubelet.
Sep 16 12:00:43.889573 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.889555    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 12:00:43.890396 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.890382    2559 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 12:00:43.891030 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:43.890995    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 12:00:43.891903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.891883    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pxkk9"
Sep 16 12:00:43.892076 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:43.891252    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-254.ec2.internal.18d5cb60e019c611  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-254.ec2.internal,UID:ip-10-0-134-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-254.ec2.internal,},FirstTimestamp:2026-09-16 12:00:43.886724625 +0000 UTC m=+0.329759479,LastTimestamp:2026-09-16 12:00:43.886724625 +0000 UTC m=+0.329759479,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-254.ec2.internal,}"
Sep 16 12:00:43.896415 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.896399    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 12:00:43.896500 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.896413    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 12:00:43.896500 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:43.896466    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:43.897084 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897065    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 12:00:43.897170 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897084    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pxkk9"
Sep 16 12:00:43.897170 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897101    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 12:00:43.897170 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897114    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 12:00:43.897306 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897219    2559 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 12:00:43.897306 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897228    2559 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 12:00:43.897493 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897479    2559 factory.go:55] Registering systemd factory
Sep 16 12:00:43.897493 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897494    2559 factory.go:223] Registration of the systemd container factory successfully
Sep 16 12:00:43.897688 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897673    2559 factory.go:153] Registering CRI-O factory
Sep 16 12:00:43.897688 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897707    2559 factory.go:223] Registration of the crio container factory successfully
Sep 16 12:00:43.897824 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897760    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 12:00:43.897824 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897775    2559 factory.go:103] Registering Raw factory
Sep 16 12:00:43.897824 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.897786    2559 manager.go:1196] Started watching for new ooms in manager
Sep 16 12:00:43.898129 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.898117    2559 manager.go:349] Starting recovery of all containers
Sep 16 12:00:43.909208 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.909186    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:43.909573 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.909549    2559 manager.go:354] Recovery completed
Sep 16 12:00:43.912162 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:43.912140    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-254.ec2.internal\" not found" node="ip-10-0-134-254.ec2.internal"
Sep 16 12:00:43.914210 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.914200    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:43.915888 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.915765    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:43.915888 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.915793    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:43.915888 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.915818    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:43.916396 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.916382    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 12:00:43.916396 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.916388    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:43.916396 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.916395    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 12:00:43.916563 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.916414    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:00:43.917104 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.917087    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:43.917177 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.917118    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:43.917177 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.917128    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:43.917416 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.917404    2559 policy_none.go:49] "None policy: Start"
Sep 16 12:00:43.917485 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.917421    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 12:00:43.917485 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.917435    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 12:00:43.918716 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.918689    2559 policy_none.go:47] "Start"
Sep 16 12:00:43.943668 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.943569    2559 manager.go:337] "Starting Device Plugin manager"
Sep 16 12:00:43.943781 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:43.943731    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 12:00:43.943781 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.943744    2559 server.go:87] "Starting device plugin registration server"
Sep 16 12:00:43.943973 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.943961    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 12:00:43.944015 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.943973    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 12:00:43.944091 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.944074    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 12:00:43.944195 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.944155    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 12:00:43.944195 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:43.944164    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 12:00:43.944663 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:43.944649    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 12:00:43.944743 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:43.944685    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.022528 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.022504    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 12:00:44.023585 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.023574    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 12:00:44.023646 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.023612    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 12:00:44.023646 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.023630    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 12:00:44.023743 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.023662    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 12:00:44.026010 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.025992    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:44.044907 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.044892    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:44.045619 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.045603    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:44.045707 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.045627    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:44.045707 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.045637    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:44.045707 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.045655    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.054606 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.054584    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.054664 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.054607    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-254.ec2.internal\": node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.071984 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.071933    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.124299 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.124279    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal"]
Sep 16 12:00:44.124381 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.124338    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:44.125123 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.125100    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:44.125201 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.125126    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:44.125201 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.125140    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:44.126320 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.126306    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:44.126441 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.126427    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.126489 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.126454    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:44.127028 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.127011    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:44.127028 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.127021    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:44.127115 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.127042    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:44.127115 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.127056    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:44.127115 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.127042    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:44.127115 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.127114    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:44.128087 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.128072    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.128157 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.128095    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:00:44.128779 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.128762    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:00:44.128842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.128790    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:00:44.128842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.128804    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:00:44.150183 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.150161    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-254.ec2.internal\" not found" node="ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.154218 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.154204    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-254.ec2.internal\" not found" node="ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.173012 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.172995    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.198706 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.198679    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d08afcddc68f55b21ba091d1f6f66b29-config\") pod \"kube-apiserver-proxy-ip-10-0-134-254.ec2.internal\" (UID: \"d08afcddc68f55b21ba091d1f6f66b29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.198766 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.198710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e04180e7178d889d528d8d3b81c66bf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal\" (UID: \"e04180e7178d889d528d8d3b81c66bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.198766 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.198726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e04180e7178d889d528d8d3b81c66bf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal\" (UID: \"e04180e7178d889d528d8d3b81c66bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.273985 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.273962    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.299292 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.299276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e04180e7178d889d528d8d3b81c66bf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal\" (UID: \"e04180e7178d889d528d8d3b81c66bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.299292 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.299288    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e04180e7178d889d528d8d3b81c66bf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal\" (UID: \"e04180e7178d889d528d8d3b81c66bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.299391 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.299305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e04180e7178d889d528d8d3b81c66bf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal\" (UID: \"e04180e7178d889d528d8d3b81c66bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.299391 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.299321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d08afcddc68f55b21ba091d1f6f66b29-config\") pod \"kube-apiserver-proxy-ip-10-0-134-254.ec2.internal\" (UID: \"d08afcddc68f55b21ba091d1f6f66b29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.299391 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.299334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e04180e7178d889d528d8d3b81c66bf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal\" (UID: \"e04180e7178d889d528d8d3b81c66bf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.299391 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.299374    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d08afcddc68f55b21ba091d1f6f66b29-config\") pod \"kube-apiserver-proxy-ip-10-0-134-254.ec2.internal\" (UID: \"d08afcddc68f55b21ba091d1f6f66b29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.374559 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.374520    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.453019 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.452997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.457461 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.457442    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:44.475429 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.475410    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.575901 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.575878    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.676074 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.676055    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.777258 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.777234    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.828973 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.828957    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:44.838634 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.838612    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 12:00:44.838812 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.838778    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:00:44.838812 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.838779    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:00:44.838939 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.838781    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:00:44.878279 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.878260    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:44.902960 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.902928    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 11:55:44 +0000 UTC" deadline="2028-05-20 09:43:43.661284839 +0000 UTC"
Sep 16 12:00:44.902960 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:44.902958    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14685h42m58.758329498s"
Sep 16 12:00:44.979262 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:44.979214    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:45.080249 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:45.079650    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:45.168219 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:45.168189    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04180e7178d889d528d8d3b81c66bf7.slice/crio-f8b6486cecb127f671b4339674d78e14ac4d1c6a21aaf189bd55a4e8a2ab36a5 WatchSource:0}: Error finding container f8b6486cecb127f671b4339674d78e14ac4d1c6a21aaf189bd55a4e8a2ab36a5: Status 404 returned error can't find the container with id f8b6486cecb127f671b4339674d78e14ac4d1c6a21aaf189bd55a4e8a2ab36a5
Sep 16 12:00:45.168626 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:45.168603    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08afcddc68f55b21ba091d1f6f66b29.slice/crio-0ab955cf86636d2e4ab8d80d44103dc4923223e0f6a7dc0b32fd3260d23525d6 WatchSource:0}: Error finding container 0ab955cf86636d2e4ab8d80d44103dc4923223e0f6a7dc0b32fd3260d23525d6: Status 404 returned error can't find the container with id 0ab955cf86636d2e4ab8d80d44103dc4923223e0f6a7dc0b32fd3260d23525d6
Sep 16 12:00:45.173822 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.173806    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:00:45.180594 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:45.180576    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-254.ec2.internal\" not found"
Sep 16 12:00:45.240189 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.240140    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:45.297742 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.297712    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:45.309073 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.309055    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:00:45.310093 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.310080    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal"
Sep 16 12:00:45.319219 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.319202    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:00:45.876982 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.876953    2559 apiserver.go:52] "Watching apiserver"
Sep 16 12:00:45.884662 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.884636    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 12:00:45.886213 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.886185    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-t4rw6","openshift-cluster-node-tuning-operator/tuned-8grw8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal","openshift-multus/multus-l2dgp","openshift-multus/network-metrics-daemon-th86b","kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr","openshift-dns/node-resolver-gbwzr","openshift-image-registry/node-ca-dhskk","openshift-multus/multus-additional-cni-plugins-wqc9k","openshift-network-diagnostics/network-check-target-2k6xr","openshift-network-operator/iptables-alerter-wpw9w","openshift-ovn-kubernetes/ovnkube-node-bwh6m","kube-system/global-pull-secret-syncer-7792l"]
Sep 16 12:00:45.887867 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.887844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:45.889571 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.889551    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.890819 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.890799    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 12:00:45.890917 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.890851    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:45.890988 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:45.890919    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:00:45.891121 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.891096    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gb646\""
Sep 16 12:00:45.891331 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.891158    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 12:00:45.891414 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.891192    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 12:00:45.892438 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.892417    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fcqrk\""
Sep 16 12:00:45.893246 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.892695    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 12:00:45.893246 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.892839    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 12:00:45.893246 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.892843    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 12:00:45.893246 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.892915    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 12:00:45.893246 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.893023    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 12:00:45.893246 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.893116    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 12:00:45.893246 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.893220    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.893911 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.893788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:45.893911 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:45.893874    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:00:45.895267 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.895238    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:45.896491 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.896466    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 12:00:45.896883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.896846    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 12:00:45.897041 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.897005    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hcwlc\""
Sep 16 12:00:45.897251 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.897232    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 12:00:45.897897 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.897369    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 12:00:45.897897 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.897775    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 12:00:45.898224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.898199    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jgr2j\""
Sep 16 12:00:45.898646 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.898624    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 12:00:45.898949 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.898929    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 12:00:45.899878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.899503    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:45.901505 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.901484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:00:45.901848 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.901822    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 12:00:45.902153 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.902098    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vjzqc\""
Sep 16 12:00:45.902282 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.902261    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 12:00:45.902523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.902506    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 12:00:45.903069 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.903047    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:45.904073 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.904027    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9hkhs\""
Sep 16 12:00:45.904073 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.904037    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 12:00:45.904234 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.904093    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 12:00:45.904499 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.904479    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:45.905585 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.905567    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-klnsl\""
Sep 16 12:00:45.905690 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.905633    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:00:45.906218 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.906196    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 12:00:45.906438 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.906419    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:45.906533 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:45.906496    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:00:45.906883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.906862    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 12:00:45.906976 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.906941    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 12:00:45.907101 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.907085    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4l8gt\""
Sep 16 12:00:45.907664 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.907646    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:45.908960 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.908938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-kubelet\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.909065 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.908975    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.909065 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7vfh\" (UniqueName: \"kubernetes.io/projected/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-kube-api-access-d7vfh\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.909065 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-cni-bin\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.909224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-var-lib-cni-bin\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.909224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909109    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-etc-kubernetes\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.909224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909145    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.909224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-run-k8s-cni-cncf-io\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.909224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-multus-conf-dir\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.909480 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cch69\" (UniqueName: \"kubernetes.io/projected/22f2b29c-104a-4588-aad9-65bde4875647-kube-api-access-cch69\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.909480 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909282    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-registration-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:45.909480 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-etc-selinux\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:45.909480 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msfq6\" (UniqueName: \"kubernetes.io/projected/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-kube-api-access-msfq6\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:45.909480 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-var-lib-kubelet\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.909480 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-run-ovn\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.909480 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22f2b29c-104a-4588-aad9-65bde4875647-cni-binary-copy\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/268eaad8-cdac-46d7-8412-4e2561bb9efe-serviceca\") pod \"node-ca-dhskk\" (UID: \"268eaad8-cdac-46d7-8412-4e2561bb9efe\") " pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-systemd-units\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-var-lib-openvswitch\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909649    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02034161-8299-407b-a512-5484c2272a6c-kubelet-config\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02034161-8299-407b-a512-5484c2272a6c-dbus\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-var-lib-cni-multus\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909747    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-socket-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:45.909825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909789    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw986\" (UniqueName: \"kubernetes.io/projected/8baa1341-2665-43af-abee-7297cf014daa-kube-api-access-bw986\") pod \"node-resolver-gbwzr\" (UID: \"8baa1341-2665-43af-abee-7297cf014daa\") " pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-ovnkube-script-lib\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-run-netns\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909865    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22f2b29c-104a-4588-aad9-65bde4875647-multus-daemon-config\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909927    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/268eaad8-cdac-46d7-8412-4e2561bb9efe-host\") pod \"node-ca-dhskk\" (UID: \"268eaad8-cdac-46d7-8412-4e2561bb9efe\") " pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.909981    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-ovnkube-config\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-ovn-node-metrics-cert\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-system-cni-dir\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q5dg\" (UniqueName: \"kubernetes.io/projected/268eaad8-cdac-46d7-8412-4e2561bb9efe-kube-api-access-8q5dg\") pod \"node-ca-dhskk\" (UID: \"268eaad8-cdac-46d7-8412-4e2561bb9efe\") " pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8baa1341-2665-43af-abee-7297cf014daa-hosts-file\") pod \"node-resolver-gbwzr\" (UID: \"8baa1341-2665-43af-abee-7297cf014daa\") " pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-etc-openvswitch\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-env-overrides\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910149    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx5b6\" (UniqueName: \"kubernetes.io/projected/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-kube-api-access-kx5b6\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910173    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910195    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-run-systemd\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910219    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-cni-netd\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.910374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-cnibin\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-multus-socket-dir-parent\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-sys-fs\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8baa1341-2665-43af-abee-7297cf014daa-tmp-dir\") pod \"node-resolver-gbwzr\" (UID: \"8baa1341-2665-43af-abee-7297cf014daa\") " pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910370    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-slash\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-node-log\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910471    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-45qxq\""
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-run-multus-certs\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-device-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910575    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-run-openvswitch\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-log-socket\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910491    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910622    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-multus-cni-dir\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-run-netns\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-hostroot\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:45.911182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.910830    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 12:00:45.912628 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.912577    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:00:45.932971 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.932952    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8ks7q"
Sep 16 12:00:45.940817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.940799    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8ks7q"
Sep 16 12:00:45.998092 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:45.998073    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 12:00:46.010986 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.010963    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8baa1341-2665-43af-abee-7297cf014daa-hosts-file\") pod \"node-resolver-gbwzr\" (UID: \"8baa1341-2665-43af-abee-7297cf014daa\") " pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:46.011097 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.010997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-etc-openvswitch\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011097 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-env-overrides\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011097 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011039    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5b6\" (UniqueName: \"kubernetes.io/projected/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-kube-api-access-kx5b6\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:46.011097 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011068    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-modprobe-d\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.011334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8baa1341-2665-43af-abee-7297cf014daa-hosts-file\") pod \"node-resolver-gbwzr\" (UID: \"8baa1341-2665-43af-abee-7297cf014daa\") " pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:46.011334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011173    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-etc-openvswitch\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.011334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-run-systemd\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-cni-netd\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011324    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011339    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-run-systemd\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-cni-netd\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-cnibin\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011395    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-cnibin\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-multus-socket-dir-parent\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-host\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-sys-fs\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011479    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8baa1341-2665-43af-abee-7297cf014daa-tmp-dir\") pod \"node-resolver-gbwzr\" (UID: \"8baa1341-2665-43af-abee-7297cf014daa\") " pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011498    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-multus-socket-dir-parent\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-slash\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-node-log\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011556    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-run-multus-certs\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-sys-fs\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011587    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-slash\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-env-overrides\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-device-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-run-openvswitch\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.011660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-run-multus-certs\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011653    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-node-log\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-log-socket\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011712    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-run-openvswitch\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-log-socket\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011769    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-device-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-multus-cni-dir\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011849    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8baa1341-2665-43af-abee-7297cf014daa-tmp-dir\") pod \"node-resolver-gbwzr\" (UID: \"8baa1341-2665-43af-abee-7297cf014daa\") " pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-run-netns\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-hostroot\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-multus-cni-dir\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-kubelet\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011915    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-run-netns\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-hostroot\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7vfh\" (UniqueName: \"kubernetes.io/projected/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-kube-api-access-d7vfh\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.011988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/261d3c92-c780-4939-8091-d610fc73fcd9-tmp\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012010    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/215b7997-e1a8-4b85-a03b-da890a22ead0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.012548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012033    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-kubelet\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fcf95c25-cb57-40a7-a833-a1df70924833-iptables-alerter-script\") pod \"iptables-alerter-wpw9w\" (UID: \"fcf95c25-cb57-40a7-a833-a1df70924833\") " pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-var-lib-kubelet\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xfvz\" (UniqueName: \"kubernetes.io/projected/fcf95c25-cb57-40a7-a833-a1df70924833-kube-api-access-9xfvz\") pod \"iptables-alerter-wpw9w\" (UID: \"fcf95c25-cb57-40a7-a833-a1df70924833\") " pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-cni-bin\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-var-lib-cni-bin\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012217    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-var-lib-cni-bin\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012254    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-cni-bin\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-etc-kubernetes\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4dc63791-1615-450f-8182-165405956a01-agent-certs\") pod \"konnectivity-agent-t4rw6\" (UID: \"4dc63791-1615-450f-8182-165405956a01\") " pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-sysctl-conf\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkz8c\" (UniqueName: \"kubernetes.io/projected/261d3c92-c780-4939-8091-d610fc73fcd9-kube-api-access-xkz8c\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012366    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-etc-kubernetes\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-run-k8s-cni-cncf-io\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012448    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.013440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-run-k8s-cni-cncf-io\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-multus-conf-dir\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cch69\" (UniqueName: \"kubernetes.io/projected/22f2b29c-104a-4588-aad9-65bde4875647-kube-api-access-cch69\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-systemd\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/215b7997-e1a8-4b85-a03b-da890a22ead0-cnibin\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/215b7997-e1a8-4b85-a03b-da890a22ead0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-registration-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-etc-selinux\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msfq6\" (UniqueName: \"kubernetes.io/projected/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-kube-api-access-msfq6\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012775    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-multus-conf-dir\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012836    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-registration-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012846    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-var-lib-kubelet\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012877    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-etc-selinux\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4dc63791-1615-450f-8182-165405956a01-konnectivity-ca\") pod \"konnectivity-agent-t4rw6\" (UID: \"4dc63791-1615-450f-8182-165405956a01\") " pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012914    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-var-lib-kubelet\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-sys\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/261d3c92-c780-4939-8091-d610fc73fcd9-etc-tuned\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.014345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.012989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcf95c25-cb57-40a7-a833-a1df70924833-host-slash\") pod \"iptables-alerter-wpw9w\" (UID: \"fcf95c25-cb57-40a7-a833-a1df70924833\") " pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013024    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-run-ovn\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.013145    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22f2b29c-104a-4588-aad9-65bde4875647-cni-binary-copy\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-run-ovn\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-kubernetes\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/215b7997-e1a8-4b85-a03b-da890a22ead0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013330    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/268eaad8-cdac-46d7-8412-4e2561bb9efe-serviceca\") pod \"node-ca-dhskk\" (UID: \"268eaad8-cdac-46d7-8412-4e2561bb9efe\") " pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-systemd-units\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-systemd-units\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.013454    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret podName:02034161-8299-407b-a512-5484c2272a6c nodeName:}" failed. No retries permitted until 2026-09-16 12:00:46.513424399 +0000 UTC m=+2.956459245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret") pod "global-pull-secret-syncer-7792l" (UID: "02034161-8299-407b-a512-5484c2272a6c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-var-lib-openvswitch\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.013555    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02034161-8299-407b-a512-5484c2272a6c-kubelet-config\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013623    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-var-lib-openvswitch\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.015259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02034161-8299-407b-a512-5484c2272a6c-dbus\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013668    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-var-lib-cni-multus\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.013691    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:00:46.513672807 +0000 UTC m=+2.956707663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013684    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02034161-8299-407b-a512-5484c2272a6c-kubelet-config\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013728    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-var-lib-cni-multus\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013775    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02034161-8299-407b-a512-5484c2272a6c-dbus\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-sysconfig\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-socket-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw986\" (UniqueName: \"kubernetes.io/projected/8baa1341-2665-43af-abee-7297cf014daa-kube-api-access-bw986\") pod \"node-resolver-gbwzr\" (UID: \"8baa1341-2665-43af-abee-7297cf014daa\") " pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22f2b29c-104a-4588-aad9-65bde4875647-cni-binary-copy\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-ovnkube-script-lib\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013939    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-sysctl-d\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/268eaad8-cdac-46d7-8412-4e2561bb9efe-serviceca\") pod \"node-ca-dhskk\" (UID: \"268eaad8-cdac-46d7-8412-4e2561bb9efe\") " pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013963    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-lib-modules\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-socket-dir\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.013999    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/215b7997-e1a8-4b85-a03b-da890a22ead0-system-cni-dir\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.016162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m48c6\" (UniqueName: \"kubernetes.io/projected/215b7997-e1a8-4b85-a03b-da890a22ead0-kube-api-access-m48c6\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-run-netns\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22f2b29c-104a-4588-aad9-65bde4875647-multus-daemon-config\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014170    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/268eaad8-cdac-46d7-8412-4e2561bb9efe-host\") pod \"node-ca-dhskk\" (UID: \"268eaad8-cdac-46d7-8412-4e2561bb9efe\") " pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-ovnkube-config\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-ovn-node-metrics-cert\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014239    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/268eaad8-cdac-46d7-8412-4e2561bb9efe-host\") pod \"node-ca-dhskk\" (UID: \"268eaad8-cdac-46d7-8412-4e2561bb9efe\") " pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014406    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-system-cni-dir\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-system-cni-dir\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-run\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014512    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q5dg\" (UniqueName: \"kubernetes.io/projected/268eaad8-cdac-46d7-8412-4e2561bb9efe-kube-api-access-8q5dg\") pod \"node-ca-dhskk\" (UID: \"268eaad8-cdac-46d7-8412-4e2561bb9efe\") " pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-ovnkube-script-lib\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/215b7997-e1a8-4b85-a03b-da890a22ead0-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014587    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22f2b29c-104a-4588-aad9-65bde4875647-host-run-netns\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22f2b29c-104a-4588-aad9-65bde4875647-multus-daemon-config\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014707    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 12:00:46.016904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.014742    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-ovnkube-config\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.018630 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.018606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-ovn-node-metrics-cert\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.020063 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.019986    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5b6\" (UniqueName: \"kubernetes.io/projected/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-kube-api-access-kx5b6\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:46.020365 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.020343    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7vfh\" (UniqueName: \"kubernetes.io/projected/db0b628b-61b9-4035-8c95-6f95f0ed8ea8-kube-api-access-d7vfh\") pod \"ovnkube-node-bwh6m\" (UID: \"db0b628b-61b9-4035-8c95-6f95f0ed8ea8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.022340 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.022316    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msfq6\" (UniqueName: \"kubernetes.io/projected/8128a6a0-1fc0-446e-96c8-bedbc4b15b95-kube-api-access-msfq6\") pod \"aws-ebs-csi-driver-node-d8wkr\" (UID: \"8128a6a0-1fc0-446e-96c8-bedbc4b15b95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.022765 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.022720    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cch69\" (UniqueName: \"kubernetes.io/projected/22f2b29c-104a-4588-aad9-65bde4875647-kube-api-access-cch69\") pod \"multus-l2dgp\" (UID: \"22f2b29c-104a-4588-aad9-65bde4875647\") " pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.029332 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.029258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q5dg\" (UniqueName: \"kubernetes.io/projected/268eaad8-cdac-46d7-8412-4e2561bb9efe-kube-api-access-8q5dg\") pod \"node-ca-dhskk\" (UID: \"268eaad8-cdac-46d7-8412-4e2561bb9efe\") " pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:46.029455 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.029366    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal" event={"ID":"d08afcddc68f55b21ba091d1f6f66b29","Type":"ContainerStarted","Data":"0ab955cf86636d2e4ab8d80d44103dc4923223e0f6a7dc0b32fd3260d23525d6"}
Sep 16 12:00:46.029829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.029802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw986\" (UniqueName: \"kubernetes.io/projected/8baa1341-2665-43af-abee-7297cf014daa-kube-api-access-bw986\") pod \"node-resolver-gbwzr\" (UID: \"8baa1341-2665-43af-abee-7297cf014daa\") " pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:46.030804 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.030779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal" event={"ID":"e04180e7178d889d528d8d3b81c66bf7","Type":"ContainerStarted","Data":"f8b6486cecb127f671b4339674d78e14ac4d1c6a21aaf189bd55a4e8a2ab36a5"}
Sep 16 12:00:46.115189 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/261d3c92-c780-4939-8091-d610fc73fcd9-tmp\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/215b7997-e1a8-4b85-a03b-da890a22ead0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.115325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fcf95c25-cb57-40a7-a833-a1df70924833-iptables-alerter-script\") pod \"iptables-alerter-wpw9w\" (UID: \"fcf95c25-cb57-40a7-a833-a1df70924833\") " pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.115325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115235    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-var-lib-kubelet\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xfvz\" (UniqueName: \"kubernetes.io/projected/fcf95c25-cb57-40a7-a833-a1df70924833-kube-api-access-9xfvz\") pod \"iptables-alerter-wpw9w\" (UID: \"fcf95c25-cb57-40a7-a833-a1df70924833\") " pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.115325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4dc63791-1615-450f-8182-165405956a01-agent-certs\") pod \"konnectivity-agent-t4rw6\" (UID: \"4dc63791-1615-450f-8182-165405956a01\") " pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:00:46.115325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-sysctl-conf\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkz8c\" (UniqueName: \"kubernetes.io/projected/261d3c92-c780-4939-8091-d610fc73fcd9-kube-api-access-xkz8c\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115349    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-var-lib-kubelet\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115357    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-systemd\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/215b7997-e1a8-4b85-a03b-da890a22ead0-cnibin\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.115660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/215b7997-e1a8-4b85-a03b-da890a22ead0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.115660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115646    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-systemd\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115677    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4dc63791-1615-450f-8182-165405956a01-konnectivity-ca\") pod \"konnectivity-agent-t4rw6\" (UID: \"4dc63791-1615-450f-8182-165405956a01\") " pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/215b7997-e1a8-4b85-a03b-da890a22ead0-cnibin\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115798    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-sys\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-sysctl-conf\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115702    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-sys\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/215b7997-e1a8-4b85-a03b-da890a22ead0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/261d3c92-c780-4939-8091-d610fc73fcd9-etc-tuned\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcf95c25-cb57-40a7-a833-a1df70924833-host-slash\") pod \"iptables-alerter-wpw9w\" (UID: \"fcf95c25-cb57-40a7-a833-a1df70924833\") " pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115929    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-kubernetes\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115965    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/215b7997-e1a8-4b85-a03b-da890a22ead0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.115981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.115968    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/215b7997-e1a8-4b85-a03b-da890a22ead0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116023    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcf95c25-cb57-40a7-a833-a1df70924833-host-slash\") pod \"iptables-alerter-wpw9w\" (UID: \"fcf95c25-cb57-40a7-a833-a1df70924833\") " pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-sysconfig\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-sysctl-d\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-kubernetes\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116114    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-lib-modules\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/215b7997-e1a8-4b85-a03b-da890a22ead0-system-cni-dir\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48c6\" (UniqueName: \"kubernetes.io/projected/215b7997-e1a8-4b85-a03b-da890a22ead0-kube-api-access-m48c6\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-run\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116219    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-sysctl-d\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116239    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fcf95c25-cb57-40a7-a833-a1df70924833-iptables-alerter-script\") pod \"iptables-alerter-wpw9w\" (UID: \"fcf95c25-cb57-40a7-a833-a1df70924833\") " pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/215b7997-e1a8-4b85-a03b-da890a22ead0-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-sysconfig\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116294    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-modprobe-d\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116315    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-lib-modules\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-host\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.116539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116350    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4dc63791-1615-450f-8182-165405956a01-konnectivity-ca\") pod \"konnectivity-agent-t4rw6\" (UID: \"4dc63791-1615-450f-8182-165405956a01\") " pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:00:46.117522 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-host\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.117522 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-run\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.117522 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/215b7997-e1a8-4b85-a03b-da890a22ead0-system-cni-dir\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.117522 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/215b7997-e1a8-4b85-a03b-da890a22ead0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.117522 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116589    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/261d3c92-c780-4939-8091-d610fc73fcd9-etc-modprobe-d\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.117522 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.116906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/215b7997-e1a8-4b85-a03b-da890a22ead0-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.118076 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.118055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4dc63791-1615-450f-8182-165405956a01-agent-certs\") pod \"konnectivity-agent-t4rw6\" (UID: \"4dc63791-1615-450f-8182-165405956a01\") " pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:00:46.118591 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.118572    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/261d3c92-c780-4939-8091-d610fc73fcd9-etc-tuned\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.118795 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.118776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/261d3c92-c780-4939-8091-d610fc73fcd9-tmp\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.123394 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.123325    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:46.123394 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.123353    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:46.123394 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.123366    2559 projected.go:196] Error preparing data for projected volume kube-api-access-plshs for pod openshift-network-diagnostics/network-check-target-2k6xr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:46.123568 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.123422    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs podName:a675b90a-b0e9-4cd5-bfb3-647bdd797283 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:46.623409062 +0000 UTC m=+3.066443921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-plshs" (UniqueName: "kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs") pod "network-check-target-2k6xr" (UID: "a675b90a-b0e9-4cd5-bfb3-647bdd797283") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:46.124821 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.124802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkz8c\" (UniqueName: \"kubernetes.io/projected/261d3c92-c780-4939-8091-d610fc73fcd9-kube-api-access-xkz8c\") pod \"tuned-8grw8\" (UID: \"261d3c92-c780-4939-8091-d610fc73fcd9\") " pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.125613 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.125587    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xfvz\" (UniqueName: \"kubernetes.io/projected/fcf95c25-cb57-40a7-a833-a1df70924833-kube-api-access-9xfvz\") pod \"iptables-alerter-wpw9w\" (UID: \"fcf95c25-cb57-40a7-a833-a1df70924833\") " pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.125765 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.125744    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m48c6\" (UniqueName: \"kubernetes.io/projected/215b7997-e1a8-4b85-a03b-da890a22ead0-kube-api-access-m48c6\") pod \"multus-additional-cni-plugins-wqc9k\" (UID: \"215b7997-e1a8-4b85-a03b-da890a22ead0\") " pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.202106 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.202057    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr"
Sep 16 12:00:46.209606 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.209587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:00:46.219560 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.219540    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l2dgp"
Sep 16 12:00:46.225099 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.225077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gbwzr"
Sep 16 12:00:46.232789 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.232766    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhskk"
Sep 16 12:00:46.240403 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.240386    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:00:46.247945 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.247924    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8grw8"
Sep 16 12:00:46.253278 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.253259    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:46.255397 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.255380    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqc9k"
Sep 16 12:00:46.261983 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.261964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wpw9w"
Sep 16 12:00:46.266515 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.266497    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:46.412737 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:46.412706    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc63791_1615_450f_8182_165405956a01.slice/crio-2f90f19c38f95873e35786a42d9a69a77060383090dcc00a9f56a80c83013a57 WatchSource:0}: Error finding container 2f90f19c38f95873e35786a42d9a69a77060383090dcc00a9f56a80c83013a57: Status 404 returned error can't find the container with id 2f90f19c38f95873e35786a42d9a69a77060383090dcc00a9f56a80c83013a57
Sep 16 12:00:46.426523 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:46.426495    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215b7997_e1a8_4b85_a03b_da890a22ead0.slice/crio-c67c470c23d2a9620e504e64574074829e4e7a73131e97c7cf84f8fba0682f69 WatchSource:0}: Error finding container c67c470c23d2a9620e504e64574074829e4e7a73131e97c7cf84f8fba0682f69: Status 404 returned error can't find the container with id c67c470c23d2a9620e504e64574074829e4e7a73131e97c7cf84f8fba0682f69
Sep 16 12:00:46.432518 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:46.432313    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261d3c92_c780_4939_8091_d610fc73fcd9.slice/crio-fada6a1c17c06dc518505f9bc5ab9f2ea70adf0e61ed19c51d10df7a96db0651 WatchSource:0}: Error finding container fada6a1c17c06dc518505f9bc5ab9f2ea70adf0e61ed19c51d10df7a96db0651: Status 404 returned error can't find the container with id fada6a1c17c06dc518505f9bc5ab9f2ea70adf0e61ed19c51d10df7a96db0651
Sep 16 12:00:46.433013 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:46.432980    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f2b29c_104a_4588_aad9_65bde4875647.slice/crio-a3f40d956c93dced90ab952598c7a05f69aee203ec386547d675cb464a0363cc WatchSource:0}: Error finding container a3f40d956c93dced90ab952598c7a05f69aee203ec386547d675cb464a0363cc: Status 404 returned error can't find the container with id a3f40d956c93dced90ab952598c7a05f69aee203ec386547d675cb464a0363cc
Sep 16 12:00:46.434150 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:46.434069    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf95c25_cb57_40a7_a833_a1df70924833.slice/crio-b79981fdb2bd133db0eebbb387b3349717610bae2f29f8b209a7fbc3e52a87ed WatchSource:0}: Error finding container b79981fdb2bd133db0eebbb387b3349717610bae2f29f8b209a7fbc3e52a87ed: Status 404 returned error can't find the container with id b79981fdb2bd133db0eebbb387b3349717610bae2f29f8b209a7fbc3e52a87ed
Sep 16 12:00:46.435334 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:46.435273    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0b628b_61b9_4035_8c95_6f95f0ed8ea8.slice/crio-bb583f78ae64859398bec2a6aafbd181398801710984c035a9fd16a6ba2a4084 WatchSource:0}: Error finding container bb583f78ae64859398bec2a6aafbd181398801710984c035a9fd16a6ba2a4084: Status 404 returned error can't find the container with id bb583f78ae64859398bec2a6aafbd181398801710984c035a9fd16a6ba2a4084
Sep 16 12:00:46.436527 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:46.436490    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268eaad8_cdac_46d7_8412_4e2561bb9efe.slice/crio-38bfd976e1d8b900c4856e79ecbc77408e7f5473c5e5792dc1bc7e7a38488a74 WatchSource:0}: Error finding container 38bfd976e1d8b900c4856e79ecbc77408e7f5473c5e5792dc1bc7e7a38488a74: Status 404 returned error can't find the container with id 38bfd976e1d8b900c4856e79ecbc77408e7f5473c5e5792dc1bc7e7a38488a74
Sep 16 12:00:46.437488 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:46.437465    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8baa1341_2665_43af_abee_7297cf014daa.slice/crio-3d60766f1a49502733135e8207104d43686904bcc02a82de08b2a1fb24f7bc77 WatchSource:0}: Error finding container 3d60766f1a49502733135e8207104d43686904bcc02a82de08b2a1fb24f7bc77: Status 404 returned error can't find the container with id 3d60766f1a49502733135e8207104d43686904bcc02a82de08b2a1fb24f7bc77
Sep 16 12:00:46.438395 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:00:46.438372    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8128a6a0_1fc0_446e_96c8_bedbc4b15b95.slice/crio-0bd83e524b30d227e0369fcdecaffc80688ba86cee2e68ec34806121a9bf7d6c WatchSource:0}: Error finding container 0bd83e524b30d227e0369fcdecaffc80688ba86cee2e68ec34806121a9bf7d6c: Status 404 returned error can't find the container with id 0bd83e524b30d227e0369fcdecaffc80688ba86cee2e68ec34806121a9bf7d6c
Sep 16 12:00:46.519928 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.519895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:46.520039 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.519937    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:46.520101 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.520065    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:46.520157 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.520116    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret podName:02034161-8299-407b-a512-5484c2272a6c nodeName:}" failed. No retries permitted until 2026-09-16 12:00:47.520102519 +0000 UTC m=+3.963137366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret") pod "global-pull-secret-syncer-7792l" (UID: "02034161-8299-407b-a512-5484c2272a6c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:46.520157 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.520068    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:46.520266 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.520188    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:00:47.520175657 +0000 UTC m=+3.963210502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:46.721090 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.721058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:46.721259 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.721243    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:46.721332 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.721268    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:46.721332 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.721282    2559 projected.go:196] Error preparing data for projected volume kube-api-access-plshs for pod openshift-network-diagnostics/network-check-target-2k6xr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:46.721442 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:46.721341    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs podName:a675b90a-b0e9-4cd5-bfb3-647bdd797283 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:47.721320478 +0000 UTC m=+4.164355323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-plshs" (UniqueName: "kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs") pod "network-check-target-2k6xr" (UID: "a675b90a-b0e9-4cd5-bfb3-647bdd797283") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:46.943740 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.943660    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 11:55:46 +0000 UTC" deadline="2028-04-14 04:13:26.197123004 +0000 UTC"
Sep 16 12:00:46.943740 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:46.943738    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13816h12m39.253389625s"
Sep 16 12:00:47.025082 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.024533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:47.025082 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:47.024664    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:00:47.042356 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.042319    2559 generic.go:356] "Generic (PLEG): container finished" podID="e04180e7178d889d528d8d3b81c66bf7" containerID="e258cd5d0f1a1b6cff65fce657ac8e5f655ac13f57bd2ab439f31dded707c96a" exitCode=0
Sep 16 12:00:47.042492 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.042410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal" event={"ID":"e04180e7178d889d528d8d3b81c66bf7","Type":"ContainerDied","Data":"e258cd5d0f1a1b6cff65fce657ac8e5f655ac13f57bd2ab439f31dded707c96a"}
Sep 16 12:00:47.048336 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.047810    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gbwzr" event={"ID":"8baa1341-2665-43af-abee-7297cf014daa","Type":"ContainerStarted","Data":"3d60766f1a49502733135e8207104d43686904bcc02a82de08b2a1fb24f7bc77"}
Sep 16 12:00:47.051103 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.050838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" event={"ID":"db0b628b-61b9-4035-8c95-6f95f0ed8ea8","Type":"ContainerStarted","Data":"bb583f78ae64859398bec2a6aafbd181398801710984c035a9fd16a6ba2a4084"}
Sep 16 12:00:47.055230 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.055170    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqc9k" event={"ID":"215b7997-e1a8-4b85-a03b-da890a22ead0","Type":"ContainerStarted","Data":"c67c470c23d2a9620e504e64574074829e4e7a73131e97c7cf84f8fba0682f69"}
Sep 16 12:00:47.071224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.071197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr" event={"ID":"8128a6a0-1fc0-446e-96c8-bedbc4b15b95","Type":"ContainerStarted","Data":"0bd83e524b30d227e0369fcdecaffc80688ba86cee2e68ec34806121a9bf7d6c"}
Sep 16 12:00:47.081472 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.081443    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhskk" event={"ID":"268eaad8-cdac-46d7-8412-4e2561bb9efe","Type":"ContainerStarted","Data":"38bfd976e1d8b900c4856e79ecbc77408e7f5473c5e5792dc1bc7e7a38488a74"}
Sep 16 12:00:47.091890 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.090256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wpw9w" event={"ID":"fcf95c25-cb57-40a7-a833-a1df70924833","Type":"ContainerStarted","Data":"b79981fdb2bd133db0eebbb387b3349717610bae2f29f8b209a7fbc3e52a87ed"}
Sep 16 12:00:47.100020 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.099993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l2dgp" event={"ID":"22f2b29c-104a-4588-aad9-65bde4875647","Type":"ContainerStarted","Data":"a3f40d956c93dced90ab952598c7a05f69aee203ec386547d675cb464a0363cc"}
Sep 16 12:00:47.113526 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.113466    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8grw8" event={"ID":"261d3c92-c780-4939-8091-d610fc73fcd9","Type":"ContainerStarted","Data":"fada6a1c17c06dc518505f9bc5ab9f2ea70adf0e61ed19c51d10df7a96db0651"}
Sep 16 12:00:47.117358 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.117331    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4rw6" event={"ID":"4dc63791-1615-450f-8182-165405956a01","Type":"ContainerStarted","Data":"2f90f19c38f95873e35786a42d9a69a77060383090dcc00a9f56a80c83013a57"}
Sep 16 12:00:47.528407 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.528369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:47.528591 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.528423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:47.528694 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:47.528663    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:47.528798 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:47.528778    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:00:49.528714578 +0000 UTC m=+5.971749422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:47.529243 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:47.529216    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:47.529320 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:47.529280    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret podName:02034161-8299-407b-a512-5484c2272a6c nodeName:}" failed. No retries permitted until 2026-09-16 12:00:49.529260822 +0000 UTC m=+5.972295679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret") pod "global-pull-secret-syncer-7792l" (UID: "02034161-8299-407b-a512-5484c2272a6c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:47.730427 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.730339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:47.730592 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:47.730513    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:47.730592 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:47.730536    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:47.730592 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:47.730550    2559 projected.go:196] Error preparing data for projected volume kube-api-access-plshs for pod openshift-network-diagnostics/network-check-target-2k6xr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:47.730822 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:47.730608    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs podName:a675b90a-b0e9-4cd5-bfb3-647bdd797283 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:49.730589117 +0000 UTC m=+6.173623963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-plshs" (UniqueName: "kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs") pod "network-check-target-2k6xr" (UID: "a675b90a-b0e9-4cd5-bfb3-647bdd797283") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:47.733547 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.733211    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:00:47.944782 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.944681    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 11:55:46 +0000 UTC" deadline="2028-03-26 06:49:53.816537837 +0000 UTC"
Sep 16 12:00:47.944782 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:47.944730    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13362h49m5.871813308s"
Sep 16 12:00:48.026442 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:48.024898    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:48.026442 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:48.025050    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:00:48.026442 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:48.025426    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:48.026442 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:48.025506    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:00:48.126559 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:48.125972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal" event={"ID":"e04180e7178d889d528d8d3b81c66bf7","Type":"ContainerStarted","Data":"b7839a9d29021487387481b6140a3da859a61127af8969348e6f9fa19a06ca8f"}
Sep 16 12:00:49.024850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:49.024812    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:49.025415 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:49.024951    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:00:49.546167 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:49.545329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:49.546167 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:49.545380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:49.546167 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:49.545537    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:49.546167 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:49.545601    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:00:53.545582013 +0000 UTC m=+9.988616861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:49.546167 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:49.546038    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:49.546167 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:49.546089    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret podName:02034161-8299-407b-a512-5484c2272a6c nodeName:}" failed. No retries permitted until 2026-09-16 12:00:53.546072074 +0000 UTC m=+9.989106919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret") pod "global-pull-secret-syncer-7792l" (UID: "02034161-8299-407b-a512-5484c2272a6c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:49.747118 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:49.747030    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:49.747316 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:49.747205    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:49.747316 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:49.747230    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:49.747316 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:49.747243    2559 projected.go:196] Error preparing data for projected volume kube-api-access-plshs for pod openshift-network-diagnostics/network-check-target-2k6xr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:49.747316 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:49.747312    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs podName:a675b90a-b0e9-4cd5-bfb3-647bdd797283 nodeName:}" failed. No retries permitted until 2026-09-16 12:00:53.747293861 +0000 UTC m=+10.190328705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-plshs" (UniqueName: "kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs") pod "network-check-target-2k6xr" (UID: "a675b90a-b0e9-4cd5-bfb3-647bdd797283") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:50.024093 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:50.024015    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:50.024247 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:50.024148    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:00:50.024883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:50.024644    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:50.024883 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:50.024782    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:00:51.024720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:51.024680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:51.024916 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:51.024841    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:00:52.026992 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:52.026481    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:52.026992 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:52.026622    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:00:52.026992 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:52.026660    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:52.026992 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:52.026781    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:00:53.023933 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:53.023844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:53.024097 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:53.023976    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:00:53.579098 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:53.579057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:53.579675 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:53.579109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:53.579675 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:53.579334    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:53.579675 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:53.579398    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:01:01.579379204 +0000 UTC m=+18.022414071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:00:53.579904 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:53.579847    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:53.579959 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:53.579909    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret podName:02034161-8299-407b-a512-5484c2272a6c nodeName:}" failed. No retries permitted until 2026-09-16 12:01:01.579890062 +0000 UTC m=+18.022924904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret") pod "global-pull-secret-syncer-7792l" (UID: "02034161-8299-407b-a512-5484c2272a6c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:00:53.781102 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:53.780415    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:53.781102 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:53.780628    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:00:53.781102 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:53.780652    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:00:53.781102 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:53.780665    2559 projected.go:196] Error preparing data for projected volume kube-api-access-plshs for pod openshift-network-diagnostics/network-check-target-2k6xr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:53.781102 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:53.780724    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs podName:a675b90a-b0e9-4cd5-bfb3-647bdd797283 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:01.780705137 +0000 UTC m=+18.223739998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-plshs" (UniqueName: "kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs") pod "network-check-target-2k6xr" (UID: "a675b90a-b0e9-4cd5-bfb3-647bdd797283") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:00:54.025635 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:54.025099    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:54.025635 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:54.025213    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:00:54.025635 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:54.025402    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:54.025635 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:54.025531    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:00:55.023932 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:55.023788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:55.023932 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:55.023907    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:00:56.024834 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:56.024784    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:56.025290 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:56.024784    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:56.025290 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:56.024927    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:00:56.025290 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:56.025019    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:00:57.024093 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:57.024062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:57.024248 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:57.024154    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:00:58.024589 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:58.024518    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:00:58.024589 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:58.024560    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:00:58.025095 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:58.024637    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:00:58.025095 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:58.024796    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:00:59.024886 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:00:59.024851    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:00:59.025326 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:00:59.024976    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:00.024607 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:00.024518    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:00.024808 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:00.024648    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:00.024808 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:00.024716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:00.024925 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:00.024814    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:01.023992 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:01.023967    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:01.024173 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:01.024052    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:01.640442 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:01.640409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:01.640442 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:01.640448    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:01.640981 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:01.640555    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:01:01.640981 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:01.640569    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:01:01.640981 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:01.640621    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:01:17.640602107 +0000 UTC m=+34.083636964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:01:01.640981 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:01.640643    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret podName:02034161-8299-407b-a512-5484c2272a6c nodeName:}" failed. No retries permitted until 2026-09-16 12:01:17.640632305 +0000 UTC m=+34.083667152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret") pod "global-pull-secret-syncer-7792l" (UID: "02034161-8299-407b-a512-5484c2272a6c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:01:01.842793 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:01.842761    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:01.842958 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:01.842885    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:01:01.842958 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:01.842902    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:01:01.842958 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:01.842913    2559 projected.go:196] Error preparing data for projected volume kube-api-access-plshs for pod openshift-network-diagnostics/network-check-target-2k6xr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:01:01.843089 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:01.842965    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs podName:a675b90a-b0e9-4cd5-bfb3-647bdd797283 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:17.842952044 +0000 UTC m=+34.285986883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-plshs" (UniqueName: "kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs") pod "network-check-target-2k6xr" (UID: "a675b90a-b0e9-4cd5-bfb3-647bdd797283") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:01:02.024960 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:02.024887    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:02.025092 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:02.025008    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:02.025092 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:02.025064    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:02.025159 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:02.025146    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:03.024118 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:03.024086    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:03.024577 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:03.024206    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:04.025124 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:04.025091    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:04.025527 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:04.025212    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:04.025527 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:04.025231    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:04.025527 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:04.025310    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:05.024564 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:05.024543    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:05.024680 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:05.024660    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:05.158305 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:05.158281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal" event={"ID":"d08afcddc68f55b21ba091d1f6f66b29","Type":"ContainerStarted","Data":"84c5a518e94f199f694ae0653046de1c04e5f1c75e2fb236b6fa9c0cede2b69b"}
Sep 16 12:01:05.175481 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:05.175445    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-254.ec2.internal" podStartSLOduration=19.175433343 podStartE2EDuration="19.175433343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:00:48.146983995 +0000 UTC m=+4.590018861" watchObservedRunningTime="2026-09-16 12:01:05.175433343 +0000 UTC m=+21.618468205"
Sep 16 12:01:06.025160 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.024900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:06.025305 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.024900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:06.025305 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:06.025238    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:06.025305 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:06.025291    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:06.161682 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.161651    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhskk" event={"ID":"268eaad8-cdac-46d7-8412-4e2561bb9efe","Type":"ContainerStarted","Data":"28d12ed327800f0432c251c1e1117423e238a3e0b58d128b90d17b41233708f1"}
Sep 16 12:01:06.163196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.163171    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l2dgp" event={"ID":"22f2b29c-104a-4588-aad9-65bde4875647","Type":"ContainerStarted","Data":"4fdcf283b6895a39bbede4d5fd282a5f378257676c99a12310d2c324e966897b"}
Sep 16 12:01:06.164537 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.164516    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8grw8" event={"ID":"261d3c92-c780-4939-8091-d610fc73fcd9","Type":"ContainerStarted","Data":"46bf1e52d4032c367d56684cefd1d581623bbd9a50856b20458dd0f9a1225d5e"}
Sep 16 12:01:06.165982 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.165941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4rw6" event={"ID":"4dc63791-1615-450f-8182-165405956a01","Type":"ContainerStarted","Data":"2e718685cb7ce0aca61cabffe08c1f7f8013a8a78e7c7cdb6be61aca825a73f3"}
Sep 16 12:01:06.167371 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.167351    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gbwzr" event={"ID":"8baa1341-2665-43af-abee-7297cf014daa","Type":"ContainerStarted","Data":"ec2244d365d320a9fe074900cb6c57ac02dbf55191c8119ecdba0b28fbedc627"}
Sep 16 12:01:06.170179 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.170160    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" event={"ID":"db0b628b-61b9-4035-8c95-6f95f0ed8ea8","Type":"ContainerStarted","Data":"0cce34d18f7aed0ca52950ac8b208c18b8ea9c3c88e5b06a5a10fe105fafbc28"}
Sep 16 12:01:06.170264 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.170221    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" event={"ID":"db0b628b-61b9-4035-8c95-6f95f0ed8ea8","Type":"ContainerStarted","Data":"1ac7560b5acefaabe868c4e0ec6134411481bb2c9d01b41e917a6b699b17d7c2"}
Sep 16 12:01:06.170323 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.170272    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" event={"ID":"db0b628b-61b9-4035-8c95-6f95f0ed8ea8","Type":"ContainerStarted","Data":"94fa6e3f2889aea5484230467ecb34346367d4cc4eaf9212accf725f734b2f2c"}
Sep 16 12:01:06.170360 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.170322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" event={"ID":"db0b628b-61b9-4035-8c95-6f95f0ed8ea8","Type":"ContainerStarted","Data":"bbf0b041c9561c3d983050159514ff42a266156eacde6acf3ce110385648c007"}
Sep 16 12:01:06.170389 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.170372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" event={"ID":"db0b628b-61b9-4035-8c95-6f95f0ed8ea8","Type":"ContainerStarted","Data":"442b515c9816af46895089845b15eed7770194743fb6a8af2c75007c32e67cd3"}
Sep 16 12:01:06.170437 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.170404    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" event={"ID":"db0b628b-61b9-4035-8c95-6f95f0ed8ea8","Type":"ContainerStarted","Data":"63cec0df9acf5700ccf16d0e3dcfe97ea060c87d83e2249f79fd642d56aebfcf"}
Sep 16 12:01:06.171578 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.171559    2559 generic.go:356] "Generic (PLEG): container finished" podID="215b7997-e1a8-4b85-a03b-da890a22ead0" containerID="6f5c77b61491107124b501e69240a63a3db610c4256fe88635abe57cadd63e52" exitCode=0
Sep 16 12:01:06.171646 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.171620    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqc9k" event={"ID":"215b7997-e1a8-4b85-a03b-da890a22ead0","Type":"ContainerDied","Data":"6f5c77b61491107124b501e69240a63a3db610c4256fe88635abe57cadd63e52"}
Sep 16 12:01:06.173111 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.173089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr" event={"ID":"8128a6a0-1fc0-446e-96c8-bedbc4b15b95","Type":"ContainerStarted","Data":"5bfd22198d3f900d259848ca5d7c745cacb395759464720d4d8bee87c4aadf6c"}
Sep 16 12:01:06.177554 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.177520    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-254.ec2.internal" podStartSLOduration=20.177509928 podStartE2EDuration="20.177509928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:05.175169221 +0000 UTC m=+21.618204083" watchObservedRunningTime="2026-09-16 12:01:06.177509928 +0000 UTC m=+22.620544789"
Sep 16 12:01:06.192656 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.192616    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-l2dgp" podStartSLOduration=3.278735888 podStartE2EDuration="22.192605007s" totalImagesPullingTime="18.913869119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:06.192572701 +0000 UTC m=+22.635607563" watchObservedRunningTime="2026-09-16 12:01:06.192605007 +0000 UTC m=+22.635639869"
Sep 16 12:01:06.192905 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.192882    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dhskk" podStartSLOduration=3.625375074 podStartE2EDuration="22.192875574s" totalImagesPullingTime="18.5675005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:06.177199534 +0000 UTC m=+22.620234523" watchObservedRunningTime="2026-09-16 12:01:06.192875574 +0000 UTC m=+22.635910441"
Sep 16 12:01:06.217060 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.217017    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gbwzr" podStartSLOduration=3.616656684 podStartE2EDuration="22.217007018s" totalImagesPullingTime="18.600350334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:06.216485139 +0000 UTC m=+22.659520001" watchObservedRunningTime="2026-09-16 12:01:06.217007018 +0000 UTC m=+22.660041880"
Sep 16 12:01:06.287515 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.287455    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t4rw6" podStartSLOduration=3.703096255 podStartE2EDuration="22.28744432s" totalImagesPullingTime="18.584348065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:06.24660771 +0000 UTC m=+22.689642572" watchObservedRunningTime="2026-09-16 12:01:06.28744432 +0000 UTC m=+22.730479182"
Sep 16 12:01:06.287593 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.287520    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8grw8" podStartSLOduration=3.679499417 podStartE2EDuration="22.287515424s" totalImagesPullingTime="18.608016007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:06.287237075 +0000 UTC m=+22.730271936" watchObservedRunningTime="2026-09-16 12:01:06.287515424 +0000 UTC m=+22.730550286"
Sep 16 12:01:06.566223 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.566013    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 12:01:06.955926 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.955777    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T12:01:06.566222751Z","UUID":"6103fa0c-1a18-4093-b430-712789a342db","Handler":null,"Name":"","Endpoint":""}
Sep 16 12:01:06.957404 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.957384    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 12:01:06.957509 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:06.957411    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 12:01:07.024579 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:07.024558    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:07.024719 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:07.024665    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:07.178624 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:07.178561    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr" event={"ID":"8128a6a0-1fc0-446e-96c8-bedbc4b15b95","Type":"ContainerStarted","Data":"16e1c93af14090a480f93dc96e0fee7fe20371a0fd60fbc306d22869bd9d3efd"}
Sep 16 12:01:07.180585 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:07.180552    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wpw9w" event={"ID":"fcf95c25-cb57-40a7-a833-a1df70924833","Type":"ContainerStarted","Data":"91a247f4da9ed6c59eb37fcc62ba7d2ba603cc1b8aacd113cdc906e426a370fb"}
Sep 16 12:01:07.196764 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:07.196718    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wpw9w" podStartSLOduration=4.5869469370000004 podStartE2EDuration="23.196687095s" totalImagesPullingTime="18.609740158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:07.196371415 +0000 UTC m=+23.639406278" watchObservedRunningTime="2026-09-16 12:01:07.196687095 +0000 UTC m=+23.639721961"
Sep 16 12:01:08.024204 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:08.024131    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:08.024340 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:08.024258    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:08.024340 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:08.024310    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:08.024429 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:08.024396    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:08.186165 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:08.186129    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" event={"ID":"db0b628b-61b9-4035-8c95-6f95f0ed8ea8","Type":"ContainerStarted","Data":"01a23779704990345e6d65e0bdeb956c62c375f4d3aac1ed90db7303b68412da"}
Sep 16 12:01:08.188489 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:08.188458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr" event={"ID":"8128a6a0-1fc0-446e-96c8-bedbc4b15b95","Type":"ContainerStarted","Data":"8b0857e966c87e077544d0d2f7bc8f150f85d634e3712fc9c781a06356cb18e1"}
Sep 16 12:01:08.207463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:08.207414    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8wkr" podStartSLOduration=3.509477226 podStartE2EDuration="24.207396561s" totalImagesPullingTime="20.697919335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:08.206450241 +0000 UTC m=+24.649485105" watchObservedRunningTime="2026-09-16 12:01:08.207396561 +0000 UTC m=+24.650431424"
Sep 16 12:01:09.024367 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:09.024341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:09.024543 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:09.024434    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:09.309916 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:09.309838    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:01:09.310362 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:09.310335    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:01:10.024788 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:10.024761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:10.024960 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:10.024895    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:10.025014 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:10.024997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:10.025149 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:10.025122    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:10.193082 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:10.193016    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:01:10.193444 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:10.193427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t4rw6"
Sep 16 12:01:11.024285 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:11.024120    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:11.024783 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:11.024383    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:11.198316 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:11.198294    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" event={"ID":"db0b628b-61b9-4035-8c95-6f95f0ed8ea8","Type":"ContainerStarted","Data":"b764fac677aa778d0a36e121b065b5d9a8e94ce461c72ebe606bb9ae73e14dc9"}
Sep 16 12:01:11.198535 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:11.198492    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:01:11.198610 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:11.198550    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:01:11.200401 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:11.200377    2559 generic.go:356] "Generic (PLEG): container finished" podID="215b7997-e1a8-4b85-a03b-da890a22ead0" containerID="acd9609e035d285c8a414bc24e70ec86cdef7462e6cded3c391bde4c6588ab70" exitCode=0
Sep 16 12:01:11.200496 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:11.200447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqc9k" event={"ID":"215b7997-e1a8-4b85-a03b-da890a22ead0","Type":"ContainerDied","Data":"acd9609e035d285c8a414bc24e70ec86cdef7462e6cded3c391bde4c6588ab70"}
Sep 16 12:01:11.213526 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:11.213506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:01:11.215448 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:11.215429    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:01:11.226223 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:11.226190    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m" podStartSLOduration=8.599919218 podStartE2EDuration="27.226178442s" totalImagesPullingTime="18.626259224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:11.224874317 +0000 UTC m=+27.667909179" watchObservedRunningTime="2026-09-16 12:01:11.226178442 +0000 UTC m=+27.669213304"
Sep 16 12:01:12.026412 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.025745    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:12.026412 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:12.025869    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:12.026412 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.026088    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:12.026412 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:12.026206    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:12.204785 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.204753    2559 generic.go:356] "Generic (PLEG): container finished" podID="215b7997-e1a8-4b85-a03b-da890a22ead0" containerID="9c204f161888da08b50d77fbd8d6d430392ef6b9804d8e17e9224e6bc0b667de" exitCode=0
Sep 16 12:01:12.204885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.204817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqc9k" event={"ID":"215b7997-e1a8-4b85-a03b-da890a22ead0","Type":"ContainerDied","Data":"9c204f161888da08b50d77fbd8d6d430392ef6b9804d8e17e9224e6bc0b667de"}
Sep 16 12:01:12.205067 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.205052    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 12:01:12.273274 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.273192    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-th86b"]
Sep 16 12:01:12.273370 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.273285    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:12.273428 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:12.273390    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:12.273845 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.273826    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2k6xr"]
Sep 16 12:01:12.273941 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.273902    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:12.274009 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:12.273990    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:12.276322 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.276302    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7792l"]
Sep 16 12:01:12.276410 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:12.276396    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:12.276512 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:12.276492    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:13.206318 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:13.206292    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 12:01:13.984469 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:13.984444    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215b7997_e1a8_4b85_a03b_da890a22ead0.slice/crio-conmon-590444965d61ac3bd80c4101aa44776343ce0899d31c22a217a6d001feeaea18.scope\": RecentStats: unable to find data in memory cache]"
Sep 16 12:01:14.025405 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:14.025383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:14.025508 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:14.025417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:14.025508 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:14.025483    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:14.025618 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:14.025524    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:14.025618 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:14.025557    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:14.025726 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:14.025625    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:14.070931 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:14.070911    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:01:14.210936 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:14.210879    2559 generic.go:356] "Generic (PLEG): container finished" podID="215b7997-e1a8-4b85-a03b-da890a22ead0" containerID="590444965d61ac3bd80c4101aa44776343ce0899d31c22a217a6d001feeaea18" exitCode=0
Sep 16 12:01:14.211237 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:14.210958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqc9k" event={"ID":"215b7997-e1a8-4b85-a03b-da890a22ead0","Type":"ContainerDied","Data":"590444965d61ac3bd80c4101aa44776343ce0899d31c22a217a6d001feeaea18"}
Sep 16 12:01:16.024559 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:16.024524    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:16.025076 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:16.024535    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:16.025076 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:16.024643    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k6xr" podUID="a675b90a-b0e9-4cd5-bfb3-647bdd797283"
Sep 16 12:01:16.025076 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:16.024664    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:16.025076 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:16.024779    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7792l" podUID="02034161-8299-407b-a512-5484c2272a6c"
Sep 16 12:01:16.025076 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:16.024873    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:01:17.665369 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.665329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:17.665910 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.665378    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:17.665910 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:17.665482    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:01:17.665910 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:17.665485    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:01:17.665910 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:17.665535    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:01:49.665521585 +0000 UTC m=+66.108556425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:01:17.665910 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:17.665548    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret podName:02034161-8299-407b-a512-5484c2272a6c nodeName:}" failed. No retries permitted until 2026-09-16 12:01:49.665541809 +0000 UTC m=+66.108576649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret") pod "global-pull-secret-syncer-7792l" (UID: "02034161-8299-407b-a512-5484c2272a6c") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:01:17.840043 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.840019    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-254.ec2.internal" event="NodeReady"
Sep 16 12:01:17.840173 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.840133    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 12:01:17.867774 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.867743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:17.867909 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:17.867888    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:01:17.867975 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:17.867913    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:01:17.867975 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:17.867926    2559 projected.go:196] Error preparing data for projected volume kube-api-access-plshs for pod openshift-network-diagnostics/network-check-target-2k6xr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:01:17.868060 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:17.867982    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs podName:a675b90a-b0e9-4cd5-bfb3-647bdd797283 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:49.867965454 +0000 UTC m=+66.311000298 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-plshs" (UniqueName: "kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs") pod "network-check-target-2k6xr" (UID: "a675b90a-b0e9-4cd5-bfb3-647bdd797283") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:01:17.888391 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.888365    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jfmgf"]
Sep 16 12:01:17.906093 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.906066    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zntf4"]
Sep 16 12:01:17.906274 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.906255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:17.908827 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.908804    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 12:01:17.908928 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.908870    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 12:01:17.908990 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.908871    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rfzsk\""
Sep 16 12:01:17.918178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.918132    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jfmgf"]
Sep 16 12:01:17.918178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.918177    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zntf4"]
Sep 16 12:01:17.918307 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.918251    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zntf4"
Sep 16 12:01:17.921089 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.920947    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 12:01:17.921089 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.920961    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 12:01:17.921089 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.920965    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-knmsl\""
Sep 16 12:01:17.921089 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:17.920947    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 12:01:18.024786 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.024761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:18.024891 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.024792    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:18.024891 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.024761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:18.027982 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.027893    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:01:18.028088 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.028078    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rfjm7\""
Sep 16 12:01:18.028155 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.028110    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:01:18.028390 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.028372    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:01:18.028476 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.028444    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hp2p6\""
Sep 16 12:01:18.028537 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.028512    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:01:18.068895 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.068873    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b531e0f4-f48e-48e8-b629-c32125d742c4-config-volume\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.069004 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.068926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/402683c1-20d6-4a8e-b7a8-b74e847dbf76-cert\") pod \"ingress-canary-zntf4\" (UID: \"402683c1-20d6-4a8e-b7a8-b74e847dbf76\") " pod="openshift-ingress-canary/ingress-canary-zntf4"
Sep 16 12:01:18.069004 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.068950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b531e0f4-f48e-48e8-b629-c32125d742c4-tmp-dir\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.069097 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.069008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.069097 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.069041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-657nr\" (UniqueName: \"kubernetes.io/projected/b531e0f4-f48e-48e8-b629-c32125d742c4-kube-api-access-657nr\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.069097 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.069078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gb9q\" (UniqueName: \"kubernetes.io/projected/402683c1-20d6-4a8e-b7a8-b74e847dbf76-kube-api-access-4gb9q\") pod \"ingress-canary-zntf4\" (UID: \"402683c1-20d6-4a8e-b7a8-b74e847dbf76\") " pod="openshift-ingress-canary/ingress-canary-zntf4"
Sep 16 12:01:18.170234 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.170165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gb9q\" (UniqueName: \"kubernetes.io/projected/402683c1-20d6-4a8e-b7a8-b74e847dbf76-kube-api-access-4gb9q\") pod \"ingress-canary-zntf4\" (UID: \"402683c1-20d6-4a8e-b7a8-b74e847dbf76\") " pod="openshift-ingress-canary/ingress-canary-zntf4"
Sep 16 12:01:18.170234 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.170208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b531e0f4-f48e-48e8-b629-c32125d742c4-config-volume\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.170399 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.170248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/402683c1-20d6-4a8e-b7a8-b74e847dbf76-cert\") pod \"ingress-canary-zntf4\" (UID: \"402683c1-20d6-4a8e-b7a8-b74e847dbf76\") " pod="openshift-ingress-canary/ingress-canary-zntf4"
Sep 16 12:01:18.170399 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.170268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b531e0f4-f48e-48e8-b629-c32125d742c4-tmp-dir\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.170399 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.170312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.170399 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.170346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-657nr\" (UniqueName: \"kubernetes.io/projected/b531e0f4-f48e-48e8-b629-c32125d742c4-kube-api-access-657nr\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.170589 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:18.170554    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:18.170634 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:18.170614    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls podName:b531e0f4-f48e-48e8-b629-c32125d742c4 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:18.670593801 +0000 UTC m=+35.113628659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls") pod "dns-default-jfmgf" (UID: "b531e0f4-f48e-48e8-b629-c32125d742c4") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:18.170687 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.170640    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b531e0f4-f48e-48e8-b629-c32125d742c4-tmp-dir\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.170969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.170937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b531e0f4-f48e-48e8-b629-c32125d742c4-config-volume\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.174784 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.174760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/402683c1-20d6-4a8e-b7a8-b74e847dbf76-cert\") pod \"ingress-canary-zntf4\" (UID: \"402683c1-20d6-4a8e-b7a8-b74e847dbf76\") " pod="openshift-ingress-canary/ingress-canary-zntf4"
Sep 16 12:01:18.183041 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.181980    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-657nr\" (UniqueName: \"kubernetes.io/projected/b531e0f4-f48e-48e8-b629-c32125d742c4-kube-api-access-657nr\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.183868 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.183844    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gb9q\" (UniqueName: \"kubernetes.io/projected/402683c1-20d6-4a8e-b7a8-b74e847dbf76-kube-api-access-4gb9q\") pod \"ingress-canary-zntf4\" (UID: \"402683c1-20d6-4a8e-b7a8-b74e847dbf76\") " pod="openshift-ingress-canary/ingress-canary-zntf4"
Sep 16 12:01:18.229200 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.229182    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zntf4"
Sep 16 12:01:18.605196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.605046    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zntf4"]
Sep 16 12:01:18.607875 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:01:18.607850    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402683c1_20d6_4a8e_b7a8_b74e847dbf76.slice/crio-08360ffcff100272331413cf608d7c37751cde1c914b66f497c8685d2fc311ba WatchSource:0}: Error finding container 08360ffcff100272331413cf608d7c37751cde1c914b66f497c8685d2fc311ba: Status 404 returned error can't find the container with id 08360ffcff100272331413cf608d7c37751cde1c914b66f497c8685d2fc311ba
Sep 16 12:01:18.674527 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:18.674497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:18.674828 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:18.674637    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:18.674828 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:18.674704    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls podName:b531e0f4-f48e-48e8-b629-c32125d742c4 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:19.674675856 +0000 UTC m=+36.117710696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls") pod "dns-default-jfmgf" (UID: "b531e0f4-f48e-48e8-b629-c32125d742c4") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:19.224327 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:19.224289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zntf4" event={"ID":"402683c1-20d6-4a8e-b7a8-b74e847dbf76","Type":"ContainerStarted","Data":"08360ffcff100272331413cf608d7c37751cde1c914b66f497c8685d2fc311ba"}
Sep 16 12:01:19.227701 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:19.227673    2559 generic.go:356] "Generic (PLEG): container finished" podID="215b7997-e1a8-4b85-a03b-da890a22ead0" containerID="f70fda4f16c4ad593a9b4d3f13d9d78b47dd8464b8284ee9cdd0161b96d8ed79" exitCode=0
Sep 16 12:01:19.227829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:19.227728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqc9k" event={"ID":"215b7997-e1a8-4b85-a03b-da890a22ead0","Type":"ContainerDied","Data":"f70fda4f16c4ad593a9b4d3f13d9d78b47dd8464b8284ee9cdd0161b96d8ed79"}
Sep 16 12:01:19.681847 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:19.681815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:19.682340 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:19.681971    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:19.682340 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:19.682044    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls podName:b531e0f4-f48e-48e8-b629-c32125d742c4 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:21.682025119 +0000 UTC m=+38.125059964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls") pod "dns-default-jfmgf" (UID: "b531e0f4-f48e-48e8-b629-c32125d742c4") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:20.234438 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:20.234409    2559 generic.go:356] "Generic (PLEG): container finished" podID="215b7997-e1a8-4b85-a03b-da890a22ead0" containerID="4712b114d98e250e948470c267f0cf9d4fe90da6dc715eb8de90bc640b993473" exitCode=0
Sep 16 12:01:20.234599 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:20.234480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqc9k" event={"ID":"215b7997-e1a8-4b85-a03b-da890a22ead0","Type":"ContainerDied","Data":"4712b114d98e250e948470c267f0cf9d4fe90da6dc715eb8de90bc640b993473"}
Sep 16 12:01:21.240112 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:21.240078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqc9k" event={"ID":"215b7997-e1a8-4b85-a03b-da890a22ead0","Type":"ContainerStarted","Data":"87136e046a0f400b5874c0487a8f67b6a0100e4022d2cb4c87a13b60810726b1"}
Sep 16 12:01:21.241680 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:21.241654    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zntf4" event={"ID":"402683c1-20d6-4a8e-b7a8-b74e847dbf76","Type":"ContainerStarted","Data":"d5e1a6859aeb965fde1a441b7ff4782135c726ba0cd426a6b698ce2456608fdf"}
Sep 16 12:01:21.262991 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:21.262949    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wqc9k" podStartSLOduration=7.60542607 podStartE2EDuration="37.262933717s" totalImagesPullingTime="29.657507647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:21.2613126 +0000 UTC m=+37.704347463" watchObservedRunningTime="2026-09-16 12:01:21.262933717 +0000 UTC m=+37.705968579"
Sep 16 12:01:21.694521 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:21.694359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:21.694680 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:21.694471    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:21.694680 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:21.694590    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls podName:b531e0f4-f48e-48e8-b629-c32125d742c4 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:25.694571982 +0000 UTC m=+42.137606838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls") pod "dns-default-jfmgf" (UID: "b531e0f4-f48e-48e8-b629-c32125d742c4") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:25.720050 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:25.720018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:25.720395 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:25.720117    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:25.720395 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:25.720160    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls podName:b531e0f4-f48e-48e8-b629-c32125d742c4 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:33.720148121 +0000 UTC m=+50.163182960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls") pod "dns-default-jfmgf" (UID: "b531e0f4-f48e-48e8-b629-c32125d742c4") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:33.770898 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:33.770868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:33.771283 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:33.770964    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:33.771283 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:33.771013    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls podName:b531e0f4-f48e-48e8-b629-c32125d742c4 nodeName:}" failed. No retries permitted until 2026-09-16 12:01:49.770999808 +0000 UTC m=+66.214034647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls") pod "dns-default-jfmgf" (UID: "b531e0f4-f48e-48e8-b629-c32125d742c4") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:44.221139 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:44.221113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwh6m"
Sep 16 12:01:44.249457 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:44.249415    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zntf4" podStartSLOduration=24.832676644 podStartE2EDuration="27.249402345s" totalImagesPullingTime="2.416725701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:21.277886217 +0000 UTC m=+37.720921080" watchObservedRunningTime="2026-09-16 12:01:44.249402345 +0000 UTC m=+60.692437207"
Sep 16 12:01:49.670403 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.670369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:49.670403 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.670402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:01:49.672993 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.672976    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:01:49.673141 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.673123    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:01:49.681425 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:49.681404    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 12:01:49.681843 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:49.681811    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:02:53.68145386 +0000 UTC m=+130.124488700 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : secret "metrics-daemon-secret" not found
Sep 16 12:01:49.685549 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.685522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02034161-8299-407b-a512-5484c2272a6c-original-pull-secret\") pod \"global-pull-secret-syncer-7792l\" (UID: \"02034161-8299-407b-a512-5484c2272a6c\") " pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:49.771252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.771225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:01:49.771347 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:49.771306    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:01:49.771387 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:01:49.771347    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls podName:b531e0f4-f48e-48e8-b629-c32125d742c4 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:21.771336069 +0000 UTC m=+98.214370908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls") pod "dns-default-jfmgf" (UID: "b531e0f4-f48e-48e8-b629-c32125d742c4") : secret "dns-default-metrics-tls" not found
Sep 16 12:01:49.842999 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.842978    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7792l"
Sep 16 12:01:49.871783 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.871759    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:49.874724 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.874685    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:01:49.884571 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.884544    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:01:49.895252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:49.895228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plshs\" (UniqueName: \"kubernetes.io/projected/a675b90a-b0e9-4cd5-bfb3-647bdd797283-kube-api-access-plshs\") pod \"network-check-target-2k6xr\" (UID: \"a675b90a-b0e9-4cd5-bfb3-647bdd797283\") " pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:50.106910 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:50.106850    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7792l"]
Sep 16 12:01:50.110412 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:01:50.110385    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02034161_8299_407b_a512_5484c2272a6c.slice/crio-6aacd6a2186d776d2e79950866afd719dcb80872507ed505b32ecc38d9bcccde WatchSource:0}: Error finding container 6aacd6a2186d776d2e79950866afd719dcb80872507ed505b32ecc38d9bcccde: Status 404 returned error can't find the container with id 6aacd6a2186d776d2e79950866afd719dcb80872507ed505b32ecc38d9bcccde
Sep 16 12:01:50.151459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:50.151441    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rfjm7\""
Sep 16 12:01:50.159670 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:50.159651    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:50.298682 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:50.298652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7792l" event={"ID":"02034161-8299-407b-a512-5484c2272a6c","Type":"ContainerStarted","Data":"6aacd6a2186d776d2e79950866afd719dcb80872507ed505b32ecc38d9bcccde"}
Sep 16 12:01:50.426048 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:50.426021    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2k6xr"]
Sep 16 12:01:50.428489 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:01:50.428466    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda675b90a_b0e9_4cd5_bfb3_647bdd797283.slice/crio-75ef9430df2fb61f682af674ce5a884bbc502f8aac2c657156ae1538be3038a0 WatchSource:0}: Error finding container 75ef9430df2fb61f682af674ce5a884bbc502f8aac2c657156ae1538be3038a0: Status 404 returned error can't find the container with id 75ef9430df2fb61f682af674ce5a884bbc502f8aac2c657156ae1538be3038a0
Sep 16 12:01:51.303138 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:51.303097    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2k6xr" event={"ID":"a675b90a-b0e9-4cd5-bfb3-647bdd797283","Type":"ContainerStarted","Data":"75ef9430df2fb61f682af674ce5a884bbc502f8aac2c657156ae1538be3038a0"}
Sep 16 12:01:55.315004 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:55.314919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7792l" event={"ID":"02034161-8299-407b-a512-5484c2272a6c","Type":"ContainerStarted","Data":"db57e1124b5da6dd9f359442dc0cee4b72bd4b1fe1460a2f1247ab11f7d95cfd"}
Sep 16 12:01:55.316326 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:55.316299    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2k6xr" event={"ID":"a675b90a-b0e9-4cd5-bfb3-647bdd797283","Type":"ContainerStarted","Data":"3695e51246abf30c2b63d63722451a679690c6d029dce56752cfd12a55785cdc"}
Sep 16 12:01:55.316460 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:55.316437    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:01:55.330576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:55.330530    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7792l" podStartSLOduration=66.549502951 podStartE2EDuration="1m11.330518605s" totalImagesPullingTime="4.781015654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:55.329869529 +0000 UTC m=+71.772904402" watchObservedRunningTime="2026-09-16 12:01:55.330518605 +0000 UTC m=+71.773553467"
Sep 16 12:01:55.346005 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:01:55.345973    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2k6xr" podStartSLOduration=66.882702329 podStartE2EDuration="1m11.345960978s" totalImagesPullingTime="4.463258649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:01:55.345049742 +0000 UTC m=+71.788084605" watchObservedRunningTime="2026-09-16 12:01:55.345960978 +0000 UTC m=+71.788995856"
Sep 16 12:02:17.661366 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.661258    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"]
Sep 16 12:02:17.665176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.665159    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"
Sep 16 12:02:17.669972 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.669946    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 16 12:02:17.670111 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.670080    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 12:02:17.670111 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.670096    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pf726\""
Sep 16 12:02:17.670241 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.670080    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 12:02:17.670241 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.670100    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 12:02:17.674877 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.674857    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"]
Sep 16 12:02:17.689790 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.689766    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"]
Sep 16 12:02:17.692342 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.692326    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.695236 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.695214    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 16 12:02:17.695236 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.695225    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 16 12:02:17.695381 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.695252    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 16 12:02:17.695575 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.695561    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 16 12:02:17.712165 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.712142    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"]
Sep 16 12:02:17.741332 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.741314    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75f9484e-098e-4adc-b7c2-ca8f2e308da4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68748f9f78-zb7kj\" (UID: \"75f9484e-098e-4adc-b7c2-ca8f2e308da4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"
Sep 16 12:02:17.741427 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.741341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.741427 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.741368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-hub\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.741427 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.741384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1afb352-078c-47c3-9be9-f10dae8eb246-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.741557 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.741424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.741557 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.741454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7f5z\" (UniqueName: \"kubernetes.io/projected/75f9484e-098e-4adc-b7c2-ca8f2e308da4-kube-api-access-b7f5z\") pod \"managed-serviceaccount-addon-agent-68748f9f78-zb7kj\" (UID: \"75f9484e-098e-4adc-b7c2-ca8f2e308da4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"
Sep 16 12:02:17.741557 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.741483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-ca\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.741557 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.741499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq2hd\" (UniqueName: \"kubernetes.io/projected/b1afb352-078c-47c3-9be9-f10dae8eb246-kube-api-access-fq2hd\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.842233 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.842210    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-ca\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.842315 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.842236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq2hd\" (UniqueName: \"kubernetes.io/projected/b1afb352-078c-47c3-9be9-f10dae8eb246-kube-api-access-fq2hd\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.842315 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.842265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75f9484e-098e-4adc-b7c2-ca8f2e308da4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68748f9f78-zb7kj\" (UID: \"75f9484e-098e-4adc-b7c2-ca8f2e308da4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"
Sep 16 12:02:17.842315 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.842287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.842452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.842405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-hub\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.842452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.842443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1afb352-078c-47c3-9be9-f10dae8eb246-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.842559 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.842478    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.842559 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.842514    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7f5z\" (UniqueName: \"kubernetes.io/projected/75f9484e-098e-4adc-b7c2-ca8f2e308da4-kube-api-access-b7f5z\") pod \"managed-serviceaccount-addon-agent-68748f9f78-zb7kj\" (UID: \"75f9484e-098e-4adc-b7c2-ca8f2e308da4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"
Sep 16 12:02:17.843226 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.843200    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1afb352-078c-47c3-9be9-f10dae8eb246-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.844868 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.844842    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75f9484e-098e-4adc-b7c2-ca8f2e308da4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68748f9f78-zb7kj\" (UID: \"75f9484e-098e-4adc-b7c2-ca8f2e308da4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"
Sep 16 12:02:17.844951 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.844934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.845060 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.845044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-ca\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.845221 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.845202    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.845448 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.845435    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b1afb352-078c-47c3-9be9-f10dae8eb246-hub\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.851227 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.851203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7f5z\" (UniqueName: \"kubernetes.io/projected/75f9484e-098e-4adc-b7c2-ca8f2e308da4-kube-api-access-b7f5z\") pod \"managed-serviceaccount-addon-agent-68748f9f78-zb7kj\" (UID: \"75f9484e-098e-4adc-b7c2-ca8f2e308da4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"
Sep 16 12:02:17.851635 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.851617    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq2hd\" (UniqueName: \"kubernetes.io/projected/b1afb352-078c-47c3-9be9-f10dae8eb246-kube-api-access-fq2hd\") pod \"cluster-proxy-proxy-agent-5c7449b767-9vqbc\" (UID: \"b1afb352-078c-47c3-9be9-f10dae8eb246\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:17.988080 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.988031    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"
Sep 16 12:02:17.999850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:17.999831    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:02:18.260975 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:18.258752    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj"]
Sep 16 12:02:18.265898 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:02:18.265871    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75f9484e_098e_4adc_b7c2_ca8f2e308da4.slice/crio-23eb7399247e477e347cef25c90e28a9cdbce77bc3cd56720d285796cf86dbb6 WatchSource:0}: Error finding container 23eb7399247e477e347cef25c90e28a9cdbce77bc3cd56720d285796cf86dbb6: Status 404 returned error can't find the container with id 23eb7399247e477e347cef25c90e28a9cdbce77bc3cd56720d285796cf86dbb6
Sep 16 12:02:18.283168 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:18.283140    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"]
Sep 16 12:02:18.285374 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:02:18.285355    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1afb352_078c_47c3_9be9_f10dae8eb246.slice/crio-5bea23b6679582ec8f263a9fb6d8ca088eaf95643a8112163e156f6a92377d17 WatchSource:0}: Error finding container 5bea23b6679582ec8f263a9fb6d8ca088eaf95643a8112163e156f6a92377d17: Status 404 returned error can't find the container with id 5bea23b6679582ec8f263a9fb6d8ca088eaf95643a8112163e156f6a92377d17
Sep 16 12:02:18.364360 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:18.364335    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" event={"ID":"b1afb352-078c-47c3-9be9-f10dae8eb246","Type":"ContainerStarted","Data":"5bea23b6679582ec8f263a9fb6d8ca088eaf95643a8112163e156f6a92377d17"}
Sep 16 12:02:18.365386 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:18.365366    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj" event={"ID":"75f9484e-098e-4adc-b7c2-ca8f2e308da4","Type":"ContainerStarted","Data":"23eb7399247e477e347cef25c90e28a9cdbce77bc3cd56720d285796cf86dbb6"}
Sep 16 12:02:21.772600 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:21.772564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:02:21.773010 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:02:21.772680    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:02:21.773010 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:02:21.772752    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls podName:b531e0f4-f48e-48e8-b629-c32125d742c4 nodeName:}" failed. No retries permitted until 2026-09-16 12:03:25.77273565 +0000 UTC m=+162.215770490 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls") pod "dns-default-jfmgf" (UID: "b531e0f4-f48e-48e8-b629-c32125d742c4") : secret "dns-default-metrics-tls" not found
Sep 16 12:02:22.379107 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:22.379071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj" event={"ID":"75f9484e-098e-4adc-b7c2-ca8f2e308da4","Type":"ContainerStarted","Data":"f2723983c610ec8386aeb9a4dfec22f60b5fcf0afb478aa18196c6da9472dd23"}
Sep 16 12:02:22.394203 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:22.394156    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj" podStartSLOduration=2.308176999 podStartE2EDuration="5.394139552s" totalImagesPullingTime="3.085962553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:22.393513656 +0000 UTC m=+98.836548519" watchObservedRunningTime="2026-09-16 12:02:22.394139552 +0000 UTC m=+98.837174420"
Sep 16 12:02:23.384443 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:23.384406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" event={"ID":"b1afb352-078c-47c3-9be9-f10dae8eb246","Type":"ContainerStarted","Data":"5b4541938d81a66b7e3a510ccb315661ccf11cba391bd685699136125f66b0da"}
Sep 16 12:02:23.384864 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:23.384462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" event={"ID":"b1afb352-078c-47c3-9be9-f10dae8eb246","Type":"ContainerStarted","Data":"85acec686ec7b7512958d450ec650996bc7b08bebf80ebf8d9c3e94ac91fcd9a"}
Sep 16 12:02:23.384864 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:23.384483    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" event={"ID":"b1afb352-078c-47c3-9be9-f10dae8eb246","Type":"ContainerStarted","Data":"754735818c027399fc41ead8278e2d961f105de1d837dbc0ff1516f997ed1d0c"}
Sep 16 12:02:23.408244 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:23.408201    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" podStartSLOduration=1.993921633 podStartE2EDuration="6.408186968s" totalImagesPullingTime="4.414265335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:23.407476571 +0000 UTC m=+99.850511435" watchObservedRunningTime="2026-09-16 12:02:23.408186968 +0000 UTC m=+99.851221871"
Sep 16 12:02:26.320796 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:26.320769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2k6xr"
Sep 16 12:02:53.765235 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:02:53.765195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:02:53.765632 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:02:53.765329    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 12:02:53.765632 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:02:53.765386    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:04:55.765372284 +0000 UTC m=+252.208407124 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : secret "metrics-daemon-secret" not found
Sep 16 12:03:20.918110 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:03:20.918074    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jfmgf" podUID="b531e0f4-f48e-48e8-b629-c32125d742c4"
Sep 16 12:03:21.035933 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:03:21.035901    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:03:21.530159 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:03:21.530135    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:03:25.863743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:03:25.863680    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:03:25.864114 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:03:25.863828    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:03:25.864114 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:03:25.863879    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls podName:b531e0f4-f48e-48e8-b629-c32125d742c4 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:27.863864458 +0000 UTC m=+284.306899298 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls") pod "dns-default-jfmgf" (UID: "b531e0f4-f48e-48e8-b629-c32125d742c4") : secret "dns-default-metrics-tls" not found
Sep 16 12:03:36.024323 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:03:36.024292    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:04:21.680794 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:04:21.680766    2559 generic.go:356] "Generic (PLEG): container finished" podID="75f9484e-098e-4adc-b7c2-ca8f2e308da4" containerID="f2723983c610ec8386aeb9a4dfec22f60b5fcf0afb478aa18196c6da9472dd23" exitCode=255
Sep 16 12:04:21.681123 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:04:21.680836    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj" event={"ID":"75f9484e-098e-4adc-b7c2-ca8f2e308da4","Type":"ContainerDied","Data":"f2723983c610ec8386aeb9a4dfec22f60b5fcf0afb478aa18196c6da9472dd23"}
Sep 16 12:04:21.681123 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:04:21.681098    2559 scope.go:117] "RemoveContainer" containerID="f2723983c610ec8386aeb9a4dfec22f60b5fcf0afb478aa18196c6da9472dd23"
Sep 16 12:04:22.684825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:04:22.684796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68748f9f78-zb7kj" event={"ID":"75f9484e-098e-4adc-b7c2-ca8f2e308da4","Type":"ContainerStarted","Data":"fb79c24df9f5a248200e284a95c30e719cae054231f6b46721fc499168868fdc"}
Sep 16 12:04:55.827895 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:04:55.827861    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:04:55.828420 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:04:55.827999    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 12:04:55.828420 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:04:55.828077    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs podName:6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb nodeName:}" failed. No retries permitted until 2026-09-16 12:06:57.828056928 +0000 UTC m=+374.271091786 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs") pod "network-metrics-daemon-th86b" (UID: "6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb") : secret "metrics-daemon-secret" not found
Sep 16 12:05:10.195020 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.194946    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lhb9v"]
Sep 16 12:05:10.201615 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.201596    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.204220 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.204198    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 12:05:10.204220 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.204208    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 12:05:10.204363 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.204255    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lnmtw\""
Sep 16 12:05:10.204363 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.204212    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 12:05:10.205161 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.205142    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 12:05:10.207173 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.207155    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lhb9v"]
Sep 16 12:05:10.218883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.218865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbncv\" (UniqueName: \"kubernetes.io/projected/2190092b-e043-4242-a850-b5df4be51ce8-kube-api-access-gbncv\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.218969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.218890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2190092b-e043-4242-a850-b5df4be51ce8-crio-socket\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.218969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.218907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2190092b-e043-4242-a850-b5df4be51ce8-data-volume\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.218969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.218921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.219065 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.218977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.319920 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.319899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbncv\" (UniqueName: \"kubernetes.io/projected/2190092b-e043-4242-a850-b5df4be51ce8-kube-api-access-gbncv\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.320006 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.319925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2190092b-e043-4242-a850-b5df4be51ce8-crio-socket\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.320006 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.319941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2190092b-e043-4242-a850-b5df4be51ce8-data-volume\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.320006 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.319961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.320113 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.320012    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2190092b-e043-4242-a850-b5df4be51ce8-crio-socket\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.320207 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:10.320184    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:10.320253 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.320224    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.320293 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:10.320260    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:10.820242265 +0000 UTC m=+267.263277109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:10.320340 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.320324    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2190092b-e043-4242-a850-b5df4be51ce8-data-volume\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.320374 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:10.320333    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:10.320419 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:10.320397    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:10.820383869 +0000 UTC m=+267.263418712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:10.328389 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.328368    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbncv\" (UniqueName: \"kubernetes.io/projected/2190092b-e043-4242-a850-b5df4be51ce8-kube-api-access-gbncv\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.823824 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.823798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.823928 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:10.823842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:10.823928 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:10.823901    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:10.824036 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:10.823942    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:10.824036 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:10.823945    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:11.823928857 +0000 UTC m=+268.266963714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:10.824036 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:10.823997    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:11.823982964 +0000 UTC m=+268.267017808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:11.829335 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:11.829303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:11.829751 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:11.829349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:11.829751 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:11.829421    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:11.829751 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:11.829464    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:11.829751 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:11.829479    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:13.829464932 +0000 UTC m=+270.272499771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:11.829751 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:11.829514    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:13.829498609 +0000 UTC m=+270.272533450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:12.353201 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:12.353180    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gbwzr_8baa1341-2665-43af-abee-7297cf014daa/dns-node-resolver/0.log"
Sep 16 12:05:13.152860 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.152840    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhskk_268eaad8-cdac-46d7-8412-4e2561bb9efe/node-ca/0.log"
Sep 16 12:05:13.213053 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.213026    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-g97bt"]
Sep 16 12:05:13.215937 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.215920    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.218604 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.218582    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 16 12:05:13.218711 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.218615    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7w7l5\""
Sep 16 12:05:13.219672 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.219651    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 16 12:05:13.219772 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.219651    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 16 12:05:13.219772 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.219731    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 16 12:05:13.224679 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.224659    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-g97bt"]
Sep 16 12:05:13.239156 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.239134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddbdr\" (UniqueName: \"kubernetes.io/projected/d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87-kube-api-access-ddbdr\") pod \"service-ca-568869fdc5-g97bt\" (UID: \"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87\") " pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.239256 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.239162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87-signing-key\") pod \"service-ca-568869fdc5-g97bt\" (UID: \"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87\") " pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.239256 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.239188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87-signing-cabundle\") pod \"service-ca-568869fdc5-g97bt\" (UID: \"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87\") " pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.340483 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.340461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbdr\" (UniqueName: \"kubernetes.io/projected/d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87-kube-api-access-ddbdr\") pod \"service-ca-568869fdc5-g97bt\" (UID: \"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87\") " pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.340562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.340486    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87-signing-key\") pod \"service-ca-568869fdc5-g97bt\" (UID: \"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87\") " pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.340562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.340505    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87-signing-cabundle\") pod \"service-ca-568869fdc5-g97bt\" (UID: \"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87\") " pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.341024 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.341009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87-signing-cabundle\") pod \"service-ca-568869fdc5-g97bt\" (UID: \"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87\") " pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.342731 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.342715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87-signing-key\") pod \"service-ca-568869fdc5-g97bt\" (UID: \"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87\") " pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.348947 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.348929    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddbdr\" (UniqueName: \"kubernetes.io/projected/d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87-kube-api-access-ddbdr\") pod \"service-ca-568869fdc5-g97bt\" (UID: \"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87\") " pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.524486 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.524436    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-g97bt"
Sep 16 12:05:13.792218 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.792151    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-g97bt"]
Sep 16 12:05:13.796333 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:05:13.796311    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cedac0_723c_4a6b_b21b_ce9dd0c3eb87.slice/crio-b10ced2dfc9440be1bd17a9240bf0ae43a1c52894e234c2186c03da2b4299742 WatchSource:0}: Error finding container b10ced2dfc9440be1bd17a9240bf0ae43a1c52894e234c2186c03da2b4299742: Status 404 returned error can't find the container with id b10ced2dfc9440be1bd17a9240bf0ae43a1c52894e234c2186c03da2b4299742
Sep 16 12:05:13.818836 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.818813    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-g97bt" event={"ID":"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87","Type":"ContainerStarted","Data":"b10ced2dfc9440be1bd17a9240bf0ae43a1c52894e234c2186c03da2b4299742"}
Sep 16 12:05:13.843924 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.843895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:13.843991 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:13.843940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:13.844033 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:13.844018    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:13.844076 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:13.844067    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:17.844053213 +0000 UTC m=+274.287088053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:13.844120 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:13.844105    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:13.844158 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:13.844149    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:17.844137335 +0000 UTC m=+274.287172176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:14.152798 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:14.152778    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zntf4_402683c1-20d6-4a8e-b7a8-b74e847dbf76/serve-healthcheck-canary/0.log"
Sep 16 12:05:15.826480 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:15.826441    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-g97bt" event={"ID":"d0cedac0-723c-4a6b-b21b-ce9dd0c3eb87","Type":"ContainerStarted","Data":"00edd9f81e51c8a28760e6b7cfeb95227cc4d6aed550dc07a712626cf649b30e"}
Sep 16 12:05:15.842805 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:15.842763    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-g97bt" podStartSLOduration=0.936468792 podStartE2EDuration="2.842748008s" totalImagesPullingTime="1.906279216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:05:15.841842628 +0000 UTC m=+272.284877491" watchObservedRunningTime="2026-09-16 12:05:15.842748008 +0000 UTC m=+272.285782870"
Sep 16 12:05:17.874689 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:17.874649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:17.875150 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:17.874719    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:17.875150 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:17.874790    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:05:17.875150 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:17.874856    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:17.875150 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:17.874861    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:25.874841518 +0000 UTC m=+282.317876363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : configmap "kube-rbac-proxy" not found
Sep 16 12:05:17.875150 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:17.874916    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:25.874898657 +0000 UTC m=+282.317933500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:24.530453 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:24.530420    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jfmgf" podUID="b531e0f4-f48e-48e8-b629-c32125d742c4"
Sep 16 12:05:24.857915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:24.857852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:05:25.929863 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:25.929831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:25.930240 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:25.929868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:25.930240 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:25.929987    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:25.930240 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:25.930046    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls podName:2190092b-e043-4242-a850-b5df4be51ce8 nodeName:}" failed. No retries permitted until 2026-09-16 12:05:41.930030783 +0000 UTC m=+298.373065626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhb9v" (UID: "2190092b-e043-4242-a850-b5df4be51ce8") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:05:25.930351 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:25.930282    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2190092b-e043-4242-a850-b5df4be51ce8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:27.940808 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:27.940773    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:05:27.942932 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:27.942904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b531e0f4-f48e-48e8-b629-c32125d742c4-metrics-tls\") pod \"dns-default-jfmgf\" (UID: \"b531e0f4-f48e-48e8-b629-c32125d742c4\") " pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:05:28.161347 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:28.161328    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rfzsk\""
Sep 16 12:05:28.169265 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:28.169248    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:05:28.439829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:28.439803    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jfmgf"]
Sep 16 12:05:28.442436 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:05:28.442411    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb531e0f4_f48e_48e8_b629_c32125d742c4.slice/crio-a27a5ffef937dd1d80fc08d715b672c006c566159069218b642cf166e07e2b69 WatchSource:0}: Error finding container a27a5ffef937dd1d80fc08d715b672c006c566159069218b642cf166e07e2b69: Status 404 returned error can't find the container with id a27a5ffef937dd1d80fc08d715b672c006c566159069218b642cf166e07e2b69
Sep 16 12:05:28.868851 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:28.868822    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jfmgf" event={"ID":"b531e0f4-f48e-48e8-b629-c32125d742c4","Type":"ContainerStarted","Data":"a27a5ffef937dd1d80fc08d715b672c006c566159069218b642cf166e07e2b69"}
Sep 16 12:05:30.876667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:30.876628    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jfmgf" event={"ID":"b531e0f4-f48e-48e8-b629-c32125d742c4","Type":"ContainerStarted","Data":"0149a0a384c521f796abde1bf35636b8b12055552a168f654b646ff162112a3a"}
Sep 16 12:05:30.877017 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:30.876681    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jfmgf" event={"ID":"b531e0f4-f48e-48e8-b629-c32125d742c4","Type":"ContainerStarted","Data":"d239d5f299379bad9e6ba9a0b3b5384fe71917cb6ad64d8e7d017f9265380bf1"}
Sep 16 12:05:30.877017 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:30.876741    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:05:30.895367 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:30.895324    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jfmgf" podStartSLOduration=252.359247689 podStartE2EDuration="4m13.895309978s" totalImagesPullingTime="1.536062289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:05:30.893841298 +0000 UTC m=+287.336876162" watchObservedRunningTime="2026-09-16 12:05:30.895309978 +0000 UTC m=+287.338344834"
Sep 16 12:05:39.024664 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:05:39.024622    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-th86b" podUID="6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb"
Sep 16 12:05:40.881651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:40.881624    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jfmgf"
Sep 16 12:05:42.029541 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:42.029496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:42.031986 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:42.031964    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2190092b-e043-4242-a850-b5df4be51ce8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhb9v\" (UID: \"2190092b-e043-4242-a850-b5df4be51ce8\") " pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:42.310857 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:42.310806    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lhb9v"
Sep 16 12:05:42.580538 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:42.580475    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lhb9v"]
Sep 16 12:05:42.583787 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:05:42.583759    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2190092b_e043_4242_a850_b5df4be51ce8.slice/crio-d6319fc4a8f72b2f1717c7398a533e4868d03dd040c4df1afb5cee3a156f7b62 WatchSource:0}: Error finding container d6319fc4a8f72b2f1717c7398a533e4868d03dd040c4df1afb5cee3a156f7b62: Status 404 returned error can't find the container with id d6319fc4a8f72b2f1717c7398a533e4868d03dd040c4df1afb5cee3a156f7b62
Sep 16 12:05:42.915011 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:42.914981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhb9v" event={"ID":"2190092b-e043-4242-a850-b5df4be51ce8","Type":"ContainerStarted","Data":"e744dbded89c4210810103eb4768fa9a50799ebc1714ea292ab581b657c839fd"}
Sep 16 12:05:42.915119 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:42.915036    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhb9v" event={"ID":"2190092b-e043-4242-a850-b5df4be51ce8","Type":"ContainerStarted","Data":"d6319fc4a8f72b2f1717c7398a533e4868d03dd040c4df1afb5cee3a156f7b62"}
Sep 16 12:05:43.915909 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:43.915880    2559 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 12:05:43.919813 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:43.919789    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhb9v" event={"ID":"2190092b-e043-4242-a850-b5df4be51ce8","Type":"ContainerStarted","Data":"a97e641be483c547ea6fbfeec862903f3b781ea86bb6ca1c3717cdef45d1acb8"}
Sep 16 12:05:45.928206 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:45.928172    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhb9v" event={"ID":"2190092b-e043-4242-a850-b5df4be51ce8","Type":"ContainerStarted","Data":"047ca52cbb508f7446dcb276fe9eabd40b76b53d1bc3a4ea6451e844cb55a54d"}
Sep 16 12:05:45.949007 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:45.948961    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lhb9v" podStartSLOduration=33.612046726 podStartE2EDuration="35.94894793s" totalImagesPullingTime="2.336901204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:05:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:05:45.948113763 +0000 UTC m=+302.391148625" watchObservedRunningTime="2026-09-16 12:05:45.94894793 +0000 UTC m=+302.391982792"
Sep 16 12:05:50.024570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:05:50.024544    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:06:28.001009 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:28.000966    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" podUID="b1afb352-078c-47c3-9be9-f10dae8eb246" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 12:06:38.001171 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:38.001080    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" podUID="b1afb352-078c-47c3-9be9-f10dae8eb246" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 12:06:48.001419 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:48.001382    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" podUID="b1afb352-078c-47c3-9be9-f10dae8eb246" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 12:06:48.001792 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:48.001449    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc"
Sep 16 12:06:48.001883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:48.001855    2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5b4541938d81a66b7e3a510ccb315661ccf11cba391bd685699136125f66b0da"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 16 12:06:48.001921 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:48.001901    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" podUID="b1afb352-078c-47c3-9be9-f10dae8eb246" containerName="service-proxy" containerID="cri-o://5b4541938d81a66b7e3a510ccb315661ccf11cba391bd685699136125f66b0da" gracePeriod=30
Sep 16 12:06:49.100780 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:49.100754    2559 generic.go:356] "Generic (PLEG): container finished" podID="b1afb352-078c-47c3-9be9-f10dae8eb246" containerID="5b4541938d81a66b7e3a510ccb315661ccf11cba391bd685699136125f66b0da" exitCode=2
Sep 16 12:06:49.101094 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:49.100803    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" event={"ID":"b1afb352-078c-47c3-9be9-f10dae8eb246","Type":"ContainerDied","Data":"5b4541938d81a66b7e3a510ccb315661ccf11cba391bd685699136125f66b0da"}
Sep 16 12:06:49.101094 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:49.100832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7449b767-9vqbc" event={"ID":"b1afb352-078c-47c3-9be9-f10dae8eb246","Type":"ContainerStarted","Data":"a4002ffc43d58077c3e4dd71cd41642a0af68ad2b4020bf795504da68de2f2d7"}
Sep 16 12:06:57.903526 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:57.903494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:06:57.905624 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:57.905604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb-metrics-certs\") pod \"network-metrics-daemon-th86b\" (UID: \"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb\") " pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:06:58.127560 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:58.127538    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hp2p6\""
Sep 16 12:06:58.135781 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:58.135764    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-th86b"
Sep 16 12:06:58.403647 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:58.403618    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-th86b"]
Sep 16 12:06:58.406354 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:06:58.406327    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2f42ca_2177_4cd6_a32b_8fb0dda6adbb.slice/crio-ff8798ac68490d9c6a685937faa771e99e096e59a454eb3e411e3f87a5a6213e WatchSource:0}: Error finding container ff8798ac68490d9c6a685937faa771e99e096e59a454eb3e411e3f87a5a6213e: Status 404 returned error can't find the container with id ff8798ac68490d9c6a685937faa771e99e096e59a454eb3e411e3f87a5a6213e
Sep 16 12:06:58.408291 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:58.408274    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:06:59.130614 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:06:59.130576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-th86b" event={"ID":"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb","Type":"ContainerStarted","Data":"ff8798ac68490d9c6a685937faa771e99e096e59a454eb3e411e3f87a5a6213e"}
Sep 16 12:07:00.135049 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:00.135020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-th86b" event={"ID":"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb","Type":"ContainerStarted","Data":"643777e1a498dab44a74b07dac7416bd84d1a726386eb18184a17bb2b03bc6d6"}
Sep 16 12:07:00.135358 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:00.135066    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-th86b" event={"ID":"6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb","Type":"ContainerStarted","Data":"536591a6b6624ecdd129e35048686186bc8b5554ceaa256dcd19561a06e82d18"}
Sep 16 12:07:00.156889 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:00.156838    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-th86b" podStartSLOduration=375.20815035 podStartE2EDuration="6m16.15682399s" totalImagesPullingTime="948.67364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:00.15659381 +0000 UTC m=+376.599628672" watchObservedRunningTime="2026-09-16 12:07:00.15682399 +0000 UTC m=+376.599858852"
Sep 16 12:07:33.783671 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.783641    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p4qsw"]
Sep 16 12:07:33.788902 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.788877    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:33.791987 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.791966    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 12:07:33.792141 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.792117    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 12:07:33.792252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.792172    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 12:07:33.792252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.792018    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 12:07:33.792377 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.791981    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 12:07:33.793019 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.792998    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 12:07:33.793689 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.793669    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rk4zl\""
Sep 16 12:07:33.916093 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.916069    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-textfile\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:33.916190 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.916096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:33.916190 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.916115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bnkh\" (UniqueName: \"kubernetes.io/projected/03cd13fc-07da-4a64-be43-c63b884ec44c-kube-api-access-8bnkh\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:33.916190 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.916133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-tls\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:33.916190 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.916167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:33.916381 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.916227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-wtmp\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:33.916381 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.916266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03cd13fc-07da-4a64-be43-c63b884ec44c-root\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:33.916381 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.916292    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03cd13fc-07da-4a64-be43-c63b884ec44c-metrics-client-ca\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:33.916381 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:33.916353    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03cd13fc-07da-4a64-be43-c63b884ec44c-sys\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016551 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-textfile\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bnkh\" (UniqueName: \"kubernetes.io/projected/03cd13fc-07da-4a64-be43-c63b884ec44c-kube-api-access-8bnkh\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-tls\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016665    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-wtmp\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03cd13fc-07da-4a64-be43-c63b884ec44c-root\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03cd13fc-07da-4a64-be43-c63b884ec44c-metrics-client-ca\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03cd13fc-07da-4a64-be43-c63b884ec44c-sys\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03cd13fc-07da-4a64-be43-c63b884ec44c-sys\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-wtmp\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.016885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016863    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03cd13fc-07da-4a64-be43-c63b884ec44c-root\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.017233 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.016885    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-textfile\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.017386 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.017355    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.017386 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.017360    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03cd13fc-07da-4a64-be43-c63b884ec44c-metrics-client-ca\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.019143 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.019123    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.019354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.019331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03cd13fc-07da-4a64-be43-c63b884ec44c-node-exporter-tls\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.025323 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.025302    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bnkh\" (UniqueName: \"kubernetes.io/projected/03cd13fc-07da-4a64-be43-c63b884ec44c-kube-api-access-8bnkh\") pod \"node-exporter-p4qsw\" (UID: \"03cd13fc-07da-4a64-be43-c63b884ec44c\") " pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.102903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.102854    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p4qsw"
Sep 16 12:07:34.115149 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:07:34.115125    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cd13fc_07da_4a64_be43_c63b884ec44c.slice/crio-a6dcca0a87d85f34f71b3411f9857d9fb970df691cc8531782dbb5e869d22ca7 WatchSource:0}: Error finding container a6dcca0a87d85f34f71b3411f9857d9fb970df691cc8531782dbb5e869d22ca7: Status 404 returned error can't find the container with id a6dcca0a87d85f34f71b3411f9857d9fb970df691cc8531782dbb5e869d22ca7
Sep 16 12:07:34.228702 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.228674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4qsw" event={"ID":"03cd13fc-07da-4a64-be43-c63b884ec44c","Type":"ContainerStarted","Data":"a6dcca0a87d85f34f71b3411f9857d9fb970df691cc8531782dbb5e869d22ca7"}
Sep 16 12:07:34.824443 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.824408    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:07:34.828756 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.828731    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:34.831444 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.831420    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 16 12:07:34.831581 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.831472    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 16 12:07:34.831827 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.831804    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 16 12:07:34.831943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.831859    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 16 12:07:34.832340 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.832254    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 16 12:07:34.832340 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.832285    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 16 12:07:34.832340 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.832319    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 16 12:07:34.832539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.832350    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m98jn\""
Sep 16 12:07:34.832539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.832396    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 16 12:07:34.837944 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.837921    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 16 12:07:34.842443 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:34.842418    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:07:35.024312 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024277    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024481 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024481 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024481 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0101191-8da3-48e6-9fde-fbbe04e97afd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024481 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024481 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv8fw\" (UniqueName: \"kubernetes.io/projected/c0101191-8da3-48e6-9fde-fbbe04e97afd-kube-api-access-nv8fw\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024756 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024756 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024613    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024756 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-web-config\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024756 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0101191-8da3-48e6-9fde-fbbe04e97afd-config-out\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024907 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0101191-8da3-48e6-9fde-fbbe04e97afd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024907 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0101191-8da3-48e6-9fde-fbbe04e97afd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.024907 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.024833    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0101191-8da3-48e6-9fde-fbbe04e97afd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.125786 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.125725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.125786 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.125758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.125786 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.125777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126031 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.125793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0101191-8da3-48e6-9fde-fbbe04e97afd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126031 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.125812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126031 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.125839    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv8fw\" (UniqueName: \"kubernetes.io/projected/c0101191-8da3-48e6-9fde-fbbe04e97afd-kube-api-access-nv8fw\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126031 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.125868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126031 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.125907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126031 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:07:35.125911    2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 16 12:07:35.126031 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:07:35.125982    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-main-tls podName:c0101191-8da3-48e6-9fde-fbbe04e97afd nodeName:}" failed. No retries permitted until 2026-09-16 12:07:35.62596279 +0000 UTC m=+412.068997646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c0101191-8da3-48e6-9fde-fbbe04e97afd") : secret "alertmanager-main-tls" not found
Sep 16 12:07:35.126031 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.126028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-web-config\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.126064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0101191-8da3-48e6-9fde-fbbe04e97afd-config-out\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.126095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0101191-8da3-48e6-9fde-fbbe04e97afd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.126130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0101191-8da3-48e6-9fde-fbbe04e97afd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.126173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0101191-8da3-48e6-9fde-fbbe04e97afd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126657 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.126469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0101191-8da3-48e6-9fde-fbbe04e97afd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.126657 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.126642    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0101191-8da3-48e6-9fde-fbbe04e97afd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.129554 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.128991    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.129554 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.129120    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.129554 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.129162    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-web-config\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.129554 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.129233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0101191-8da3-48e6-9fde-fbbe04e97afd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.129554 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.129500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.129554 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.129547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0101191-8da3-48e6-9fde-fbbe04e97afd-config-out\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.129868 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.129782    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0101191-8da3-48e6-9fde-fbbe04e97afd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.130041 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.130026    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.130382 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.130366    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.136478 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.136457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv8fw\" (UniqueName: \"kubernetes.io/projected/c0101191-8da3-48e6-9fde-fbbe04e97afd-kube-api-access-nv8fw\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.233461 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.233435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4qsw" event={"ID":"03cd13fc-07da-4a64-be43-c63b884ec44c","Type":"ContainerStarted","Data":"3b91a3eed2e66eec80f4eefadcd38be124bb9e3d591f0ed0e93c66c58ab85c6b"}
Sep 16 12:07:35.630068 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.630036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.631950 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.631930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0101191-8da3-48e6-9fde-fbbe04e97afd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0101191-8da3-48e6-9fde-fbbe04e97afd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:35.741026 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:35.741000    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:07:36.023047 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.023023    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:07:36.024182 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:07:36.024159    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0101191_8da3_48e6_9fde_fbbe04e97afd.slice/crio-6af152f9cfd76fa61e9d1f043a5d2da8202ad3d02baf221b82c6999a87f588cd WatchSource:0}: Error finding container 6af152f9cfd76fa61e9d1f043a5d2da8202ad3d02baf221b82c6999a87f588cd: Status 404 returned error can't find the container with id 6af152f9cfd76fa61e9d1f043a5d2da8202ad3d02baf221b82c6999a87f588cd
Sep 16 12:07:36.241833 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.241805    2559 generic.go:356] "Generic (PLEG): container finished" podID="03cd13fc-07da-4a64-be43-c63b884ec44c" containerID="3b91a3eed2e66eec80f4eefadcd38be124bb9e3d591f0ed0e93c66c58ab85c6b" exitCode=0
Sep 16 12:07:36.241925 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.241870    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4qsw" event={"ID":"03cd13fc-07da-4a64-be43-c63b884ec44c","Type":"ContainerDied","Data":"3b91a3eed2e66eec80f4eefadcd38be124bb9e3d591f0ed0e93c66c58ab85c6b"}
Sep 16 12:07:36.243057 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.243035    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0101191-8da3-48e6-9fde-fbbe04e97afd","Type":"ContainerStarted","Data":"6af152f9cfd76fa61e9d1f043a5d2da8202ad3d02baf221b82c6999a87f588cd"}
Sep 16 12:07:36.750752 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.750713    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"]
Sep 16 12:07:36.754098 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.754080    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:36.756743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.756561    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 16 12:07:36.756743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.756570    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 16 12:07:36.756743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.756604    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 16 12:07:36.756743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.756645    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2quh71pplj6aj\""
Sep 16 12:07:36.757016 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.756981    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 16 12:07:36.757071 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.757026    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 16 12:07:36.757535 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.757519    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4sdjb\""
Sep 16 12:07:36.767247 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.767223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"]
Sep 16 12:07:36.939539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.939514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-tls\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:36.939639 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.939544    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:36.939639 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.939567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-grpc-tls\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:36.939639 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.939616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:36.939639 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.939632    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6k94\" (UniqueName: \"kubernetes.io/projected/71ec0486-e779-4c89-b2cf-c803c133b0a7-kube-api-access-d6k94\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:36.939823 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.939650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ec0486-e779-4c89-b2cf-c803c133b0a7-metrics-client-ca\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:36.939823 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.939666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:36.939823 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:36.939684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.040770 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.040710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-tls\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.040770 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.040746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.041178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.040778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-grpc-tls\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.041178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.040928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.041178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.040956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6k94\" (UniqueName: \"kubernetes.io/projected/71ec0486-e779-4c89-b2cf-c803c133b0a7-kube-api-access-d6k94\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.041178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.040984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ec0486-e779-4c89-b2cf-c803c133b0a7-metrics-client-ca\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.041178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.041011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.041178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.041043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.041861 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.041834    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71ec0486-e779-4c89-b2cf-c803c133b0a7-metrics-client-ca\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.043476 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.043446    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-grpc-tls\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.043665 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.043646    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.043768 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.043676    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-tls\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.043846 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.043824    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.043902 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.043822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.044214 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.044195    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/71ec0486-e779-4c89-b2cf-c803c133b0a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.049350 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.049333    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6k94\" (UniqueName: \"kubernetes.io/projected/71ec0486-e779-4c89-b2cf-c803c133b0a7-kube-api-access-d6k94\") pod \"thanos-querier-5b56d4fb4b-r6rr9\" (UID: \"71ec0486-e779-4c89-b2cf-c803c133b0a7\") " pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.064204 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.064184    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:37.248122 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.248091    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4qsw" event={"ID":"03cd13fc-07da-4a64-be43-c63b884ec44c","Type":"ContainerStarted","Data":"8327e4d28fb2f439cfdc22eafdf1f90379afe6451ad7f9871e358315ae90ee01"}
Sep 16 12:07:37.248239 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.248145    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4qsw" event={"ID":"03cd13fc-07da-4a64-be43-c63b884ec44c","Type":"ContainerStarted","Data":"7a0acee074f138e44f38c833abc8ee8bbcf0006b124b49d81c97dfa6d5ac4175"}
Sep 16 12:07:37.267504 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.267464    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p4qsw" podStartSLOduration=3.161468208 podStartE2EDuration="4.267450454s" totalImagesPullingTime="1.045769694s" totalInitContainerRuntime="60.212552ms" isStatefulPod=true podCreationTimestamp="2026-09-16 12:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:37.267023717 +0000 UTC m=+413.710058591" watchObservedRunningTime="2026-09-16 12:07:37.267450454 +0000 UTC m=+413.710485655"
Sep 16 12:07:37.335807 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:37.335396    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"]
Sep 16 12:07:37.338051 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:07:37.338026    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ec0486_e779_4c89_b2cf_c803c133b0a7.slice/crio-549a940d36be83958682a7c5510e5bfe572537121498262adfebb6cd715c56ba WatchSource:0}: Error finding container 549a940d36be83958682a7c5510e5bfe572537121498262adfebb6cd715c56ba: Status 404 returned error can't find the container with id 549a940d36be83958682a7c5510e5bfe572537121498262adfebb6cd715c56ba
Sep 16 12:07:38.252383 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:38.252352    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9" event={"ID":"71ec0486-e779-4c89-b2cf-c803c133b0a7","Type":"ContainerStarted","Data":"549a940d36be83958682a7c5510e5bfe572537121498262adfebb6cd715c56ba"}
Sep 16 12:07:38.253889 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:38.253868    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0101191-8da3-48e6-9fde-fbbe04e97afd" containerID="785cc1232cdb6ce22ff530cf448622ae6b9fe7ab9b92a99b5d36369250afbb7f" exitCode=0
Sep 16 12:07:38.253987 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:38.253950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0101191-8da3-48e6-9fde-fbbe04e97afd","Type":"ContainerDied","Data":"785cc1232cdb6ce22ff530cf448622ae6b9fe7ab9b92a99b5d36369250afbb7f"}
Sep 16 12:07:40.263962 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:40.263929    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9" event={"ID":"71ec0486-e779-4c89-b2cf-c803c133b0a7","Type":"ContainerStarted","Data":"0eba4b35a3ab2a929a0fbcc294aa67a1a9158014a873f0b3edca40c5c5767ace"}
Sep 16 12:07:40.264311 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:40.263995    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9" event={"ID":"71ec0486-e779-4c89-b2cf-c803c133b0a7","Type":"ContainerStarted","Data":"9acb51f7ef75fe95791cca4a0c5a616ef510e58588319851c60222dbee4d4620"}
Sep 16 12:07:40.264311 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:40.264033    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9" event={"ID":"71ec0486-e779-4c89-b2cf-c803c133b0a7","Type":"ContainerStarted","Data":"7a5557db385f1ddd3d7c25a9aefd3d551abc4f87acb561f88262506fc8302a23"}
Sep 16 12:07:41.270159 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.270132    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9" event={"ID":"71ec0486-e779-4c89-b2cf-c803c133b0a7","Type":"ContainerStarted","Data":"fa8bfb7d3bded8fd1bc1bc7912c06e9c4923679cc1f7578d2c5135a5ad0b21bd"}
Sep 16 12:07:41.270509 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.270204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9" event={"ID":"71ec0486-e779-4c89-b2cf-c803c133b0a7","Type":"ContainerStarted","Data":"ba127b329ad608cc600a104a67355c018ce0bc4ed38b5c4a298b58e0c261434e"}
Sep 16 12:07:41.270509 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.270247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9" event={"ID":"71ec0486-e779-4c89-b2cf-c803c133b0a7","Type":"ContainerStarted","Data":"e0f9b2e45abe51e1af079c8222cbc9c15fe747361b29d93684a3047becfeee9b"}
Sep 16 12:07:41.270509 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.270293    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:07:41.273426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.273401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0101191-8da3-48e6-9fde-fbbe04e97afd","Type":"ContainerStarted","Data":"eee96f0d0a882492b1f55b5863b9078aa5eb124f6ad91a0b60bf58b59dc170f9"}
Sep 16 12:07:41.273516 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.273452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0101191-8da3-48e6-9fde-fbbe04e97afd","Type":"ContainerStarted","Data":"0646656cc71e6872e8bb6e6a4aa9de8aaecf0ee68688346cfb8af5343f1c302c"}
Sep 16 12:07:41.273516 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.273477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0101191-8da3-48e6-9fde-fbbe04e97afd","Type":"ContainerStarted","Data":"a62cb1f72a61682a658d4b81db9e149134676d1991f53b0a98472cd7bb9a7e36"}
Sep 16 12:07:41.273516 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.273499    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0101191-8da3-48e6-9fde-fbbe04e97afd","Type":"ContainerStarted","Data":"bd5aae464b2c1b110f5268c2289f65b160149e7009606c3236b62cd46bd3db7e"}
Sep 16 12:07:41.273638 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.273527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0101191-8da3-48e6-9fde-fbbe04e97afd","Type":"ContainerStarted","Data":"b7c443c442b03813976fd313f26ed7ec122b4f54ecde3d3a92c4fe8a4f40cef6"}
Sep 16 12:07:41.273638 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.273554    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0101191-8da3-48e6-9fde-fbbe04e97afd","Type":"ContainerStarted","Data":"0168b41393d6f864dd8b174434c8bb0ea471ae35a3e617f32a16709e91973a35"}
Sep 16 12:07:41.295134 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.295090    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9" podStartSLOduration=1.951423828 podStartE2EDuration="5.295076958s" totalImagesPullingTime="3.34365313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:41.294715916 +0000 UTC m=+417.737750782" watchObservedRunningTime="2026-09-16 12:07:41.295076958 +0000 UTC m=+417.738111819"
Sep 16 12:07:41.323064 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:41.323024    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8000423 podStartE2EDuration="7.323009949s" totalImagesPullingTime="4.508815164s" totalInitContainerRuntime="14.152485ms" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:41.321348021 +0000 UTC m=+417.764382879" watchObservedRunningTime="2026-09-16 12:07:41.323009949 +0000 UTC m=+417.766044811"
Sep 16 12:07:47.283791 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:07:47.283766    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b56d4fb4b-r6rr9"
Sep 16 12:08:58.133482 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.133448    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d9559f744-crh2g"]
Sep 16 12:08:58.136926 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.136908    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.139638 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.139612    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 16 12:08:58.139638 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.139625    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 16 12:08:58.139883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.139654    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 16 12:08:58.139883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.139714    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 16 12:08:58.140025 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.140011    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 16 12:08:58.140061 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.140013    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6r649\""
Sep 16 12:08:58.145134 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.145115    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 16 12:08:58.150725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.150691    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d9559f744-crh2g"]
Sep 16 12:08:58.254199 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.254178    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-telemeter-client-tls\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.254293 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.254204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfcmw\" (UniqueName: \"kubernetes.io/projected/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-kube-api-access-pfcmw\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.254293 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.254232    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-secret-telemeter-client\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.254293 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.254259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.254293 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.254279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.254425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.254295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-metrics-client-ca\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.254425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.254312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-federate-client-tls\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.254425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.254339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-serving-certs-ca-bundle\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.355498 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.355476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-telemeter-client-tls\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.355570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.355503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfcmw\" (UniqueName: \"kubernetes.io/projected/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-kube-api-access-pfcmw\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.355570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.355533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-secret-telemeter-client\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.355658 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.355641    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.355713 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.355678    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.355769 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.355726    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-metrics-client-ca\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.355824 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.355766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-federate-client-tls\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.355824 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.355794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-serving-certs-ca-bundle\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.356430 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.356402    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-metrics-client-ca\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.356583 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.356442    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-serving-certs-ca-bundle\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.356687 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.356666    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.358137 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.358111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.358235 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.358195    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-secret-telemeter-client\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.358425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.358405    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-telemeter-client-tls\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.358482 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.358408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-federate-client-tls\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.364928 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.364904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfcmw\" (UniqueName: \"kubernetes.io/projected/ef83a61d-d9f0-4497-9171-b63b3e64ccbd-kube-api-access-pfcmw\") pod \"telemeter-client-6d9559f744-crh2g\" (UID: \"ef83a61d-d9f0-4497-9171-b63b3e64ccbd\") " pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.446272 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.446253    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g"
Sep 16 12:08:58.720806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:58.720772    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d9559f744-crh2g"]
Sep 16 12:08:58.723336 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:08:58.723305    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef83a61d_d9f0_4497_9171_b63b3e64ccbd.slice/crio-83302f00c54f8d1f2249fb239726e475c79131078befa718f619de56c2e8a46a WatchSource:0}: Error finding container 83302f00c54f8d1f2249fb239726e475c79131078befa718f619de56c2e8a46a: Status 404 returned error can't find the container with id 83302f00c54f8d1f2249fb239726e475c79131078befa718f619de56c2e8a46a
Sep 16 12:08:59.524252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:08:59.524209    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g" event={"ID":"ef83a61d-d9f0-4497-9171-b63b3e64ccbd","Type":"ContainerStarted","Data":"83302f00c54f8d1f2249fb239726e475c79131078befa718f619de56c2e8a46a"}
Sep 16 12:09:01.534079 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:09:01.534042    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g" event={"ID":"ef83a61d-d9f0-4497-9171-b63b3e64ccbd","Type":"ContainerStarted","Data":"7686a3cc36001efe221e4e4ecaa1b53cffd257b8638f24958fb51791b14f9317"}
Sep 16 12:09:01.534437 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:09:01.534101    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g" event={"ID":"ef83a61d-d9f0-4497-9171-b63b3e64ccbd","Type":"ContainerStarted","Data":"d7f7beb78b4a1b88d376bf41d8c443a7fe12c8245e2cf9a884078bd9b7b70837"}
Sep 16 12:09:01.534437 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:09:01.534124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g" event={"ID":"ef83a61d-d9f0-4497-9171-b63b3e64ccbd","Type":"ContainerStarted","Data":"3f1bfb277a2d9e085cb0ca5cfab2207739cda79e68a83e9a64b369fb8362c44c"}
Sep 16 12:09:01.559244 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:09:01.559199    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d9559f744-crh2g" podStartSLOduration=1.693285551 podStartE2EDuration="3.559184832s" totalImagesPullingTime="1.865899281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:09:01.558485732 +0000 UTC m=+498.001520595" watchObservedRunningTime="2026-09-16 12:09:01.559184832 +0000 UTC m=+498.002219694"
Sep 16 12:11:21.182525 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.182495    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"]
Sep 16 12:11:21.184798 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.184782    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"
Sep 16 12:11:21.187351 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.187331    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:11:21.187351 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.187348    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2b9dj\""
Sep 16 12:11:21.188462 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.188446    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 12:11:21.194911 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.194889    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"]
Sep 16 12:11:21.275939 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.275917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42be28c3-9be4-4ee9-a80d-5f63d5f61e6e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-shj6z\" (UID: \"42be28c3-9be4-4ee9-a80d-5f63d5f61e6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"
Sep 16 12:11:21.276042 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.275964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chwm6\" (UniqueName: \"kubernetes.io/projected/42be28c3-9be4-4ee9-a80d-5f63d5f61e6e-kube-api-access-chwm6\") pod \"openshift-lws-operator-fd8ccff4c-shj6z\" (UID: \"42be28c3-9be4-4ee9-a80d-5f63d5f61e6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"
Sep 16 12:11:21.376569 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.376536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42be28c3-9be4-4ee9-a80d-5f63d5f61e6e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-shj6z\" (UID: \"42be28c3-9be4-4ee9-a80d-5f63d5f61e6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"
Sep 16 12:11:21.376660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.376589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chwm6\" (UniqueName: \"kubernetes.io/projected/42be28c3-9be4-4ee9-a80d-5f63d5f61e6e-kube-api-access-chwm6\") pod \"openshift-lws-operator-fd8ccff4c-shj6z\" (UID: \"42be28c3-9be4-4ee9-a80d-5f63d5f61e6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"
Sep 16 12:11:21.376893 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.376877    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42be28c3-9be4-4ee9-a80d-5f63d5f61e6e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-shj6z\" (UID: \"42be28c3-9be4-4ee9-a80d-5f63d5f61e6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"
Sep 16 12:11:21.383913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.383895    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chwm6\" (UniqueName: \"kubernetes.io/projected/42be28c3-9be4-4ee9-a80d-5f63d5f61e6e-kube-api-access-chwm6\") pod \"openshift-lws-operator-fd8ccff4c-shj6z\" (UID: \"42be28c3-9be4-4ee9-a80d-5f63d5f61e6e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"
Sep 16 12:11:21.493042 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.492989    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"
Sep 16 12:11:21.758083 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.758061    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z"]
Sep 16 12:11:21.760476 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:11:21.760456    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42be28c3_9be4_4ee9_a80d_5f63d5f61e6e.slice/crio-7ba856575deb7160ae6a3d943c9b75f48427752d344c82db04a7b003ecd9b6e2 WatchSource:0}: Error finding container 7ba856575deb7160ae6a3d943c9b75f48427752d344c82db04a7b003ecd9b6e2: Status 404 returned error can't find the container with id 7ba856575deb7160ae6a3d943c9b75f48427752d344c82db04a7b003ecd9b6e2
Sep 16 12:11:21.994067 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:21.994038    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z" event={"ID":"42be28c3-9be4-4ee9-a80d-5f63d5f61e6e","Type":"ContainerStarted","Data":"7ba856575deb7160ae6a3d943c9b75f48427752d344c82db04a7b003ecd9b6e2"}
Sep 16 12:11:25.009848 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:25.009809    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z" event={"ID":"42be28c3-9be4-4ee9-a80d-5f63d5f61e6e","Type":"ContainerStarted","Data":"2c93420801a6e98c50242da130a66022351b4029225b70903d3077f65808f7b9"}
Sep 16 12:11:25.027598 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:25.027553    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-shj6z" podStartSLOduration=1.71242034 podStartE2EDuration="4.027539026s" totalImagesPullingTime="2.315118686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:11:25.025266626 +0000 UTC m=+641.468301487" watchObservedRunningTime="2026-09-16 12:11:25.027539026 +0000 UTC m=+641.470573888"
Sep 16 12:11:44.182759 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.182731    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"]
Sep 16 12:11:44.184862 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.184846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.187407 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.187385    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lcl5n\""
Sep 16 12:11:44.187537 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.187436    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 12:11:44.187537 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.187470    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 12:11:44.187537 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.187503    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 12:11:44.187718 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.187582    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 12:11:44.205252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.205226    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"]
Sep 16 12:11:44.322419 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.322389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68556de2-054e-4109-8506-59efb95b2a39-webhook-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.322550 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.322438    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68556de2-054e-4109-8506-59efb95b2a39-tmp\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.322550 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.322503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st9lr\" (UniqueName: \"kubernetes.io/projected/68556de2-054e-4109-8506-59efb95b2a39-kube-api-access-st9lr\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.322669 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.322569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68556de2-054e-4109-8506-59efb95b2a39-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.322669 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.322614    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68556de2-054e-4109-8506-59efb95b2a39-manifests\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.423371 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.423346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68556de2-054e-4109-8506-59efb95b2a39-manifests\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.423486 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.423377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68556de2-054e-4109-8506-59efb95b2a39-webhook-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.423486 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.423402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68556de2-054e-4109-8506-59efb95b2a39-tmp\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.423486 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.423427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st9lr\" (UniqueName: \"kubernetes.io/projected/68556de2-054e-4109-8506-59efb95b2a39-kube-api-access-st9lr\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.423486 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.423454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68556de2-054e-4109-8506-59efb95b2a39-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.423806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.423781    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68556de2-054e-4109-8506-59efb95b2a39-manifests\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.425565 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.425542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68556de2-054e-4109-8506-59efb95b2a39-tmp\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.425790 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.425772    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68556de2-054e-4109-8506-59efb95b2a39-webhook-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.425946 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.425923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68556de2-054e-4109-8506-59efb95b2a39-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.440495 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.440443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st9lr\" (UniqueName: \"kubernetes.io/projected/68556de2-054e-4109-8506-59efb95b2a39-kube-api-access-st9lr\") pod \"opendatahub-operator-controller-manager-7887d7f7b8-7cr4f\" (UID: \"68556de2-054e-4109-8506-59efb95b2a39\") " pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.494727 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.494684    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:44.771235 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:44.771210    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"]
Sep 16 12:11:44.773323 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:11:44.773298    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68556de2_054e_4109_8506_59efb95b2a39.slice/crio-516430c908a3b9915a8412ed6a1a69c08a641b394a40b075b6f1e469ca38751e WatchSource:0}: Error finding container 516430c908a3b9915a8412ed6a1a69c08a641b394a40b075b6f1e469ca38751e: Status 404 returned error can't find the container with id 516430c908a3b9915a8412ed6a1a69c08a641b394a40b075b6f1e469ca38751e
Sep 16 12:11:45.080705 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:45.080630    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f" event={"ID":"68556de2-054e-4109-8506-59efb95b2a39","Type":"ContainerStarted","Data":"516430c908a3b9915a8412ed6a1a69c08a641b394a40b075b6f1e469ca38751e"}
Sep 16 12:11:50.102398 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:50.102358    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f" event={"ID":"68556de2-054e-4109-8506-59efb95b2a39","Type":"ContainerStarted","Data":"ce308130e4a6f0f40c0f98befa329e5145b886309a7ddebc5be17b2fac12d242"}
Sep 16 12:11:51.107513 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:51.107483    2559 generic.go:356] "Generic (PLEG): container finished" podID="68556de2-054e-4109-8506-59efb95b2a39" containerID="ce308130e4a6f0f40c0f98befa329e5145b886309a7ddebc5be17b2fac12d242" exitCode=0
Sep 16 12:11:51.107797 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:51.107569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f" event={"ID":"68556de2-054e-4109-8506-59efb95b2a39","Type":"ContainerDied","Data":"ce308130e4a6f0f40c0f98befa329e5145b886309a7ddebc5be17b2fac12d242"}
Sep 16 12:11:52.113803 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:52.113720    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f" event={"ID":"68556de2-054e-4109-8506-59efb95b2a39","Type":"ContainerStarted","Data":"4ec508835c6f75b5fef57155fd819f3f436f07be5c5e2a6b26011850351dae49"}
Sep 16 12:11:52.114161 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:52.113830    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:11:52.136155 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:11:52.136106    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f" podStartSLOduration=1.337506327 podStartE2EDuration="8.136091821s" totalImagesPullingTime="5.778291348s" totalInitContainerRuntime="1.020294146s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:11:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:11:52.134081314 +0000 UTC m=+668.577116175" watchObservedRunningTime="2026-09-16 12:11:52.136091821 +0000 UTC m=+668.579126682"
Sep 16 12:12:03.119346 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:03.119316    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7887d7f7b8-7cr4f"
Sep 16 12:12:04.996265 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:04.996227    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"]
Sep 16 12:12:05.003502 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.003484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.006298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.006269    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 12:12:05.006411 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.006274    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 12:12:05.006411 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.006295    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gdwph\""
Sep 16 12:12:05.006411 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.006297    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 12:12:05.009084 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.009063    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 12:12:05.011056 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.011035    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"]
Sep 16 12:12:05.165256 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.165232    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8699r\" (UniqueName: \"kubernetes.io/projected/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-kube-api-access-8699r\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.165359 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.165276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-tmp\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.165359 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.165324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-tls-certs\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.265940 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.265892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8699r\" (UniqueName: \"kubernetes.io/projected/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-kube-api-access-8699r\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.265940 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.265927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-tmp\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.266072 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.265953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-tls-certs\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.266072 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:12:05.266038    2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 16 12:12:05.266147 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:12:05.266092    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-tls-certs podName:e4f65658-6be0-43dd-a1e1-1cdc902ad16b nodeName:}" failed. No retries permitted until 2026-09-16 12:12:05.766077828 +0000 UTC m=+682.209112681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-tls-certs") pod "kube-auth-proxy-55f6c77cbf-cxxmq" (UID: "e4f65658-6be0-43dd-a1e1-1cdc902ad16b") : secret "kube-auth-proxy-tls" not found
Sep 16 12:12:05.267988 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.267968    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-tmp\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.277222 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.277199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8699r\" (UniqueName: \"kubernetes.io/projected/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-kube-api-access-8699r\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.769483 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.769451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-tls-certs\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.771540 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.771522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4f65658-6be0-43dd-a1e1-1cdc902ad16b-tls-certs\") pod \"kube-auth-proxy-55f6c77cbf-cxxmq\" (UID: \"e4f65658-6be0-43dd-a1e1-1cdc902ad16b\") " pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:05.913146 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:05.913122    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"
Sep 16 12:12:06.187207 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:06.187181    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq"]
Sep 16 12:12:06.189459 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:12:06.189434    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f65658_6be0_43dd_a1e1_1cdc902ad16b.slice/crio-c76dc17d5dc14a2eb7ec34ce6b0c5ab99123bea9c5519daae1b9f165fbb0d2eb WatchSource:0}: Error finding container c76dc17d5dc14a2eb7ec34ce6b0c5ab99123bea9c5519daae1b9f165fbb0d2eb: Status 404 returned error can't find the container with id c76dc17d5dc14a2eb7ec34ce6b0c5ab99123bea9c5519daae1b9f165fbb0d2eb
Sep 16 12:12:06.191117 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:06.191102    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:12:07.168717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:07.168645    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq" event={"ID":"e4f65658-6be0-43dd-a1e1-1cdc902ad16b","Type":"ContainerStarted","Data":"c76dc17d5dc14a2eb7ec34ce6b0c5ab99123bea9c5519daae1b9f165fbb0d2eb"}
Sep 16 12:12:10.183457 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:10.183422    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq" event={"ID":"e4f65658-6be0-43dd-a1e1-1cdc902ad16b","Type":"ContainerStarted","Data":"78c0fb24349dbd462179bc5a3b330bf6c1ad71c5ed3ac0e452b563656255fd54"}
Sep 16 12:12:10.199561 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:10.199514    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55f6c77cbf-cxxmq" podStartSLOduration=3.277561542 podStartE2EDuration="6.199497712s" totalImagesPullingTime="2.92193617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:10.198901854 +0000 UTC m=+686.641936726" watchObservedRunningTime="2026-09-16 12:12:10.199497712 +0000 UTC m=+686.642532576"
Sep 16 12:12:11.191030 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.190996    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"]
Sep 16 12:12:11.194494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.194474    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.197031 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.197007    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 12:12:11.197178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.197133    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lhtrk\""
Sep 16 12:12:11.209373 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.209351    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"]
Sep 16 12:12:11.308367 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.308342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.308495 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.308378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.308495 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.308407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m2ct\" (UniqueName: \"kubernetes.io/projected/223d930a-0800-461b-a3ba-3a4c2a828bcb-kube-api-access-4m2ct\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.308495 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.308471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.308642 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.308511    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.308642 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.308548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.308781 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.308655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.308781 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.308712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223d930a-0800-461b-a3ba-3a4c2a828bcb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.308887 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.308782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.409596 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.409571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.409730 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.409605    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.409730 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.409628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.409730 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.409662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.409730 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.409690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223d930a-0800-461b-a3ba-3a4c2a828bcb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.409943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.409738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.409943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.409768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.409943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.409793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.409943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.409822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m2ct\" (UniqueName: \"kubernetes.io/projected/223d930a-0800-461b-a3ba-3a4c2a828bcb-kube-api-access-4m2ct\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.410139 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.410046    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.410330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.410301    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.410450 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.410428    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.410498 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.410448    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223d930a-0800-461b-a3ba-3a4c2a828bcb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.410556 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.410536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.411780 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.411758    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.412102 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.412083    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.423428 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.423401    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223d930a-0800-461b-a3ba-3a4c2a828bcb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.423540 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.423513    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m2ct\" (UniqueName: \"kubernetes.io/projected/223d930a-0800-461b-a3ba-3a4c2a828bcb-kube-api-access-4m2ct\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5\" (UID: \"223d930a-0800-461b-a3ba-3a4c2a828bcb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.505870 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.505812    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:11.778306 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:11.778281    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"]
Sep 16 12:12:11.780951 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:12:11.780923    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223d930a_0800_461b_a3ba_3a4c2a828bcb.slice/crio-375385aee9c967cf8a0fc1f179de472454ef6246b57c2f51c809884dbc1fbcf0 WatchSource:0}: Error finding container 375385aee9c967cf8a0fc1f179de472454ef6246b57c2f51c809884dbc1fbcf0: Status 404 returned error can't find the container with id 375385aee9c967cf8a0fc1f179de472454ef6246b57c2f51c809884dbc1fbcf0
Sep 16 12:12:12.193213 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:12.193183    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5" event={"ID":"223d930a-0800-461b-a3ba-3a4c2a828bcb","Type":"ContainerStarted","Data":"375385aee9c967cf8a0fc1f179de472454ef6246b57c2f51c809884dbc1fbcf0"}
Sep 16 12:12:15.027503 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.027455    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:12:15.027811 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.027532    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:12:15.027811 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.027561    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:12:15.210765 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.210726    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5" event={"ID":"223d930a-0800-461b-a3ba-3a4c2a828bcb","Type":"ContainerStarted","Data":"90f818931fa909dc41a8daae9902b5d12f4a3cfe811448b5e72b63b32ed0da79"}
Sep 16 12:12:15.233070 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.233017    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5" podStartSLOduration=0.988780626 podStartE2EDuration="4.232997168s" totalImagesPullingTime="3.244216542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:15.229751777 +0000 UTC m=+691.672786640" watchObservedRunningTime="2026-09-16 12:12:15.232997168 +0000 UTC m=+691.676032031"
Sep 16 12:12:15.506073 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.506044    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:15.683780 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.683752    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dx4cg"]
Sep 16 12:12:15.687042 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.687027    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:15.689615 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.689595    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 16 12:12:15.689725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.689595    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hlscm\""
Sep 16 12:12:15.697233 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.697206    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dx4cg"]
Sep 16 12:12:15.844523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.844456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s82w8\" (UniqueName: \"kubernetes.io/projected/aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5-kube-api-access-s82w8\") pod \"odh-model-controller-7998c67dc4-dx4cg\" (UID: \"aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5\") " pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:15.844523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.844516    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5-cert\") pod \"odh-model-controller-7998c67dc4-dx4cg\" (UID: \"aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5\") " pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:15.945213 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.945187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s82w8\" (UniqueName: \"kubernetes.io/projected/aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5-kube-api-access-s82w8\") pod \"odh-model-controller-7998c67dc4-dx4cg\" (UID: \"aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5\") " pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:15.945329 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.945228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5-cert\") pod \"odh-model-controller-7998c67dc4-dx4cg\" (UID: \"aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5\") " pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:15.947465 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.947447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5-cert\") pod \"odh-model-controller-7998c67dc4-dx4cg\" (UID: \"aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5\") " pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:15.954975 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.954956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s82w8\" (UniqueName: \"kubernetes.io/projected/aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5-kube-api-access-s82w8\") pod \"odh-model-controller-7998c67dc4-dx4cg\" (UID: \"aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5\") " pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:15.997331 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:15.997311    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:16.203409 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.203380    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gkqsz"]
Sep 16 12:12:16.208056 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.208032    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:12:16.210779 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.210758    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 12:12:16.210891 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.210779    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-xlfpw\""
Sep 16 12:12:16.216727 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.216687    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gkqsz"]
Sep 16 12:12:16.266406 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.266382    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dx4cg"]
Sep 16 12:12:16.269147 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:12:16.269119    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8b3bc8_eb6d_4917_be3c_b9fe92bd65c5.slice/crio-9d1303e293f9d996643134466d218aa3dc9da0222e5cc8269bd7ce76160d00c4 WatchSource:0}: Error finding container 9d1303e293f9d996643134466d218aa3dc9da0222e5cc8269bd7ce76160d00c4: Status 404 returned error can't find the container with id 9d1303e293f9d996643134466d218aa3dc9da0222e5cc8269bd7ce76160d00c4
Sep 16 12:12:16.348895 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.348872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pznr\" (UniqueName: \"kubernetes.io/projected/90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a-kube-api-access-2pznr\") pod \"model-serving-api-54d89bd5fc-gkqsz\" (UID: \"90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:12:16.349001 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.348901    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a-tls-certs\") pod \"model-serving-api-54d89bd5fc-gkqsz\" (UID: \"90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:12:16.449371 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.449350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pznr\" (UniqueName: \"kubernetes.io/projected/90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a-kube-api-access-2pznr\") pod \"model-serving-api-54d89bd5fc-gkqsz\" (UID: \"90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:12:16.449467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.449377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a-tls-certs\") pod \"model-serving-api-54d89bd5fc-gkqsz\" (UID: \"90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:12:16.451669 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.451641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a-tls-certs\") pod \"model-serving-api-54d89bd5fc-gkqsz\" (UID: \"90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:12:16.461499 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.461447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pznr\" (UniqueName: \"kubernetes.io/projected/90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a-kube-api-access-2pznr\") pod \"model-serving-api-54d89bd5fc-gkqsz\" (UID: \"90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:12:16.509622 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.509603    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:16.519858 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.519839    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:12:16.798009 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:16.797986    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gkqsz"]
Sep 16 12:12:16.799538 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:12:16.799517    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ea22b4_a3b2_4d4c_90a2_b4ef3e4fd92a.slice/crio-3ed70d6106f7d04099c99ab4727c05d19216e0d74cf2bfb1a5e4a4a6e1565859 WatchSource:0}: Error finding container 3ed70d6106f7d04099c99ab4727c05d19216e0d74cf2bfb1a5e4a4a6e1565859: Status 404 returned error can't find the container with id 3ed70d6106f7d04099c99ab4727c05d19216e0d74cf2bfb1a5e4a4a6e1565859
Sep 16 12:12:17.220977 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:17.220945    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg" event={"ID":"aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5","Type":"ContainerStarted","Data":"9d1303e293f9d996643134466d218aa3dc9da0222e5cc8269bd7ce76160d00c4"}
Sep 16 12:12:17.222089 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:17.222059    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz" event={"ID":"90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a","Type":"ContainerStarted","Data":"3ed70d6106f7d04099c99ab4727c05d19216e0d74cf2bfb1a5e4a4a6e1565859"}
Sep 16 12:12:17.222264 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:17.222249    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:17.223175 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:17.223155    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5"
Sep 16 12:12:20.238270 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:20.238236    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg" event={"ID":"aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5","Type":"ContainerStarted","Data":"687610a84160b44afc5b8d676dafefe9222185cbcce97aea9266b5902d9b7089"}
Sep 16 12:12:20.238744 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:20.238324    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:20.239858 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:20.239834    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz" event={"ID":"90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a","Type":"ContainerStarted","Data":"d2784f6860419ccf3b7657f008dd7149c134388548a9e5d987b1264d4e711748"}
Sep 16 12:12:20.239996 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:20.239979    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:12:20.254741 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:20.254703    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg" podStartSLOduration=2.027475707 podStartE2EDuration="5.254677222s" totalImagesPullingTime="3.227201515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:20.253450158 +0000 UTC m=+696.696485021" watchObservedRunningTime="2026-09-16 12:12:20.254677222 +0000 UTC m=+696.697712088"
Sep 16 12:12:20.269282 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:20.269237    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz" podStartSLOduration=1.575547318 podStartE2EDuration="4.269224589s" totalImagesPullingTime="2.693677271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:20.267901491 +0000 UTC m=+696.710936356" watchObservedRunningTime="2026-09-16 12:12:20.269224589 +0000 UTC m=+696.712259479"
Sep 16 12:12:22.242730 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.242679    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"]
Sep 16 12:12:22.247849 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.247830    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.250785 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.250756    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 12:12:22.250904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.250760    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 12:12:22.250904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.250804    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 12:12:22.250904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.250884    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kckwh\""
Sep 16 12:12:22.262906 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.262886    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"]
Sep 16 12:12:22.293115 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.293090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c22793d-308a-4fb9-93bc-ab604facde70-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.293216 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.293120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c22793d-308a-4fb9-93bc-ab604facde70-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.293216 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.293141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c22793d-308a-4fb9-93bc-ab604facde70-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.293216 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.293164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2b7m\" (UniqueName: \"kubernetes.io/projected/7c22793d-308a-4fb9-93bc-ab604facde70-kube-api-access-t2b7m\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.293326 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.293215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c22793d-308a-4fb9-93bc-ab604facde70-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.293326 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.293258    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c22793d-308a-4fb9-93bc-ab604facde70-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.293326 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.293297    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c22793d-308a-4fb9-93bc-ab604facde70-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.393847 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.393822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c22793d-308a-4fb9-93bc-ab604facde70-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.393979 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.393861    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2b7m\" (UniqueName: \"kubernetes.io/projected/7c22793d-308a-4fb9-93bc-ab604facde70-kube-api-access-t2b7m\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.393979 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.393883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c22793d-308a-4fb9-93bc-ab604facde70-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.393979 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.393919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c22793d-308a-4fb9-93bc-ab604facde70-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.393979 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.393963    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c22793d-308a-4fb9-93bc-ab604facde70-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.394192 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.393994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c22793d-308a-4fb9-93bc-ab604facde70-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.394192 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.394180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c22793d-308a-4fb9-93bc-ab604facde70-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.394676 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.394649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c22793d-308a-4fb9-93bc-ab604facde70-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.396521 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.396499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c22793d-308a-4fb9-93bc-ab604facde70-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.396601 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.396517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c22793d-308a-4fb9-93bc-ab604facde70-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.396678 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.396661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c22793d-308a-4fb9-93bc-ab604facde70-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.396866 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.396849    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c22793d-308a-4fb9-93bc-ab604facde70-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.401865 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.401841    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2b7m\" (UniqueName: \"kubernetes.io/projected/7c22793d-308a-4fb9-93bc-ab604facde70-kube-api-access-t2b7m\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.403151 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.403113    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c22793d-308a-4fb9-93bc-ab604facde70-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-27zlr\" (UID: \"7c22793d-308a-4fb9-93bc-ab604facde70\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.557182 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.557114    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:22.834034 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:22.833964    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"]
Sep 16 12:12:22.834350 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:12:22.834319    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c22793d_308a_4fb9_93bc_ab604facde70.slice/crio-fcd8078d52ded349a319be1c96d568b2772b7a1d79033ea3262309d780be9480 WatchSource:0}: Error finding container fcd8078d52ded349a319be1c96d568b2772b7a1d79033ea3262309d780be9480: Status 404 returned error can't find the container with id fcd8078d52ded349a319be1c96d568b2772b7a1d79033ea3262309d780be9480
Sep 16 12:12:23.253402 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:23.253371    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr" event={"ID":"7c22793d-308a-4fb9-93bc-ab604facde70","Type":"ContainerStarted","Data":"fcd8078d52ded349a319be1c96d568b2772b7a1d79033ea3262309d780be9480"}
Sep 16 12:12:25.075224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.075188    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"]
Sep 16 12:12:25.086580 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.086556    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"]
Sep 16 12:12:25.086734 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.086690    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:25.090672 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.090570    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:25.092072 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.091654    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-q9d8l\""
Sep 16 12:12:25.092072 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.091897    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 16 12:12:25.093108 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.093088    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"]
Sep 16 12:12:25.093217 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.093104    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 16 12:12:25.093348 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.093330    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fhdvj\""
Sep 16 12:12:25.099964 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.099872    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"]
Sep 16 12:12:25.117507 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.117481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce1b1b76-2e26-4047-87e9-30086a1d8c92-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cmznm\" (UID: \"ce1b1b76-2e26-4047-87e9-30086a1d8c92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:25.117610 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.117566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgqr4\" (UniqueName: \"kubernetes.io/projected/b58696b7-dacb-4593-af41-21fe936eefbf-kube-api-access-tgqr4\") pod \"kserve-controller-manager-d6f4b65b8-rn7nl\" (UID: \"b58696b7-dacb-4593-af41-21fe936eefbf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:25.117610 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.117593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hngzj\" (UniqueName: \"kubernetes.io/projected/ce1b1b76-2e26-4047-87e9-30086a1d8c92-kube-api-access-hngzj\") pod \"llmisvc-controller-manager-777c6bd7d5-cmznm\" (UID: \"ce1b1b76-2e26-4047-87e9-30086a1d8c92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:25.117752 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.117628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58696b7-dacb-4593-af41-21fe936eefbf-cert\") pod \"kserve-controller-manager-d6f4b65b8-rn7nl\" (UID: \"b58696b7-dacb-4593-af41-21fe936eefbf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:25.218260 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.218192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce1b1b76-2e26-4047-87e9-30086a1d8c92-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cmznm\" (UID: \"ce1b1b76-2e26-4047-87e9-30086a1d8c92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:25.218260 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.218248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgqr4\" (UniqueName: \"kubernetes.io/projected/b58696b7-dacb-4593-af41-21fe936eefbf-kube-api-access-tgqr4\") pod \"kserve-controller-manager-d6f4b65b8-rn7nl\" (UID: \"b58696b7-dacb-4593-af41-21fe936eefbf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:25.218373 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.218274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hngzj\" (UniqueName: \"kubernetes.io/projected/ce1b1b76-2e26-4047-87e9-30086a1d8c92-kube-api-access-hngzj\") pod \"llmisvc-controller-manager-777c6bd7d5-cmznm\" (UID: \"ce1b1b76-2e26-4047-87e9-30086a1d8c92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:25.218373 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.218305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58696b7-dacb-4593-af41-21fe936eefbf-cert\") pod \"kserve-controller-manager-d6f4b65b8-rn7nl\" (UID: \"b58696b7-dacb-4593-af41-21fe936eefbf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:25.218373 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:12:25.218328    2559 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 16 12:12:25.218526 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:12:25.218387    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce1b1b76-2e26-4047-87e9-30086a1d8c92-cert podName:ce1b1b76-2e26-4047-87e9-30086a1d8c92 nodeName:}" failed. No retries permitted until 2026-09-16 12:12:25.718367344 +0000 UTC m=+702.161402201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ce1b1b76-2e26-4047-87e9-30086a1d8c92-cert") pod "llmisvc-controller-manager-777c6bd7d5-cmznm" (UID: "ce1b1b76-2e26-4047-87e9-30086a1d8c92") : secret "llmisvc-webhook-server-cert" not found
Sep 16 12:12:25.218526 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:12:25.218434    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 16 12:12:25.218526 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:12:25.218483    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58696b7-dacb-4593-af41-21fe936eefbf-cert podName:b58696b7-dacb-4593-af41-21fe936eefbf nodeName:}" failed. No retries permitted until 2026-09-16 12:12:25.718466819 +0000 UTC m=+702.161501662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b58696b7-dacb-4593-af41-21fe936eefbf-cert") pod "kserve-controller-manager-d6f4b65b8-rn7nl" (UID: "b58696b7-dacb-4593-af41-21fe936eefbf") : secret "kserve-webhook-server-cert" not found
Sep 16 12:12:25.219681 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.219644    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:12:25.219813 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.219734    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:12:25.230784 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.230760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hngzj\" (UniqueName: \"kubernetes.io/projected/ce1b1b76-2e26-4047-87e9-30086a1d8c92-kube-api-access-hngzj\") pod \"llmisvc-controller-manager-777c6bd7d5-cmznm\" (UID: \"ce1b1b76-2e26-4047-87e9-30086a1d8c92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:25.230896 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.230828    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgqr4\" (UniqueName: \"kubernetes.io/projected/b58696b7-dacb-4593-af41-21fe936eefbf-kube-api-access-tgqr4\") pod \"kserve-controller-manager-d6f4b65b8-rn7nl\" (UID: \"b58696b7-dacb-4593-af41-21fe936eefbf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:25.722303 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.722272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce1b1b76-2e26-4047-87e9-30086a1d8c92-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cmznm\" (UID: \"ce1b1b76-2e26-4047-87e9-30086a1d8c92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:25.722468 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.722317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58696b7-dacb-4593-af41-21fe936eefbf-cert\") pod \"kserve-controller-manager-d6f4b65b8-rn7nl\" (UID: \"b58696b7-dacb-4593-af41-21fe936eefbf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:25.722468 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:12:25.722403    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 16 12:12:25.722468 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:12:25.722458    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58696b7-dacb-4593-af41-21fe936eefbf-cert podName:b58696b7-dacb-4593-af41-21fe936eefbf nodeName:}" failed. No retries permitted until 2026-09-16 12:12:26.722443709 +0000 UTC m=+703.165478549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b58696b7-dacb-4593-af41-21fe936eefbf-cert") pod "kserve-controller-manager-d6f4b65b8-rn7nl" (UID: "b58696b7-dacb-4593-af41-21fe936eefbf") : secret "kserve-webhook-server-cert" not found
Sep 16 12:12:25.724981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:25.724955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce1b1b76-2e26-4047-87e9-30086a1d8c92-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cmznm\" (UID: \"ce1b1b76-2e26-4047-87e9-30086a1d8c92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:26.017879 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:26.017798    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:26.268506 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:26.268422    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr" event={"ID":"7c22793d-308a-4fb9-93bc-ab604facde70","Type":"ContainerStarted","Data":"f4e015fe06395b0586eef3a264f65ac1524e6aa7e909b0ecaf985acd310ea9be"}
Sep 16 12:12:26.268952 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:26.268555    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:26.270084 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:26.270062    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr"
Sep 16 12:12:26.297915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:26.297896    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"]
Sep 16 12:12:26.300001 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:12:26.299979    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podce1b1b76_2e26_4047_87e9_30086a1d8c92.slice/crio-a150d026edaa8f3f3501a34680b00f3dee2c4707facce50cd742331ac7cb7859 WatchSource:0}: Error finding container a150d026edaa8f3f3501a34680b00f3dee2c4707facce50cd742331ac7cb7859: Status 404 returned error can't find the container with id a150d026edaa8f3f3501a34680b00f3dee2c4707facce50cd742331ac7cb7859
Sep 16 12:12:26.308853 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:26.308816    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-27zlr" podStartSLOduration=1.9258702140000001 podStartE2EDuration="4.308802993s" totalImagesPullingTime="2.382932779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:26.306610198 +0000 UTC m=+702.749645060" watchObservedRunningTime="2026-09-16 12:12:26.308802993 +0000 UTC m=+702.751837856"
Sep 16 12:12:26.731307 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:26.731278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58696b7-dacb-4593-af41-21fe936eefbf-cert\") pod \"kserve-controller-manager-d6f4b65b8-rn7nl\" (UID: \"b58696b7-dacb-4593-af41-21fe936eefbf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:26.733617 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:26.733598    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58696b7-dacb-4593-af41-21fe936eefbf-cert\") pod \"kserve-controller-manager-d6f4b65b8-rn7nl\" (UID: \"b58696b7-dacb-4593-af41-21fe936eefbf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:26.909806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:26.909782    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:27.260964 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:27.260936    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"]
Sep 16 12:12:27.264780 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:12:27.264721    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58696b7_dacb_4593_af41_21fe936eefbf.slice/crio-d3c9b085366b19454c8069aab1ca077163fb66faadee960c1b46983515f287df WatchSource:0}: Error finding container d3c9b085366b19454c8069aab1ca077163fb66faadee960c1b46983515f287df: Status 404 returned error can't find the container with id d3c9b085366b19454c8069aab1ca077163fb66faadee960c1b46983515f287df
Sep 16 12:12:27.280942 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:27.280882    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl" event={"ID":"b58696b7-dacb-4593-af41-21fe936eefbf","Type":"ContainerStarted","Data":"d3c9b085366b19454c8069aab1ca077163fb66faadee960c1b46983515f287df"}
Sep 16 12:12:27.282380 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:27.282355    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm" event={"ID":"ce1b1b76-2e26-4047-87e9-30086a1d8c92","Type":"ContainerStarted","Data":"a150d026edaa8f3f3501a34680b00f3dee2c4707facce50cd742331ac7cb7859"}
Sep 16 12:12:30.297835 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:30.297793    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl" event={"ID":"b58696b7-dacb-4593-af41-21fe936eefbf","Type":"ContainerStarted","Data":"407499b5c37620ea6e1ae933eee1164ad17bbb9c668df96aecea54834d2edc48"}
Sep 16 12:12:30.298254 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:30.297865    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:12:30.299347 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:30.299319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm" event={"ID":"ce1b1b76-2e26-4047-87e9-30086a1d8c92","Type":"ContainerStarted","Data":"979f2568307cef37f986331422b94b9f030270a6f2557882e8f11bcb8f2056fb"}
Sep 16 12:12:30.299448 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:30.299404    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:12:30.315212 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:30.315166    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl" podStartSLOduration=2.864568756 podStartE2EDuration="5.315152231s" totalImagesPullingTime="2.450583475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:30.313907097 +0000 UTC m=+706.756941959" watchObservedRunningTime="2026-09-16 12:12:30.315152231 +0000 UTC m=+706.758187093"
Sep 16 12:12:30.330789 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:30.330749    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm" podStartSLOduration=1.917830093 podStartE2EDuration="5.330735723s" totalImagesPullingTime="3.41290563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:30.329338118 +0000 UTC m=+706.772372983" watchObservedRunningTime="2026-09-16 12:12:30.330735723 +0000 UTC m=+706.773770587"
Sep 16 12:12:31.246731 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:31.246687    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dx4cg"
Sep 16 12:12:31.249367 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:12:31.249343    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gkqsz"
Sep 16 12:13:01.305618 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:01.305538    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmznm"
Sep 16 12:13:01.310740 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:01.309216    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rn7nl"
Sep 16 12:13:57.321486 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.321453    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"]
Sep 16 12:13:57.324664 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.324642    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:13:57.327557 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.327537    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 12:13:57.327662 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.327539    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 12:13:57.327662 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.327539    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mpnm2\""
Sep 16 12:13:57.335593 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.335573    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"]
Sep 16 12:13:57.368947 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.368921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz2gw\" (UniqueName: \"kubernetes.io/projected/11062334-6509-4d71-9130-f8cd066d6cca-kube-api-access-hz2gw\") pod \"kuadrant-operator-controller-manager-5f685c496f-bqpsr\" (UID: \"11062334-6509-4d71-9130-f8cd066d6cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:13:57.369055 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.368989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11062334-6509-4d71-9130-f8cd066d6cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-bqpsr\" (UID: \"11062334-6509-4d71-9130-f8cd066d6cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:13:57.422862 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.422835    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"]
Sep 16 12:13:57.423046 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:13:57.423025    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-hz2gw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr" podUID="11062334-6509-4d71-9130-f8cd066d6cca"
Sep 16 12:13:57.469528 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.469502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz2gw\" (UniqueName: \"kubernetes.io/projected/11062334-6509-4d71-9130-f8cd066d6cca-kube-api-access-hz2gw\") pod \"kuadrant-operator-controller-manager-5f685c496f-bqpsr\" (UID: \"11062334-6509-4d71-9130-f8cd066d6cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:13:57.469624 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.469550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11062334-6509-4d71-9130-f8cd066d6cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-bqpsr\" (UID: \"11062334-6509-4d71-9130-f8cd066d6cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:13:57.469849 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.469833    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11062334-6509-4d71-9130-f8cd066d6cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-bqpsr\" (UID: \"11062334-6509-4d71-9130-f8cd066d6cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:13:57.485455 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.485430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz2gw\" (UniqueName: \"kubernetes.io/projected/11062334-6509-4d71-9130-f8cd066d6cca-kube-api-access-hz2gw\") pod \"kuadrant-operator-controller-manager-5f685c496f-bqpsr\" (UID: \"11062334-6509-4d71-9130-f8cd066d6cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:13:57.654096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.654076    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:13:57.660566 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.660549    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:13:57.670671 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.670655    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz2gw\" (UniqueName: \"kubernetes.io/projected/11062334-6509-4d71-9130-f8cd066d6cca-kube-api-access-hz2gw\") pod \"11062334-6509-4d71-9130-f8cd066d6cca\" (UID: \"11062334-6509-4d71-9130-f8cd066d6cca\") "
Sep 16 12:13:57.670734 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.670722    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11062334-6509-4d71-9130-f8cd066d6cca-extensions-socket-volume\") pod \"11062334-6509-4d71-9130-f8cd066d6cca\" (UID: \"11062334-6509-4d71-9130-f8cd066d6cca\") "
Sep 16 12:13:57.670949 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.670929    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11062334-6509-4d71-9130-f8cd066d6cca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "11062334-6509-4d71-9130-f8cd066d6cca" (UID: "11062334-6509-4d71-9130-f8cd066d6cca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:13:57.672467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.672449    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11062334-6509-4d71-9130-f8cd066d6cca-kube-api-access-hz2gw" (OuterVolumeSpecName: "kube-api-access-hz2gw") pod "11062334-6509-4d71-9130-f8cd066d6cca" (UID: "11062334-6509-4d71-9130-f8cd066d6cca"). InnerVolumeSpecName "kube-api-access-hz2gw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:13:57.771099 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.771076    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11062334-6509-4d71-9130-f8cd066d6cca-extensions-socket-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:13:57.771099 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.771097    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz2gw\" (UniqueName: \"kubernetes.io/projected/11062334-6509-4d71-9130-f8cd066d6cca-kube-api-access-hz2gw\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:13:57.921689 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.921640    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"]
Sep 16 12:13:57.930464 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:57.930444    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"]
Sep 16 12:13:58.000162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.000133    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"]
Sep 16 12:13:58.006731 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.006685    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:13:58.030486 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.030461    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11062334-6509-4d71-9130-f8cd066d6cca" path="/var/lib/kubelet/pods/11062334-6509-4d71-9130-f8cd066d6cca/volumes"
Sep 16 12:13:58.036382 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.036210    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"]
Sep 16 12:13:58.072881 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.072852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck49n\" (UniqueName: \"kubernetes.io/projected/f68ebdb4-4aac-4c9b-946a-e45a9831e891-kube-api-access-ck49n\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n225s\" (UID: \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:13:58.072984 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.072886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f68ebdb4-4aac-4c9b-946a-e45a9831e891-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n225s\" (UID: \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:13:58.173359 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.173295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck49n\" (UniqueName: \"kubernetes.io/projected/f68ebdb4-4aac-4c9b-946a-e45a9831e891-kube-api-access-ck49n\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n225s\" (UID: \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:13:58.173359 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.173331    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f68ebdb4-4aac-4c9b-946a-e45a9831e891-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n225s\" (UID: \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:13:58.173721 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.173678    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f68ebdb4-4aac-4c9b-946a-e45a9831e891-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n225s\" (UID: \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:13:58.181934 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.181912    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck49n\" (UniqueName: \"kubernetes.io/projected/f68ebdb4-4aac-4c9b-946a-e45a9831e891-kube-api-access-ck49n\") pod \"kuadrant-operator-controller-manager-76f8f686bf-n225s\" (UID: \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:13:58.316927 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.316904    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:13:58.590841 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.590742    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"]
Sep 16 12:13:58.593836 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:13:58.593802    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68ebdb4_4aac_4c9b_946a_e45a9831e891.slice/crio-78763090e70e26dc77c45ab573147b5686f6a3a488ad02400c00e341f5fc88b2 WatchSource:0}: Error finding container 78763090e70e26dc77c45ab573147b5686f6a3a488ad02400c00e341f5fc88b2: Status 404 returned error can't find the container with id 78763090e70e26dc77c45ab573147b5686f6a3a488ad02400c00e341f5fc88b2
Sep 16 12:13:58.658890 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.658857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s" event={"ID":"f68ebdb4-4aac-4c9b-946a-e45a9831e891","Type":"ContainerStarted","Data":"78763090e70e26dc77c45ab573147b5686f6a3a488ad02400c00e341f5fc88b2"}
Sep 16 12:13:58.658980 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:13:58.658871    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-bqpsr"
Sep 16 12:14:02.679568 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:02.679534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s" event={"ID":"f68ebdb4-4aac-4c9b-946a-e45a9831e891","Type":"ContainerStarted","Data":"d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326"}
Sep 16 12:14:02.679971 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:02.679670    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:14:02.702727 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:02.702669    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s" podStartSLOduration=2.185287237 podStartE2EDuration="5.702656754s" totalImagesPullingTime="3.517369517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:02.700889019 +0000 UTC m=+799.143923895" watchObservedRunningTime="2026-09-16 12:14:02.702656754 +0000 UTC m=+799.145691616"
Sep 16 12:14:10.013047 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.012963    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"]
Sep 16 12:14:10.013467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.013256    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s" podUID="f68ebdb4-4aac-4c9b-946a-e45a9831e891" containerName="manager" containerID="cri-o://d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326" gracePeriod=10
Sep 16 12:14:10.015045 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.015016    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:14:10.248106 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.248085    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:14:10.262106 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.262087    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f68ebdb4-4aac-4c9b-946a-e45a9831e891-extensions-socket-volume\") pod \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\" (UID: \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\") "
Sep 16 12:14:10.262192 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.262156    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck49n\" (UniqueName: \"kubernetes.io/projected/f68ebdb4-4aac-4c9b-946a-e45a9831e891-kube-api-access-ck49n\") pod \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\" (UID: \"f68ebdb4-4aac-4c9b-946a-e45a9831e891\") "
Sep 16 12:14:10.262573 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.262552    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f68ebdb4-4aac-4c9b-946a-e45a9831e891-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f68ebdb4-4aac-4c9b-946a-e45a9831e891" (UID: "f68ebdb4-4aac-4c9b-946a-e45a9831e891"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:14:10.264127 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.264083    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f68ebdb4-4aac-4c9b-946a-e45a9831e891-kube-api-access-ck49n" (OuterVolumeSpecName: "kube-api-access-ck49n") pod "f68ebdb4-4aac-4c9b-946a-e45a9831e891" (UID: "f68ebdb4-4aac-4c9b-946a-e45a9831e891"). InnerVolumeSpecName "kube-api-access-ck49n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:14:10.355299 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.355273    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"]
Sep 16 12:14:10.355632 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.355620    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f68ebdb4-4aac-4c9b-946a-e45a9831e891" containerName="manager"
Sep 16 12:14:10.355674 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.355634    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f68ebdb4-4aac-4c9b-946a-e45a9831e891" containerName="manager"
Sep 16 12:14:10.355728 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.355704    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f68ebdb4-4aac-4c9b-946a-e45a9831e891" containerName="manager"
Sep 16 12:14:10.358513 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.358499    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:10.363346 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.363324    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck49n\" (UniqueName: \"kubernetes.io/projected/f68ebdb4-4aac-4c9b-946a-e45a9831e891-kube-api-access-ck49n\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:14:10.363444 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.363347    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f68ebdb4-4aac-4c9b-946a-e45a9831e891-extensions-socket-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:14:10.382955 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.382935    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"]
Sep 16 12:14:10.463914 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.463890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfmvq\" (UniqueName: \"kubernetes.io/projected/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-kube-api-access-rfmvq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4xfn7\" (UID: \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:10.464012 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.463929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4xfn7\" (UID: \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:10.565175 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.565123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfmvq\" (UniqueName: \"kubernetes.io/projected/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-kube-api-access-rfmvq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4xfn7\" (UID: \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:10.565175 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.565160    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4xfn7\" (UID: \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:10.565457 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.565443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4xfn7\" (UID: \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:10.579456 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.579430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfmvq\" (UniqueName: \"kubernetes.io/projected/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-kube-api-access-rfmvq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-4xfn7\" (UID: \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:10.668330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.668300    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:10.716523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.716369    2559 generic.go:356] "Generic (PLEG): container finished" podID="f68ebdb4-4aac-4c9b-946a-e45a9831e891" containerID="d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326" exitCode=0
Sep 16 12:14:10.716523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.716415    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"
Sep 16 12:14:10.716523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.716450    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s" event={"ID":"f68ebdb4-4aac-4c9b-946a-e45a9831e891","Type":"ContainerDied","Data":"d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326"}
Sep 16 12:14:10.716819 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.716530    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s" event={"ID":"f68ebdb4-4aac-4c9b-946a-e45a9831e891","Type":"ContainerDied","Data":"78763090e70e26dc77c45ab573147b5686f6a3a488ad02400c00e341f5fc88b2"}
Sep 16 12:14:10.716819 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.716567    2559 scope.go:117] "RemoveContainer" containerID="d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326"
Sep 16 12:14:10.729977 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.729954    2559 scope.go:117] "RemoveContainer" containerID="d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326"
Sep 16 12:14:10.730286 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:14:10.730266    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326\": container with ID starting with d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326 not found: ID does not exist" containerID="d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326"
Sep 16 12:14:10.730354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.730295    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326"} err="failed to get container status \"d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326\": rpc error: code = NotFound desc = could not find container \"d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326\": container with ID starting with d6f1095cdf7e36979bda423c0308ca8c7b55c43e376a3db6319f0b178bee4326 not found: ID does not exist"
Sep 16 12:14:10.753955 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.753934    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"]
Sep 16 12:14:10.762174 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.762154    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-n225s"]
Sep 16 12:14:10.981487 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:14:10.981461    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a47b05_bed1_4db9_a36c_9c1dcbc145e8.slice/crio-70d2bd23346745e7737e310954473cbdeab7d8e728664354deb4411a08f5fd9a WatchSource:0}: Error finding container 70d2bd23346745e7737e310954473cbdeab7d8e728664354deb4411a08f5fd9a: Status 404 returned error can't find the container with id 70d2bd23346745e7737e310954473cbdeab7d8e728664354deb4411a08f5fd9a
Sep 16 12:14:10.981799 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:10.981779    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"]
Sep 16 12:14:11.723945 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:11.723910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7" event={"ID":"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8","Type":"ContainerStarted","Data":"9ccf812aae52259c4d29086d156b4f54339034bb6c0fd269c3c2083a64d37b4f"}
Sep 16 12:14:11.724305 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:11.723967    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7" event={"ID":"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8","Type":"ContainerStarted","Data":"70d2bd23346745e7737e310954473cbdeab7d8e728664354deb4411a08f5fd9a"}
Sep 16 12:14:11.724305 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:11.723995    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:11.755195 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:11.755147    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7" podStartSLOduration=1.755132522 podStartE2EDuration="1.755132522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:11.753068471 +0000 UTC m=+808.196103345" watchObservedRunningTime="2026-09-16 12:14:11.755132522 +0000 UTC m=+808.198167384"
Sep 16 12:14:12.029824 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:12.029753    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f68ebdb4-4aac-4c9b-946a-e45a9831e891" path="/var/lib/kubelet/pods/f68ebdb4-4aac-4c9b-946a-e45a9831e891/volumes"
Sep 16 12:14:22.730057 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:22.730027    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:14:26.426393 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.426354    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"]
Sep 16 12:14:26.429949 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.429926    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.434621 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.434599    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5rkj9\""
Sep 16 12:14:26.448834 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.448785    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"]
Sep 16 12:14:26.483902 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.483881    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.484014 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.483926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.484014 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.483959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.484126 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.484025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.484126 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.484054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.484126 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.484076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.484126 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.484102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.484248 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.484140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.484248 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.484175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npkjd\" (UniqueName: \"kubernetes.io/projected/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-kube-api-access-npkjd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.584850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.584818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npkjd\" (UniqueName: \"kubernetes.io/projected/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-kube-api-access-npkjd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.584989 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.584870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.584989 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.584914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.584989 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.584936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.584989 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.584974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.586261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.585500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.586261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.585565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.586261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.585588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.586261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.585598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.586261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.585689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.586261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.585879    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.586261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.586013    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.586261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.586036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.592727 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.587968    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.592727 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.589047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.593139 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.593119    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.595408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.595382    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npkjd\" (UniqueName: \"kubernetes.io/projected/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-kube-api-access-npkjd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.595821 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.595801    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29fb0007-a1a1-4f0c-85c3-14ef2b52072d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rdjfk\" (UID: \"29fb0007-a1a1-4f0c-85c3-14ef2b52072d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:26.740261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:26.740204    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:27.032010 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:27.031944    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"]
Sep 16 12:14:27.038401 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:14:27.038373    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29fb0007_a1a1_4f0c_85c3_14ef2b52072d.slice/crio-f9c97f424bbb7a8792676425f6f6e7a0fb8d4145c0c779c50534f0a5ab06dfd3 WatchSource:0}: Error finding container f9c97f424bbb7a8792676425f6f6e7a0fb8d4145c0c779c50534f0a5ab06dfd3: Status 404 returned error can't find the container with id f9c97f424bbb7a8792676425f6f6e7a0fb8d4145c0c779c50534f0a5ab06dfd3
Sep 16 12:14:27.040648 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:27.040610    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:14:27.040765 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:27.040742    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:14:27.040810 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:27.040793    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:14:27.800638 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:27.800602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" event={"ID":"29fb0007-a1a1-4f0c-85c3-14ef2b52072d","Type":"ContainerStarted","Data":"10035cc0015b4289d1433164dfb2f742d138f12f020bcfac3a2ab2894d68f6c4"}
Sep 16 12:14:27.801014 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:27.800659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" event={"ID":"29fb0007-a1a1-4f0c-85c3-14ef2b52072d","Type":"ContainerStarted","Data":"f9c97f424bbb7a8792676425f6f6e7a0fb8d4145c0c779c50534f0a5ab06dfd3"}
Sep 16 12:14:27.824670 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:27.824624    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" podStartSLOduration=1.824608276 podStartE2EDuration="1.824608276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:27.822883341 +0000 UTC m=+824.265918199" watchObservedRunningTime="2026-09-16 12:14:27.824608276 +0000 UTC m=+824.267643138"
Sep 16 12:14:28.741384 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:28.741358    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:28.745550 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:28.745521    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:28.805365 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:28.805344    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:14:28.805943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:14:28.805927    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:15:15.691341 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.691304    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fcfb5c696-c44dn"]
Sep 16 12:15:15.694735 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.694716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:15.699219 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.699179    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 12:15:15.699349 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.699261    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 12:15:15.701159 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.701138    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 12:15:15.702491 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.702472    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-57f78\""
Sep 16 12:15:15.725390 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.725347    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fcfb5c696-c44dn"]
Sep 16 12:15:15.849148 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.849121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-webhook-cert\") pod \"maas-controller-7fcfb5c696-c44dn\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") " pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:15.849275 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.849166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-462tv\" (UniqueName: \"kubernetes.io/projected/953cee01-f004-4d98-9c8b-d0a010e12b18-kube-api-access-462tv\") pod \"maas-controller-7fcfb5c696-c44dn\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") " pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:15.849275 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.849235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-metrics-certs\") pod \"maas-controller-7fcfb5c696-c44dn\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") " pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:15.950427 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.950360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-462tv\" (UniqueName: \"kubernetes.io/projected/953cee01-f004-4d98-9c8b-d0a010e12b18-kube-api-access-462tv\") pod \"maas-controller-7fcfb5c696-c44dn\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") " pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:15.950427 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.950408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-metrics-certs\") pod \"maas-controller-7fcfb5c696-c44dn\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") " pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:15.950614 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.950456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-webhook-cert\") pod \"maas-controller-7fcfb5c696-c44dn\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") " pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:15.952719 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.952671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-webhook-cert\") pod \"maas-controller-7fcfb5c696-c44dn\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") " pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:15.952819 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.952721    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-metrics-certs\") pod \"maas-controller-7fcfb5c696-c44dn\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") " pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:15.958766 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:15.958745    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-462tv\" (UniqueName: \"kubernetes.io/projected/953cee01-f004-4d98-9c8b-d0a010e12b18-kube-api-access-462tv\") pod \"maas-controller-7fcfb5c696-c44dn\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") " pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:16.006649 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:16.006621    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:16.277134 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:16.277108    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fcfb5c696-c44dn"]
Sep 16 12:15:16.278716 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:15:16.278670    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953cee01_f004_4d98_9c8b_d0a010e12b18.slice/crio-facd6d3b674c84afde00762e5f720222648cd093a6aff76d0ac8bbdf0d50a4bc WatchSource:0}: Error finding container facd6d3b674c84afde00762e5f720222648cd093a6aff76d0ac8bbdf0d50a4bc: Status 404 returned error can't find the container with id facd6d3b674c84afde00762e5f720222648cd093a6aff76d0ac8bbdf0d50a4bc
Sep 16 12:15:17.021663 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:17.021632    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcfb5c696-c44dn" event={"ID":"953cee01-f004-4d98-9c8b-d0a010e12b18","Type":"ContainerStarted","Data":"facd6d3b674c84afde00762e5f720222648cd093a6aff76d0ac8bbdf0d50a4bc"}
Sep 16 12:15:20.038563 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:20.038493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcfb5c696-c44dn" event={"ID":"953cee01-f004-4d98-9c8b-d0a010e12b18","Type":"ContainerStarted","Data":"9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730"}
Sep 16 12:15:20.038903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:20.038616    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:20.058889 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:20.058846    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fcfb5c696-c44dn" podStartSLOduration=2.325378582 podStartE2EDuration="5.058833395s" totalImagesPullingTime="2.733454813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:15:20.057133693 +0000 UTC m=+876.500168554" watchObservedRunningTime="2026-09-16 12:15:20.058833395 +0000 UTC m=+876.501868256"
Sep 16 12:15:30.377368 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.377335    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fcfb5c696-c44dn"]
Sep 16 12:15:30.377832 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.377523    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fcfb5c696-c44dn" podUID="953cee01-f004-4d98-9c8b-d0a010e12b18" containerName="manager" containerID="cri-o://9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730" gracePeriod=30
Sep 16 12:15:30.379197 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.379171    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:30.614347 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.614326    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:30.757958 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.757930    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-metrics-certs\") pod \"953cee01-f004-4d98-9c8b-d0a010e12b18\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") "
Sep 16 12:15:30.758096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.757996    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-webhook-cert\") pod \"953cee01-f004-4d98-9c8b-d0a010e12b18\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") "
Sep 16 12:15:30.758096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.758058    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-462tv\" (UniqueName: \"kubernetes.io/projected/953cee01-f004-4d98-9c8b-d0a010e12b18-kube-api-access-462tv\") pod \"953cee01-f004-4d98-9c8b-d0a010e12b18\" (UID: \"953cee01-f004-4d98-9c8b-d0a010e12b18\") "
Sep 16 12:15:30.760050 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.760020    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "953cee01-f004-4d98-9c8b-d0a010e12b18" (UID: "953cee01-f004-4d98-9c8b-d0a010e12b18"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:15:30.760148 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.760043    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "953cee01-f004-4d98-9c8b-d0a010e12b18" (UID: "953cee01-f004-4d98-9c8b-d0a010e12b18"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:15:30.760148 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.760067    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953cee01-f004-4d98-9c8b-d0a010e12b18-kube-api-access-462tv" (OuterVolumeSpecName: "kube-api-access-462tv") pod "953cee01-f004-4d98-9c8b-d0a010e12b18" (UID: "953cee01-f004-4d98-9c8b-d0a010e12b18"). InnerVolumeSpecName "kube-api-access-462tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:15:30.858756 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.858733    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-webhook-cert\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:15:30.858756 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.858753    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-462tv\" (UniqueName: \"kubernetes.io/projected/953cee01-f004-4d98-9c8b-d0a010e12b18-kube-api-access-462tv\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:15:30.858884 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:30.858763    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/953cee01-f004-4d98-9c8b-d0a010e12b18-metrics-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:15:31.087850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:31.087795    2559 generic.go:356] "Generic (PLEG): container finished" podID="953cee01-f004-4d98-9c8b-d0a010e12b18" containerID="9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730" exitCode=0
Sep 16 12:15:31.087850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:31.087838    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fcfb5c696-c44dn"
Sep 16 12:15:31.087973 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:31.087874    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcfb5c696-c44dn" event={"ID":"953cee01-f004-4d98-9c8b-d0a010e12b18","Type":"ContainerDied","Data":"9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730"}
Sep 16 12:15:31.087973 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:31.087918    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fcfb5c696-c44dn" event={"ID":"953cee01-f004-4d98-9c8b-d0a010e12b18","Type":"ContainerDied","Data":"facd6d3b674c84afde00762e5f720222648cd093a6aff76d0ac8bbdf0d50a4bc"}
Sep 16 12:15:31.087973 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:31.087940    2559 scope.go:117] "RemoveContainer" containerID="9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730"
Sep 16 12:15:31.096832 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:31.096811    2559 scope.go:117] "RemoveContainer" containerID="9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730"
Sep 16 12:15:31.097090 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:15:31.097068    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730\": container with ID starting with 9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730 not found: ID does not exist" containerID="9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730"
Sep 16 12:15:31.097157 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:31.097098    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730"} err="failed to get container status \"9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730\": rpc error: code = NotFound desc = could not find container \"9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730\": container with ID starting with 9fe4ec4bb04c69ced1434ec96f331f7339b6d437133ebd4cc55a8a7dcaa66730 not found: ID does not exist"
Sep 16 12:15:31.109305 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:31.109134    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fcfb5c696-c44dn"]
Sep 16 12:15:31.110938 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:31.110914    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fcfb5c696-c44dn"]
Sep 16 12:15:32.029873 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:32.029845    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="953cee01-f004-4d98-9c8b-d0a010e12b18" path="/var/lib/kubelet/pods/953cee01-f004-4d98-9c8b-d0a010e12b18/volumes"
Sep 16 12:15:52.995347 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:52.995311    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"]
Sep 16 12:15:52.995818 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:52.995672    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953cee01-f004-4d98-9c8b-d0a010e12b18" containerName="manager"
Sep 16 12:15:52.995818 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:52.995685    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="953cee01-f004-4d98-9c8b-d0a010e12b18" containerName="manager"
Sep 16 12:15:52.995818 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:52.995759    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="953cee01-f004-4d98-9c8b-d0a010e12b18" containerName="manager"
Sep 16 12:15:53.003809 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.003787    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:15:53.006603 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.006576    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 12:15:53.007933 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.007908    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"]
Sep 16 12:15:53.117718 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.117666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e2fae9b-f7d0-4874-8ac9-5b196a86bd27-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-r7jp6\" (UID: \"4e2fae9b-f7d0-4874-8ac9-5b196a86bd27\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:15:53.117843 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.117730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsfg7\" (UniqueName: \"kubernetes.io/projected/4e2fae9b-f7d0-4874-8ac9-5b196a86bd27-kube-api-access-bsfg7\") pod \"payload-pre-processing-59fbc47bf8-r7jp6\" (UID: \"4e2fae9b-f7d0-4874-8ac9-5b196a86bd27\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:15:53.218424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.218393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e2fae9b-f7d0-4874-8ac9-5b196a86bd27-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-r7jp6\" (UID: \"4e2fae9b-f7d0-4874-8ac9-5b196a86bd27\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:15:53.218424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.218427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsfg7\" (UniqueName: \"kubernetes.io/projected/4e2fae9b-f7d0-4874-8ac9-5b196a86bd27-kube-api-access-bsfg7\") pod \"payload-pre-processing-59fbc47bf8-r7jp6\" (UID: \"4e2fae9b-f7d0-4874-8ac9-5b196a86bd27\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:15:53.219113 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.219092    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e2fae9b-f7d0-4874-8ac9-5b196a86bd27-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-r7jp6\" (UID: \"4e2fae9b-f7d0-4874-8ac9-5b196a86bd27\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:15:53.227185 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.227158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsfg7\" (UniqueName: \"kubernetes.io/projected/4e2fae9b-f7d0-4874-8ac9-5b196a86bd27-kube-api-access-bsfg7\") pod \"payload-pre-processing-59fbc47bf8-r7jp6\" (UID: \"4e2fae9b-f7d0-4874-8ac9-5b196a86bd27\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:15:53.315175 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.315120    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:15:53.588186 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:53.588166    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"]
Sep 16 12:15:53.590502 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:15:53.590474    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2fae9b_f7d0_4874_8ac9_5b196a86bd27.slice/crio-e5b515a072b23ecca7d5608e0b3a4876b386526958f72299bb75bd3fbbed312e WatchSource:0}: Error finding container e5b515a072b23ecca7d5608e0b3a4876b386526958f72299bb75bd3fbbed312e: Status 404 returned error can't find the container with id e5b515a072b23ecca7d5608e0b3a4876b386526958f72299bb75bd3fbbed312e
Sep 16 12:15:54.190485 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:54.190442    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6" event={"ID":"4e2fae9b-f7d0-4874-8ac9-5b196a86bd27","Type":"ContainerStarted","Data":"e5b515a072b23ecca7d5608e0b3a4876b386526958f72299bb75bd3fbbed312e"}
Sep 16 12:15:57.206053 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:57.206013    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6" event={"ID":"4e2fae9b-f7d0-4874-8ac9-5b196a86bd27","Type":"ContainerStarted","Data":"32e1bd0039aa61a036ff0ca640d9c455e93f394c73a1aa01431ffd26a22e1662"}
Sep 16 12:15:57.206476 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:57.206094    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:15:57.223511 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:15:57.223465    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6" podStartSLOduration=2.410374063 podStartE2EDuration="5.223451878s" totalImagesPullingTime="2.813077815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:15:57.221730586 +0000 UTC m=+913.664765449" watchObservedRunningTime="2026-09-16 12:15:57.223451878 +0000 UTC m=+913.666486740"
Sep 16 12:16:02.231241 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:02.231213    2559 generic.go:356] "Generic (PLEG): container finished" podID="29fb0007-a1a1-4f0c-85c3-14ef2b52072d" containerID="10035cc0015b4289d1433164dfb2f742d138f12f020bcfac3a2ab2894d68f6c4" exitCode=0
Sep 16 12:16:02.231557 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:02.231287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" event={"ID":"29fb0007-a1a1-4f0c-85c3-14ef2b52072d","Type":"ContainerDied","Data":"10035cc0015b4289d1433164dfb2f742d138f12f020bcfac3a2ab2894d68f6c4"}
Sep 16 12:16:02.231678 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:02.231663    2559 scope.go:117] "RemoveContainer" containerID="10035cc0015b4289d1433164dfb2f742d138f12f020bcfac3a2ab2894d68f6c4"
Sep 16 12:16:02.232590 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:02.232561    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:16:02.232647 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:02.232634    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:16:02.232690 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:02.232667    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:16:03.237837 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:03.237800    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" event={"ID":"29fb0007-a1a1-4f0c-85c3-14ef2b52072d","Type":"ContainerStarted","Data":"54d5126fd09e82ba2881dea82f4ec471ff0b01bd4f0f51934c3450bdd20db094"}
Sep 16 12:16:03.740869 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:03.740839    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:16:03.741040 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:03.741004    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rdjfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 16 12:16:03.741089 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:03.741041    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" podUID="29fb0007-a1a1-4f0c-85c3-14ef2b52072d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 16 12:16:04.740663 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:04.740628    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rdjfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 16 12:16:04.741080 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:04.740688    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" podUID="29fb0007-a1a1-4f0c-85c3-14ef2b52072d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 16 12:16:05.740680 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:05.740645    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rdjfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 16 12:16:05.741051 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:05.740746    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" podUID="29fb0007-a1a1-4f0c-85c3-14ef2b52072d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 16 12:16:06.740710 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:06.740660    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rdjfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 16 12:16:06.741083 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:06.740775    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" podUID="29fb0007-a1a1-4f0c-85c3-14ef2b52072d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 16 12:16:07.741501 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:07.741468    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rdjfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 16 12:16:07.741882 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:07.741526    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk" podUID="29fb0007-a1a1-4f0c-85c3-14ef2b52072d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 16 12:16:08.212259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:08.212232    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-r7jp6"
Sep 16 12:16:08.743551 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:08.743526    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:16:08.743967 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:08.743819    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:16:08.744491 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:08.744473    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rdjfk"
Sep 16 12:16:22.902210 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.902176    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"]
Sep 16 12:16:22.904534 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.904514    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:22.908411 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.908393    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jfdlt\""
Sep 16 12:16:22.908411 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.908400    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 12:16:22.908567 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.908402    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 16 12:16:22.908686 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.908672    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 12:16:22.916644 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.916626    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"]
Sep 16 12:16:22.988710 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.988675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:22.988839 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.988724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:22.988839 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.988785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjz74\" (UniqueName: \"kubernetes.io/projected/ae837cec-ad18-4112-9290-f3fd69865db1-kube-api-access-rjz74\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:22.988944 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.988855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae837cec-ad18-4112-9290-f3fd69865db1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:22.988944 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.988907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:22.989019 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:22.988944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.089708 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.089663    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.089880 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.089735    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.089880 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.089775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.089880 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.089800    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.090152 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.090131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjz74\" (UniqueName: \"kubernetes.io/projected/ae837cec-ad18-4112-9290-f3fd69865db1-kube-api-access-rjz74\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.090300 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.090274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae837cec-ad18-4112-9290-f3fd69865db1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.090377 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.090182    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.090377 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.090167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.090781 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.090756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.092657 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.092629    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae837cec-ad18-4112-9290-f3fd69865db1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.093354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.093313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae837cec-ad18-4112-9290-f3fd69865db1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.099118 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.099099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjz74\" (UniqueName: \"kubernetes.io/projected/ae837cec-ad18-4112-9290-f3fd69865db1-kube-api-access-rjz74\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq\" (UID: \"ae837cec-ad18-4112-9290-f3fd69865db1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.214876 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.214826    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:23.496489 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:23.491585    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"]
Sep 16 12:16:24.338164 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:24.338120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq" event={"ID":"ae837cec-ad18-4112-9290-f3fd69865db1","Type":"ContainerStarted","Data":"88c9b00841b91a84704adf4971ef0ef1b65bce0c2c1e28d72403b93d495494ae"}
Sep 16 12:16:25.344507 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:25.344471    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq" event={"ID":"ae837cec-ad18-4112-9290-f3fd69865db1","Type":"ContainerStarted","Data":"a605cc0231fa073e044b1b0df1376636d9ba75890bdc7e70aea303c9a9304c70"}
Sep 16 12:16:25.360933 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:25.360879    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq" podStartSLOduration=2.361771712 podStartE2EDuration="3.360860583s" totalImagesPullingTime="999.088871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:16:25.360653652 +0000 UTC m=+941.803688515" watchObservedRunningTime="2026-09-16 12:16:25.360860583 +0000 UTC m=+941.803895447"
Sep 16 12:16:33.215738 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:33.215686    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:33.216094 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:33.215776    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:33.227544 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:33.227523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:33.396790 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:33.396764    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq"
Sep 16 12:16:34.199513 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.199478    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"]
Sep 16 12:16:34.207671 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.207649    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.210324 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.210298    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 12:16:34.212668 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.212645    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"]
Sep 16 12:16:34.285479 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.285453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.285842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.285481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.285842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.285510    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d43e5ec-5425-4879-b391-a80471c83080-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.285842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.285608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6ltt\" (UniqueName: \"kubernetes.io/projected/7d43e5ec-5425-4879-b391-a80471c83080-kube-api-access-d6ltt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.285842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.285662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.285842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.285744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.386878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.386840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6ltt\" (UniqueName: \"kubernetes.io/projected/7d43e5ec-5425-4879-b391-a80471c83080-kube-api-access-d6ltt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.387019 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.386901    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.387150 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.387128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.387327 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.387304    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.387473 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.387452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.387603 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.387494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.387603 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.387530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.387603 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.387578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d43e5ec-5425-4879-b391-a80471c83080-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.387885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.387865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.390470 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.390443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d43e5ec-5425-4879-b391-a80471c83080-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.390584 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.390567    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d43e5ec-5425-4879-b391-a80471c83080-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.394908 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.394886    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6ltt\" (UniqueName: \"kubernetes.io/projected/7d43e5ec-5425-4879-b391-a80471c83080-kube-api-access-d6ltt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6vpd\" (UID: \"7d43e5ec-5425-4879-b391-a80471c83080\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.518093 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.518038    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:34.793801 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:34.793772    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"]
Sep 16 12:16:35.398601 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:35.398567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd" event={"ID":"7d43e5ec-5425-4879-b391-a80471c83080","Type":"ContainerStarted","Data":"6abb815bc03909a1cf6977b649e9553eef025fb9331cab7eecd4668aa413b26d"}
Sep 16 12:16:35.398943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:35.398649    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd" event={"ID":"7d43e5ec-5425-4879-b391-a80471c83080","Type":"ContainerStarted","Data":"0e420cb9f63d1300049f87766b12d83b16e9b13da366850959fbd2b128cd6809"}
Sep 16 12:16:35.422710 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:35.422659    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd" podStartSLOduration=1.210767439 podStartE2EDuration="1.422646094s" totalImagesPullingTime="211.878655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:16:35.421402465 +0000 UTC m=+951.864437327" watchObservedRunningTime="2026-09-16 12:16:35.422646094 +0000 UTC m=+951.865680955"
Sep 16 12:16:44.519201 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:44.519165    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:44.519540 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:44.519220    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:44.531123 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:44.531101    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:16:45.456904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:16:45.456875    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6vpd"
Sep 16 12:17:23.598593 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.598558    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"]
Sep 16 12:17:23.602136 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.602111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.604803 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.604780    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 16 12:17:23.612973 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.612950    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"]
Sep 16 12:17:23.771016 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.770987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.771172 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.771019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql4fw\" (UniqueName: \"kubernetes.io/projected/974f1426-a35e-474f-bd79-c526b1b8a925-kube-api-access-ql4fw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.771172 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.771061    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.771172 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.771123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.771172 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.771163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/974f1426-a35e-474f-bd79-c526b1b8a925-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.771311 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.771248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.872562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.872483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.872562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.872536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.872799 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.872569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/974f1426-a35e-474f-bd79-c526b1b8a925-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.872799 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.872636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.872799 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.872676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.872799 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.872727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql4fw\" (UniqueName: \"kubernetes.io/projected/974f1426-a35e-474f-bd79-c526b1b8a925-kube-api-access-ql4fw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.873034 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.873009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.873099 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.873050    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.873147 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.873100    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.874710 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.874681    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/974f1426-a35e-474f-bd79-c526b1b8a925-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.875049 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.875030    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/974f1426-a35e-474f-bd79-c526b1b8a925-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.881591 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.881570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql4fw\" (UniqueName: \"kubernetes.io/projected/974f1426-a35e-474f-bd79-c526b1b8a925-kube-api-access-ql4fw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgnpj\" (UID: \"974f1426-a35e-474f-bd79-c526b1b8a925\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:23.915714 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:23.915673    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:24.192897 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:24.192865    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"]
Sep 16 12:17:24.195522 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:17:24.195494    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod974f1426_a35e_474f_bd79_c526b1b8a925.slice/crio-3472c7713b3aa78f56f557b8fac7e663d8cb545624f4992e56ddb7d1b1e68def WatchSource:0}: Error finding container 3472c7713b3aa78f56f557b8fac7e663d8cb545624f4992e56ddb7d1b1e68def: Status 404 returned error can't find the container with id 3472c7713b3aa78f56f557b8fac7e663d8cb545624f4992e56ddb7d1b1e68def
Sep 16 12:17:24.196734 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:24.196690    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:17:24.628842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:24.628765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj" event={"ID":"974f1426-a35e-474f-bd79-c526b1b8a925","Type":"ContainerStarted","Data":"fe6f36dd84a7d1daa1aacfa1b9607980ce6182a1162c0d4598c83a87fe024240"}
Sep 16 12:17:24.628842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:24.628823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj" event={"ID":"974f1426-a35e-474f-bd79-c526b1b8a925","Type":"ContainerStarted","Data":"3472c7713b3aa78f56f557b8fac7e663d8cb545624f4992e56ddb7d1b1e68def"}
Sep 16 12:17:24.649356 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:24.649292    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj" podStartSLOduration=1.474832764 podStartE2EDuration="1.649273391s" totalImagesPullingTime="174.440627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:17:24.646651484 +0000 UTC m=+1001.089686360" watchObservedRunningTime="2026-09-16 12:17:24.649273391 +0000 UTC m=+1001.092308254"
Sep 16 12:17:33.916001 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:33.915969    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:33.916425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:33.916027    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:33.928794 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:33.928772    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:17:34.685588 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:17:34.685559    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgnpj"
Sep 16 12:19:45.475655 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.475621    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"]
Sep 16 12:19:45.479505 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.479481    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.482169 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.482146    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-0e8ffe-openshift-default-dockercfg-s98wr\""
Sep 16 12:19:45.493176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.493091    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"]
Sep 16 12:19:45.557013 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.555678    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"]
Sep 16 12:19:45.559539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.559517    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.562659 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.562632    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-7a4d5c-openshift-default-dockercfg-scgjq\""
Sep 16 12:19:45.568507 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.568398    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"]
Sep 16 12:19:45.635184 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-podinfo\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.635337 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-socket\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.635337 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-credential-socket\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.635337 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-token\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.635495 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-data\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.635495 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-certs\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.635495 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635400    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-podinfo\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.635495 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istiod-ca-cert\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.635717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-data\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.635717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-token\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.635717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-socket\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.635717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-envoy\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.635717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635678    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-credential-socket\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.635969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-certs\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.635969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wknw\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-kube-api-access-8wknw\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.635969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2c9m\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-kube-api-access-q2c9m\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.635969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istiod-ca-cert\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.635969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.635835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-envoy\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.736770 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.736667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istiod-ca-cert\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.737572 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.737543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-data\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.737824 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.737803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-token\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.737984 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.737968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-socket\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.738106 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.738090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-envoy\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.738205 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.738193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-credential-socket\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.738294 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.738282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-certs\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.738376 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.738365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wknw\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-kube-api-access-8wknw\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.738456 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.738431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-socket\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.738933 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.738453    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2c9m\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-kube-api-access-q2c9m\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.739032 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.738971    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istiod-ca-cert\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.739032 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.739000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-envoy\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.739138 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.739060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-podinfo\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.739138 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.739106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-socket\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.739138 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.739134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-credential-socket\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.739300 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.739163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-token\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.739300 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.739201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-data\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.739300 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.739229    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-certs\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.739300 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.739258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-podinfo\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.741943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.740318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-credential-socket\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.741943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.738877    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-certs\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.741943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.740583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-socket\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.741943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.740832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-data\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.741943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.737982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-data\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.741943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.737679    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istiod-ca-cert\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.741943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.741631    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istiod-ca-cert\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.741943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.741882    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-certs\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.741943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.738816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-credential-socket\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.743359 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.743312    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-envoy\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.743577 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.743531    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-podinfo\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.744467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.744423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-podinfo\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.747161 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.747141    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-envoy\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.749598 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.749551    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wknw\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-kube-api-access-8wknw\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.755667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.755545    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-token\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.756983 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.756959    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2c9m\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-kube-api-access-q2c9m\") pod \"e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") " pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.759031 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.759000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-token\") pod \"e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") " pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:45.797879 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.797857    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:45.873806 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:45.873774    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:46.081256 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.081167    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"]
Sep 16 12:19:46.085194 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:19:46.085170    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c114c5_cb69_4eff_a4ae_b0a49370b918.slice/crio-bc3a5bb8b71b5a984eae464f06b84e20296f32a44986daadb9cb0a2da1b1d141 WatchSource:0}: Error finding container bc3a5bb8b71b5a984eae464f06b84e20296f32a44986daadb9cb0a2da1b1d141: Status 404 returned error can't find the container with id bc3a5bb8b71b5a984eae464f06b84e20296f32a44986daadb9cb0a2da1b1d141
Sep 16 12:19:46.087339 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.087299    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:46.087411 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.087391    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:46.087452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.087440    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:46.152713 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.152666    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"]
Sep 16 12:19:46.156116 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:19:46.156085    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0055b8_de0a_4e9e_a7e6_87bad0f17387.slice/crio-82b6117cfce19ef1f06889e25614b2973dee28860d8ed0e8624967df25175218 WatchSource:0}: Error finding container 82b6117cfce19ef1f06889e25614b2973dee28860d8ed0e8624967df25175218: Status 404 returned error can't find the container with id 82b6117cfce19ef1f06889e25614b2973dee28860d8ed0e8624967df25175218
Sep 16 12:19:46.158340 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.158300    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:46.158423 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.158383    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:46.158470 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.158425    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:46.281948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.281871    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" event={"ID":"bc0055b8-de0a-4e9e-a7e6-87bad0f17387","Type":"ContainerStarted","Data":"1c0884080bc27233472b8b32f94758171a37a92a177c82a5b2bd938d0b78cc1c"}
Sep 16 12:19:46.281948 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.281934    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" event={"ID":"bc0055b8-de0a-4e9e-a7e6-87bad0f17387","Type":"ContainerStarted","Data":"82b6117cfce19ef1f06889e25614b2973dee28860d8ed0e8624967df25175218"}
Sep 16 12:19:46.284029 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.283965    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" event={"ID":"e6c114c5-cb69-4eff-a4ae-b0a49370b918","Type":"ContainerStarted","Data":"ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182"}
Sep 16 12:19:46.284029 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.284005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" event={"ID":"e6c114c5-cb69-4eff-a4ae-b0a49370b918","Type":"ContainerStarted","Data":"bc3a5bb8b71b5a984eae464f06b84e20296f32a44986daadb9cb0a2da1b1d141"}
Sep 16 12:19:46.302926 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.302867    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" podStartSLOduration=1.3028338019999999 podStartE2EDuration="1.302833802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:46.299826669 +0000 UTC m=+1142.742861529" watchObservedRunningTime="2026-09-16 12:19:46.302833802 +0000 UTC m=+1142.745868665"
Sep 16 12:19:46.319890 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.319791    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" podStartSLOduration=1.319770421 podStartE2EDuration="1.319770421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:46.317955928 +0000 UTC m=+1142.760990791" watchObservedRunningTime="2026-09-16 12:19:46.319770421 +0000 UTC m=+1142.762805284"
Sep 16 12:19:46.798357 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.798321    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:46.874169 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:46.874135    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:47.802903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:47.802872    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:47.878714 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:47.878660    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:48.293909 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:48.293762    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:48.294073 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:48.293939    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:48.294510 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:48.294490    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:19:48.294670 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:48.294653    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:19:52.109985 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.109951    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"]
Sep 16 12:19:52.114634 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.114616    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:19:52.129058 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.129038    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-0e8ffe-dockercfg-xt7gx\""
Sep 16 12:19:52.129453 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.129438    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-0e8ffe\""
Sep 16 12:19:52.132987 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.132965    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"]
Sep 16 12:19:52.203323 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.203295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17223d07-8fcd-4116-a4a0-e6362fe587e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv\" (UID: \"17223d07-8fcd-4116-a4a0-e6362fe587e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:19:52.203491 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.203468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl6ll\" (UniqueName: \"kubernetes.io/projected/17223d07-8fcd-4116-a4a0-e6362fe587e0-kube-api-access-hl6ll\") pod \"payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv\" (UID: \"17223d07-8fcd-4116-a4a0-e6362fe587e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:19:52.304950 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.304921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl6ll\" (UniqueName: \"kubernetes.io/projected/17223d07-8fcd-4116-a4a0-e6362fe587e0-kube-api-access-hl6ll\") pod \"payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv\" (UID: \"17223d07-8fcd-4116-a4a0-e6362fe587e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:19:52.305252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.305036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17223d07-8fcd-4116-a4a0-e6362fe587e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv\" (UID: \"17223d07-8fcd-4116-a4a0-e6362fe587e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:19:52.305742 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.305725    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17223d07-8fcd-4116-a4a0-e6362fe587e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv\" (UID: \"17223d07-8fcd-4116-a4a0-e6362fe587e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:19:52.327283 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.327256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl6ll\" (UniqueName: \"kubernetes.io/projected/17223d07-8fcd-4116-a4a0-e6362fe587e0-kube-api-access-hl6ll\") pod \"payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv\" (UID: \"17223d07-8fcd-4116-a4a0-e6362fe587e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:19:52.425646 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.425612    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:19:52.705167 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:52.705140    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"]
Sep 16 12:19:52.707405 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:19:52.707377    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17223d07_8fcd_4116_a4a0_e6362fe587e0.slice/crio-ca36b78e82a29d33146c391fbcc19643d4a80b1db82e2f526b632591bc01db9b WatchSource:0}: Error finding container ca36b78e82a29d33146c391fbcc19643d4a80b1db82e2f526b632591bc01db9b: Status 404 returned error can't find the container with id ca36b78e82a29d33146c391fbcc19643d4a80b1db82e2f526b632591bc01db9b
Sep 16 12:19:53.322264 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.322227    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv" event={"ID":"17223d07-8fcd-4116-a4a0-e6362fe587e0","Type":"ContainerStarted","Data":"ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf"}
Sep 16 12:19:53.322626 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.322278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv" event={"ID":"17223d07-8fcd-4116-a4a0-e6362fe587e0","Type":"ContainerStarted","Data":"ca36b78e82a29d33146c391fbcc19643d4a80b1db82e2f526b632591bc01db9b"}
Sep 16 12:19:53.322626 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.322306    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:19:53.342894 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.342838    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv" podStartSLOduration=1.342817576 podStartE2EDuration="1.342817576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:53.342182289 +0000 UTC m=+1149.785217155" watchObservedRunningTime="2026-09-16 12:19:53.342817576 +0000 UTC m=+1149.785852439"
Sep 16 12:19:53.646940 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.646910    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"]
Sep 16 12:19:53.656278 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.655942    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.658829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.658799    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-7c3429-openshift-default-dockercfg-ktrzh\""
Sep 16 12:19:53.665158 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.665096    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"]
Sep 16 12:19:53.819901 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.819867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-istio-token\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.820044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.819924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-data\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.820096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.820038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-socket\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.820096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.820083    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-certs\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.820187 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.820133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-envoy\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.820227 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.820189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb220df-8108-4e59-846f-d70f288396c7-istio-podinfo\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.820263 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.820221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-credential-socket\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.820263 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.820249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb220df-8108-4e59-846f-d70f288396c7-istiod-ca-cert\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.820341 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.820268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blx8x\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-kube-api-access-blx8x\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.920954 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.920893    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-certs\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.920954 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.920942    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-envoy\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.921139 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.920961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb220df-8108-4e59-846f-d70f288396c7-istio-podinfo\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.921139 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.920985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-credential-socket\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.921139 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.921013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb220df-8108-4e59-846f-d70f288396c7-istiod-ca-cert\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.921139 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.921040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blx8x\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-kube-api-access-blx8x\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.921139 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.921097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-istio-token\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.921408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.921141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-data\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.921408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.921176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-socket\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.921408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.921315    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-certs\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.921753 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.921677    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-credential-socket\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.922108 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.922086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-socket\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.922206 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.922146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-data\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.922274 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.922249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb220df-8108-4e59-846f-d70f288396c7-istiod-ca-cert\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.923529 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.923509    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb220df-8108-4e59-846f-d70f288396c7-istio-podinfo\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.923602 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.923528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-envoy\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.937884 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.937856    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-istio-token\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.938170 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.938153    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blx8x\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-kube-api-access-blx8x\") pod \"e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") " pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:53.970917 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:53.970896    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:54.253850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:54.253824    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"]
Sep 16 12:19:54.255865 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:19:54.255831    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb220df_8108_4e59_846f_d70f288396c7.slice/crio-2ba2e5007958dfc4304faef88f53026cf93e78f96b4d846a45326b401c29dbea WatchSource:0}: Error finding container 2ba2e5007958dfc4304faef88f53026cf93e78f96b4d846a45326b401c29dbea: Status 404 returned error can't find the container with id 2ba2e5007958dfc4304faef88f53026cf93e78f96b4d846a45326b401c29dbea
Sep 16 12:19:54.264775 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:54.260202    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:54.264775 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:54.260347    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:54.264775 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:54.260447    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:54.329022 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:54.328996    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" event={"ID":"5eb220df-8108-4e59-846f-d70f288396c7","Type":"ContainerStarted","Data":"dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135"}
Sep 16 12:19:54.329305 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:54.329070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" event={"ID":"5eb220df-8108-4e59-846f-d70f288396c7","Type":"ContainerStarted","Data":"2ba2e5007958dfc4304faef88f53026cf93e78f96b4d846a45326b401c29dbea"}
Sep 16 12:19:54.357134 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:54.357063    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" podStartSLOduration=1.357040214 podStartE2EDuration="1.357040214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:54.354635516 +0000 UTC m=+1150.797670382" watchObservedRunningTime="2026-09-16 12:19:54.357040214 +0000 UTC m=+1150.800075117"
Sep 16 12:19:54.971032 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:54.970999    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:55.551587 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.551554    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"]
Sep 16 12:19:55.556021 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.555996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.558962 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.558938    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1ce21877-openshift-default-dockercfg-dbhqn\""
Sep 16 12:19:55.571066 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.571046    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"]
Sep 16 12:19:55.737277 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.737242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-socket\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.737277 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.737283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-certs\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.737471 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.737392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-data\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.737471 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.737448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ds4q\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-kube-api-access-5ds4q\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.737543 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.737492    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-credential-socket\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.737543 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.737525    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b03ca22-5465-49c6-bdc9-98553dd412ea-istiod-ca-cert\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.737612 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.737542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-podinfo\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.737612 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.737574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-envoy\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.737676 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.737618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-token\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.838474 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-data\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.838474 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ds4q\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-kube-api-access-5ds4q\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.838683 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-credential-socket\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.838683 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838508    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b03ca22-5465-49c6-bdc9-98553dd412ea-istiod-ca-cert\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.838683 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-podinfo\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.838683 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-envoy\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.838683 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838609    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-token\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.838683 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-socket\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.838683 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838686    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-certs\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.839018 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.838872    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-data\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.839076 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.839054    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-credential-socket\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.839337 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.839311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-socket\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.839461 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.839321    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b03ca22-5465-49c6-bdc9-98553dd412ea-istiod-ca-cert\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.839461 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.839435    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-certs\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.840957 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.840934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-envoy\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.841276 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.841255    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-podinfo\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.846457 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.846437    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-token\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.846809 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.846789    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ds4q\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-kube-api-access-5ds4q\") pod \"e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") " pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.867866 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.867624    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:55.976666 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:55.976632    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:56.142394 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.142357    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"]
Sep 16 12:19:56.143839 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:19:56.143809    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b03ca22_5465_49c6_bdc9_98553dd412ea.slice/crio-6b220045f5ecc1313f541f0fe0c48a491eb44a8a5f37cbf935a5a3ab858d3dd8 WatchSource:0}: Error finding container 6b220045f5ecc1313f541f0fe0c48a491eb44a8a5f37cbf935a5a3ab858d3dd8: Status 404 returned error can't find the container with id 6b220045f5ecc1313f541f0fe0c48a491eb44a8a5f37cbf935a5a3ab858d3dd8
Sep 16 12:19:56.146130 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.146097    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:56.146214 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.146182    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:56.146253 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.146211    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:19:56.346168 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.346131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" event={"ID":"8b03ca22-5465-49c6-bdc9-98553dd412ea","Type":"ContainerStarted","Data":"280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c"}
Sep 16 12:19:56.346347 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.346206    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:56.346347 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.346235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" event={"ID":"8b03ca22-5465-49c6-bdc9-98553dd412ea","Type":"ContainerStarted","Data":"6b220045f5ecc1313f541f0fe0c48a491eb44a8a5f37cbf935a5a3ab858d3dd8"}
Sep 16 12:19:56.349223 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.349196    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:19:56.368987 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.368923    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" podStartSLOduration=1.368903181 podStartE2EDuration="1.368903181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:56.368276215 +0000 UTC m=+1152.811311106" watchObservedRunningTime="2026-09-16 12:19:56.368903181 +0000 UTC m=+1152.811938045"
Sep 16 12:19:56.868189 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:56.868162    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:57.877942 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:57.877898    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:58.361659 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:58.361623    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:19:58.372716 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:19:58.370916    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:20:00.503907 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.503863    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"]
Sep 16 12:20:00.508353 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.508332    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:00.511143 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.511120    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1ce21877-dockercfg-8mqs6\""
Sep 16 12:20:00.511324 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.511155    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1ce21877\""
Sep 16 12:20:00.518013 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.517990    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"]
Sep 16 12:20:00.620310 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.620268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v75g\" (UniqueName: \"kubernetes.io/projected/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-kube-api-access-9v75g\") pod \"payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd\" (UID: \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:00.620497 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.620340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd\" (UID: \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:00.721837 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.721799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v75g\" (UniqueName: \"kubernetes.io/projected/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-kube-api-access-9v75g\") pod \"payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd\" (UID: \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:00.721979 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.721851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd\" (UID: \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:00.722549 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.722529    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd\" (UID: \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:00.730722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.730688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v75g\" (UniqueName: \"kubernetes.io/projected/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-kube-api-access-9v75g\") pod \"payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd\" (UID: \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:00.819653 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:00.819575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:01.136295 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:01.136265    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"]
Sep 16 12:20:01.140725 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:20:01.140339    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e10ac4_0a88_4882_b5d1_16b6cdfe986d.slice/crio-d0b79c0c52365bd415d8b5d3f43b53febd05eb41f9d7d1897a79269f42487736 WatchSource:0}: Error finding container d0b79c0c52365bd415d8b5d3f43b53febd05eb41f9d7d1897a79269f42487736: Status 404 returned error can't find the container with id d0b79c0c52365bd415d8b5d3f43b53febd05eb41f9d7d1897a79269f42487736
Sep 16 12:20:01.406466 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:01.406430    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd" event={"ID":"13e10ac4-0a88-4882-b5d1-16b6cdfe986d","Type":"ContainerStarted","Data":"69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda"}
Sep 16 12:20:01.406739 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:01.406717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd" event={"ID":"13e10ac4-0a88-4882-b5d1-16b6cdfe986d","Type":"ContainerStarted","Data":"d0b79c0c52365bd415d8b5d3f43b53febd05eb41f9d7d1897a79269f42487736"}
Sep 16 12:20:01.407083 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:01.407059    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:01.424925 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:01.424880    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd" podStartSLOduration=1.42486639 podStartE2EDuration="1.42486639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:01.423140329 +0000 UTC m=+1157.866175192" watchObservedRunningTime="2026-09-16 12:20:01.42486639 +0000 UTC m=+1157.867901251"
Sep 16 12:20:04.331338 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:04.331254    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:20:04.335850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:04.335807    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 12:20:04.335977 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:04.335870    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 12:20:06.445235 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:06.445207    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerID="1c0884080bc27233472b8b32f94758171a37a92a177c82a5b2bd938d0b78cc1c" exitCode=0
Sep 16 12:20:06.445565 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:06.445270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" event={"ID":"bc0055b8-de0a-4e9e-a7e6-87bad0f17387","Type":"ContainerDied","Data":"1c0884080bc27233472b8b32f94758171a37a92a177c82a5b2bd938d0b78cc1c"}
Sep 16 12:20:06.445683 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:06.445668    2559 scope.go:117] "RemoveContainer" containerID="1c0884080bc27233472b8b32f94758171a37a92a177c82a5b2bd938d0b78cc1c"
Sep 16 12:20:06.446853 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:06.446808    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:06.446958 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:06.446914    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:06.447027 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:06.446993    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:07.002227 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.002189    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"]
Sep 16 12:20:07.005283 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.005261    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.007862 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.007842    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4bef4d-openshift-default-dockercfg-pn272\""
Sep 16 12:20:07.018383 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.018360    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"]
Sep 16 12:20:07.088973 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.088944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-credential-socket\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.089110 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.088991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ff6e86-96bd-476a-b556-52ac3710372e-istiod-ca-cert\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.089110 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.089087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-istio-token\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.089220 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.089118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-data\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.089220 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.089200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-certs\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.089308 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.089250    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-socket\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.089352 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.089302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmd9f\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-kube-api-access-bmd9f\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.089352 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.089336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-envoy\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.089425 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.089361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ff6e86-96bd-476a-b556-52ac3710372e-istio-podinfo\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190188 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-socket\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190188 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmd9f\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-kube-api-access-bmd9f\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190439 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-envoy\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190439 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ff6e86-96bd-476a-b556-52ac3710372e-istio-podinfo\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190439 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-credential-socket\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190439 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ff6e86-96bd-476a-b556-52ac3710372e-istiod-ca-cert\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190663 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-istio-token\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190663 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-data\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190663 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190549    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-socket\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190866 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190668    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-certs\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190866 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-credential-socket\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.190866 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190849    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-data\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.191021 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.190993    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-certs\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.191416 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.191393    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ff6e86-96bd-476a-b556-52ac3710372e-istiod-ca-cert\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.192851 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.192832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-envoy\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.192994 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.192905    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ff6e86-96bd-476a-b556-52ac3710372e-istio-podinfo\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.198663 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.198642    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-istio-token\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.198766 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.198745    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmd9f\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-kube-api-access-bmd9f\") pod \"e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") " pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.321653 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.321584    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:07.453768 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.453668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" event={"ID":"bc0055b8-de0a-4e9e-a7e6-87bad0f17387","Type":"ContainerStarted","Data":"16cdfd3971f6a7ec5c295fc3bacbd89725ea0f75328b69c56ba0a68dad73eb81"}
Sep 16 12:20:07.455684 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.455650    2559 generic.go:356] "Generic (PLEG): container finished" podID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerID="ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182" exitCode=0
Sep 16 12:20:07.455829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.455689    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" event={"ID":"e6c114c5-cb69-4eff-a4ae-b0a49370b918","Type":"ContainerDied","Data":"ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182"}
Sep 16 12:20:07.456162 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.456148    2559 scope.go:117] "RemoveContainer" containerID="ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182"
Sep 16 12:20:07.457523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.457490    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:07.457602 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.457577    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:07.457638 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.457621    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:07.612026 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.611998    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"]
Sep 16 12:20:07.615432 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:20:07.614769    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ff6e86_96bd_476a_b556_52ac3710372e.slice/crio-b33223594b2f619700dd0e90546a87b378ea546a305c81c3c4d8c33a7f7482fa WatchSource:0}: Error finding container b33223594b2f619700dd0e90546a87b378ea546a305c81c3c4d8c33a7f7482fa: Status 404 returned error can't find the container with id b33223594b2f619700dd0e90546a87b378ea546a305c81c3c4d8c33a7f7482fa
Sep 16 12:20:07.617610 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.617570    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:07.617729 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.617652    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:07.617797 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.617714    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:07.875079 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.874618    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:20:07.875079 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.874667    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 16 12:20:07.875079 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:07.874741    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 16 12:20:08.471208 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:08.471165    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" event={"ID":"e6c114c5-cb69-4eff-a4ae-b0a49370b918","Type":"ContainerStarted","Data":"634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28"}
Sep 16 12:20:08.476588 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:08.476557    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" event={"ID":"02ff6e86-96bd-476a-b556-52ac3710372e","Type":"ContainerStarted","Data":"edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627"}
Sep 16 12:20:08.476849 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:08.476828    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" event={"ID":"02ff6e86-96bd-476a-b556-52ac3710372e","Type":"ContainerStarted","Data":"b33223594b2f619700dd0e90546a87b378ea546a305c81c3c4d8c33a7f7482fa"}
Sep 16 12:20:08.525793 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:08.525738    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" podStartSLOduration=2.525722188 podStartE2EDuration="2.525722188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:08.523925869 +0000 UTC m=+1164.966960731" watchObservedRunningTime="2026-09-16 12:20:08.525722188 +0000 UTC m=+1164.968757050"
Sep 16 12:20:08.798962 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:08.798873    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:20:08.799212 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:08.798908    2559 patch_prober.go:28] interesting pod/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 16 12:20:08.799373 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:08.799350    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 16 12:20:08.874817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:08.874772    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 16 12:20:08.874988 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:08.874842    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 16 12:20:09.322802 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:09.322764    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:09.327166 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:09.327140    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:09.484476 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:09.484439    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:09.491476 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:09.491450    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:09.799399 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:09.799358    2559 patch_prober.go:28] interesting pod/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 16 12:20:09.799687 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:09.799655    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 16 12:20:09.874949 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:09.874913    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 16 12:20:09.875207 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:09.875184    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 16 12:20:10.798844 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:10.798805    2559 patch_prober.go:28] interesting pod/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 16 12:20:10.799444 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:10.799412    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 16 12:20:10.874361 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:10.874325    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 16 12:20:10.874625 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:10.874585    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 16 12:20:11.802149 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:11.802103    2559 patch_prober.go:28] interesting pod/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 16 12:20:11.802649 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:11.802171    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 16 12:20:11.878720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:11.878118    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 16 12:20:11.878720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:11.878195    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 16 12:20:12.424161 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:12.423174    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:12.800270 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:12.800167    2559 patch_prober.go:28] interesting pod/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 16 12:20:12.800553 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:12.800507    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 16 12:20:12.874523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:12.874486    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 16 12:20:12.875144 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:12.875093    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 16 12:20:13.798791 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:13.798749    2559 patch_prober.go:28] interesting pod/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 16 12:20:13.799083 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:13.799051    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 16 12:20:14.236456 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:14.236293    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:20:14.236931 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:14.236718    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:20:14.238197 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:14.238176    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:20:14.813817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:14.813782    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:20:14.814459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:14.814430    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:20:14.815372 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:14.815344    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:20:16.207874 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.207842    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"]
Sep 16 12:20:16.210572 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.210554    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:16.213407 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.213378    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-4bef4d-dockercfg-z4nlv\""
Sep 16 12:20:16.213543 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.213404    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-4bef4d\""
Sep 16 12:20:16.221810 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.221260    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"]
Sep 16 12:20:16.223814 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.223790    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"]
Sep 16 12:20:16.226593 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.226575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:16.237372 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.237349    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"]
Sep 16 12:20:16.245341 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.245281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c270dd46-7c44-47c9-b99c-17748434f2c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5\" (UID: \"c270dd46-7c44-47c9-b99c-17748434f2c5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:16.245488 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.245451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmv8w\" (UniqueName: \"kubernetes.io/projected/c270dd46-7c44-47c9-b99c-17748434f2c5-kube-api-access-qmv8w\") pod \"payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5\" (UID: \"c270dd46-7c44-47c9-b99c-17748434f2c5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:16.350719 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.346685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e16b26-1853-4634-af3e-e99ef8276eb7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498\" (UID: \"87e16b26-1853-4634-af3e-e99ef8276eb7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:16.350719 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.346818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmv8w\" (UniqueName: \"kubernetes.io/projected/c270dd46-7c44-47c9-b99c-17748434f2c5-kube-api-access-qmv8w\") pod \"payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5\" (UID: \"c270dd46-7c44-47c9-b99c-17748434f2c5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:16.350719 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.346951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c270dd46-7c44-47c9-b99c-17748434f2c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5\" (UID: \"c270dd46-7c44-47c9-b99c-17748434f2c5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:16.350719 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.346978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv9bc\" (UniqueName: \"kubernetes.io/projected/87e16b26-1853-4634-af3e-e99ef8276eb7-kube-api-access-dv9bc\") pod \"payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498\" (UID: \"87e16b26-1853-4634-af3e-e99ef8276eb7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:16.350719 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.348260    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c270dd46-7c44-47c9-b99c-17748434f2c5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5\" (UID: \"c270dd46-7c44-47c9-b99c-17748434f2c5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:16.365439 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.365410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmv8w\" (UniqueName: \"kubernetes.io/projected/c270dd46-7c44-47c9-b99c-17748434f2c5-kube-api-access-qmv8w\") pod \"payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5\" (UID: \"c270dd46-7c44-47c9-b99c-17748434f2c5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:16.448729 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.447763    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv9bc\" (UniqueName: \"kubernetes.io/projected/87e16b26-1853-4634-af3e-e99ef8276eb7-kube-api-access-dv9bc\") pod \"payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498\" (UID: \"87e16b26-1853-4634-af3e-e99ef8276eb7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:16.448729 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.447854    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e16b26-1853-4634-af3e-e99ef8276eb7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498\" (UID: \"87e16b26-1853-4634-af3e-e99ef8276eb7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:16.448957 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.448894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e16b26-1853-4634-af3e-e99ef8276eb7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498\" (UID: \"87e16b26-1853-4634-af3e-e99ef8276eb7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:16.462184 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.462132    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv9bc\" (UniqueName: \"kubernetes.io/projected/87e16b26-1853-4634-af3e-e99ef8276eb7-kube-api-access-dv9bc\") pod \"payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498\" (UID: \"87e16b26-1853-4634-af3e-e99ef8276eb7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:16.523415 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.523323    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:16.537844 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.537821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:16.824517 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.824486    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"]
Sep 16 12:20:16.826340 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:20:16.826309    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc270dd46_7c44_47c9_b99c_17748434f2c5.slice/crio-98bfc16a8f046e9155bcce01b00232b19f6ddb67d4a7400a190fc4f4791bf222 WatchSource:0}: Error finding container 98bfc16a8f046e9155bcce01b00232b19f6ddb67d4a7400a190fc4f4791bf222: Status 404 returned error can't find the container with id 98bfc16a8f046e9155bcce01b00232b19f6ddb67d4a7400a190fc4f4791bf222
Sep 16 12:20:16.834794 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:16.834767    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"]
Sep 16 12:20:16.843350 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:20:16.843314    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e16b26_1853_4634_af3e_e99ef8276eb7.slice/crio-382d9d01f2cbf6106df78818095c309d95c7d7d8ac676359d63e2238f019f596 WatchSource:0}: Error finding container 382d9d01f2cbf6106df78818095c309d95c7d7d8ac676359d63e2238f019f596: Status 404 returned error can't find the container with id 382d9d01f2cbf6106df78818095c309d95c7d7d8ac676359d63e2238f019f596
Sep 16 12:20:17.598210 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:17.598063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498" event={"ID":"87e16b26-1853-4634-af3e-e99ef8276eb7","Type":"ContainerStarted","Data":"493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7"}
Sep 16 12:20:17.598210 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:17.598144    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:17.598210 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:17.598171    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498" event={"ID":"87e16b26-1853-4634-af3e-e99ef8276eb7","Type":"ContainerStarted","Data":"382d9d01f2cbf6106df78818095c309d95c7d7d8ac676359d63e2238f019f596"}
Sep 16 12:20:17.600490 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:17.600415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5" event={"ID":"c270dd46-7c44-47c9-b99c-17748434f2c5","Type":"ContainerStarted","Data":"fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a"}
Sep 16 12:20:17.600490 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:17.600464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5" event={"ID":"c270dd46-7c44-47c9-b99c-17748434f2c5","Type":"ContainerStarted","Data":"98bfc16a8f046e9155bcce01b00232b19f6ddb67d4a7400a190fc4f4791bf222"}
Sep 16 12:20:17.600673 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:17.600579    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:17.616703 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:17.616321    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498" podStartSLOduration=1.616303561 podStartE2EDuration="1.616303561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:17.616060363 +0000 UTC m=+1174.059095227" watchObservedRunningTime="2026-09-16 12:20:17.616303561 +0000 UTC m=+1174.059338423"
Sep 16 12:20:17.632943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:17.632889    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5" podStartSLOduration=1.632873768 podStartE2EDuration="1.632873768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:17.63052071 +0000 UTC m=+1174.073555572" watchObservedRunningTime="2026-09-16 12:20:17.632873768 +0000 UTC m=+1174.075908631"
Sep 16 12:20:19.614384 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:19.614290    2559 generic.go:356] "Generic (PLEG): container finished" podID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerID="280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c" exitCode=0
Sep 16 12:20:19.614889 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:19.614371    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" event={"ID":"8b03ca22-5465-49c6-bdc9-98553dd412ea","Type":"ContainerDied","Data":"280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c"}
Sep 16 12:20:19.614954 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:19.614927    2559 scope.go:117] "RemoveContainer" containerID="280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c"
Sep 16 12:20:19.616265 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:19.616234    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:19.616353 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:19.616306    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:19.616353 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:19.616338    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:20.621327 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.621292    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" event={"ID":"8b03ca22-5465-49c6-bdc9-98553dd412ea","Type":"ContainerStarted","Data":"ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be"}
Sep 16 12:20:20.622847 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.622818    2559 generic.go:356] "Generic (PLEG): container finished" podID="5eb220df-8108-4e59-846f-d70f288396c7" containerID="dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135" exitCode=0
Sep 16 12:20:20.622969 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.622888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" event={"ID":"5eb220df-8108-4e59-846f-d70f288396c7","Type":"ContainerDied","Data":"dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135"}
Sep 16 12:20:20.623227 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.623214    2559 scope.go:117] "RemoveContainer" containerID="dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135"
Sep 16 12:20:20.624277 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.624251    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:20.624333 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.624314    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:20.624368 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.624345    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:20.869281 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.869241    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:20:20.869478 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.869414    2559 patch_prober.go:28] interesting pod/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 12:20:20.869478 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:20.869457    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 12:20:21.630767 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:21.630730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" event={"ID":"5eb220df-8108-4e59-846f-d70f288396c7","Type":"ContainerStarted","Data":"bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538"}
Sep 16 12:20:21.868440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:21.868383    2559 patch_prober.go:28] interesting pod/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 12:20:21.868623 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:21.868456    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 12:20:21.971867 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:21.971744    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:20:21.972803 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:21.972774    2559 patch_prober.go:28] interesting pod/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 12:20:21.972986 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:21.972963    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 12:20:22.868424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:22.868380    2559 patch_prober.go:28] interesting pod/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 12:20:22.869067 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:22.869034    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 12:20:22.972131 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:22.972080    2559 patch_prober.go:28] interesting pod/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 12:20:22.972424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:22.972153    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 12:20:23.868409 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:23.868364    2559 patch_prober.go:28] interesting pod/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 12:20:23.868686 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:23.868661    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 12:20:23.971418 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:23.971372    2559 patch_prober.go:28] interesting pod/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 12:20:23.971620 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:23.971469    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 12:20:24.869322 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:24.869278    2559 patch_prober.go:28] interesting pod/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 12:20:24.869845 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:24.869346    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 12:20:24.971399 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:24.971345    2559 patch_prober.go:28] interesting pod/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 12:20:24.971709 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:24.971659    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 12:20:25.868655 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:25.868607    2559 patch_prober.go:28] interesting pod/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 12:20:25.868882 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:25.868708    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 12:20:25.972274 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:25.972226    2559 patch_prober.go:28] interesting pod/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 12:20:25.972799 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:25.972298    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 12:20:26.346070 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:26.346039    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:20:26.881311 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:26.881268    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:20:26.882247 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:26.882224    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:20:26.886473 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:26.886458    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:20:26.971324 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:26.971290    2559 patch_prober.go:28] interesting pod/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 12:20:26.971588 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:26.971558    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 12:20:27.976560 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:27.976528    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:20:27.977553 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:27.977535    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:20:28.608607 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:28.608581    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:20:28.608780 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:28.608646    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:20:28.832076 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:28.832046    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"]
Sep 16 12:20:28.832255 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:28.832230    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd" podUID="13e10ac4-0a88-4882-b5d1-16b6cdfe986d" containerName="payload-pre-processing" containerID="cri-o://69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda" gracePeriod=30
Sep 16 12:20:29.137553 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.137523    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"]
Sep 16 12:20:29.147027 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.146772    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:29.296900 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.296861    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-plugins-config-volume\") pod \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\" (UID: \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\") "
Sep 16 12:20:29.296900 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.296898    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v75g\" (UniqueName: \"kubernetes.io/projected/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-kube-api-access-9v75g\") pod \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\" (UID: \"13e10ac4-0a88-4882-b5d1-16b6cdfe986d\") "
Sep 16 12:20:29.297272 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.297245    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "13e10ac4-0a88-4882-b5d1-16b6cdfe986d" (UID: "13e10ac4-0a88-4882-b5d1-16b6cdfe986d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:20:29.299400 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.299376    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-kube-api-access-9v75g" (OuterVolumeSpecName: "kube-api-access-9v75g") pod "13e10ac4-0a88-4882-b5d1-16b6cdfe986d" (UID: "13e10ac4-0a88-4882-b5d1-16b6cdfe986d"). InnerVolumeSpecName "kube-api-access-9v75g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:29.397892 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.397866    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:29.397892 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.397890    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v75g\" (UniqueName: \"kubernetes.io/projected/13e10ac4-0a88-4882-b5d1-16b6cdfe986d-kube-api-access-9v75g\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:29.693224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.693138    2559 generic.go:356] "Generic (PLEG): container finished" podID="13e10ac4-0a88-4882-b5d1-16b6cdfe986d" containerID="69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda" exitCode=0
Sep 16 12:20:29.693224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.693188    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"
Sep 16 12:20:29.693424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.693219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd" event={"ID":"13e10ac4-0a88-4882-b5d1-16b6cdfe986d","Type":"ContainerDied","Data":"69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda"}
Sep 16 12:20:29.693424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.693294    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd" event={"ID":"13e10ac4-0a88-4882-b5d1-16b6cdfe986d","Type":"ContainerDied","Data":"d0b79c0c52365bd415d8b5d3f43b53febd05eb41f9d7d1897a79269f42487736"}
Sep 16 12:20:29.693424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.693318    2559 scope.go:117] "RemoveContainer" containerID="69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda"
Sep 16 12:20:29.693424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.693403    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy" containerID="cri-o://ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be" gracePeriod=30
Sep 16 12:20:29.704602 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.704580    2559 scope.go:117] "RemoveContainer" containerID="69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda"
Sep 16 12:20:29.705128 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:20:29.705032    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda\": container with ID starting with 69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda not found: ID does not exist" containerID="69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda"
Sep 16 12:20:29.705128 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.705071    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda"} err="failed to get container status \"69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda\": rpc error: code = NotFound desc = could not find container \"69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda\": container with ID starting with 69fb8cc71d5bfd2b7baa2339e1e77916f3551dd33a52c938681c424093901cda not found: ID does not exist"
Sep 16 12:20:29.816130 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.816100    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"]
Sep 16 12:20:29.821051 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:29.821028    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ce21877-7747f49bbb-l6bqd"]
Sep 16 12:20:30.031343 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:30.031256    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e10ac4-0a88-4882-b5d1-16b6cdfe986d" path="/var/lib/kubelet/pods/13e10ac4-0a88-4882-b5d1-16b6cdfe986d/volumes"
Sep 16 12:20:32.709828 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:32.709799    2559 generic.go:356] "Generic (PLEG): container finished" podID="02ff6e86-96bd-476a-b556-52ac3710372e" containerID="edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627" exitCode=0
Sep 16 12:20:32.710192 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:32.709874    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" event={"ID":"02ff6e86-96bd-476a-b556-52ac3710372e","Type":"ContainerDied","Data":"edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627"}
Sep 16 12:20:32.710261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:32.710245    2559 scope.go:117] "RemoveContainer" containerID="edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627"
Sep 16 12:20:32.711307 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:32.711278    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:32.711362 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:32.711347    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:32.711397 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:32.711385    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:20:33.717086 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:33.717052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" event={"ID":"02ff6e86-96bd-476a-b556-52ac3710372e","Type":"ContainerStarted","Data":"04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45"}
Sep 16 12:20:34.322679 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:34.322648    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:34.322855 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:34.322826    2559 patch_prober.go:28] interesting pod/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 12:20:34.322907 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:34.322868    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 12:20:35.015758 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.015729    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:20:35.085195 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.085166    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-envoy\") pod \"8b03ca22-5465-49c6-bdc9-98553dd412ea\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") "
Sep 16 12:20:35.085420 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.085406    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-socket\") pod \"8b03ca22-5465-49c6-bdc9-98553dd412ea\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") "
Sep 16 12:20:35.085718 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.085633    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b03ca22-5465-49c6-bdc9-98553dd412ea" (UID: "8b03ca22-5465-49c6-bdc9-98553dd412ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:35.085838 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.085687    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b03ca22-5465-49c6-bdc9-98553dd412ea-istiod-ca-cert\") pod \"8b03ca22-5465-49c6-bdc9-98553dd412ea\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") "
Sep 16 12:20:35.085918 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.085907    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ds4q\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-kube-api-access-5ds4q\") pod \"8b03ca22-5465-49c6-bdc9-98553dd412ea\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") "
Sep 16 12:20:35.086260 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.086246    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-credential-socket\") pod \"8b03ca22-5465-49c6-bdc9-98553dd412ea\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") "
Sep 16 12:20:35.086549 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.086539    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-certs\") pod \"8b03ca22-5465-49c6-bdc9-98553dd412ea\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") "
Sep 16 12:20:35.086792 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.086771    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-data\") pod \"8b03ca22-5465-49c6-bdc9-98553dd412ea\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") "
Sep 16 12:20:35.087004 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.086088    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b03ca22-5465-49c6-bdc9-98553dd412ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b03ca22-5465-49c6-bdc9-98553dd412ea" (UID: "8b03ca22-5465-49c6-bdc9-98553dd412ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:20:35.087113 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.086492    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b03ca22-5465-49c6-bdc9-98553dd412ea" (UID: "8b03ca22-5465-49c6-bdc9-98553dd412ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:35.087200 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.086919    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b03ca22-5465-49c6-bdc9-98553dd412ea" (UID: "8b03ca22-5465-49c6-bdc9-98553dd412ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:35.087283 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.086998    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b03ca22-5465-49c6-bdc9-98553dd412ea" (UID: "8b03ca22-5465-49c6-bdc9-98553dd412ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:35.087373 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.087307    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-podinfo\") pod \"8b03ca22-5465-49c6-bdc9-98553dd412ea\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") "
Sep 16 12:20:35.087478 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.087464    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-token\") pod \"8b03ca22-5465-49c6-bdc9-98553dd412ea\" (UID: \"8b03ca22-5465-49c6-bdc9-98553dd412ea\") "
Sep 16 12:20:35.087542 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.087398    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b03ca22-5465-49c6-bdc9-98553dd412ea" (UID: "8b03ca22-5465-49c6-bdc9-98553dd412ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:35.087918 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.087894    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:35.088016 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.087922    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-data\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:35.088016 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.087935    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-envoy\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:35.088016 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.087946    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-workload-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:35.088016 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.087957    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b03ca22-5465-49c6-bdc9-98553dd412ea-istiod-ca-cert\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:35.088016 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.087969    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b03ca22-5465-49c6-bdc9-98553dd412ea-credential-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:35.088639 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.088613    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-kube-api-access-5ds4q" (OuterVolumeSpecName: "kube-api-access-5ds4q") pod "8b03ca22-5465-49c6-bdc9-98553dd412ea" (UID: "8b03ca22-5465-49c6-bdc9-98553dd412ea"). InnerVolumeSpecName "kube-api-access-5ds4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:35.089743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.089723    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b03ca22-5465-49c6-bdc9-98553dd412ea" (UID: "8b03ca22-5465-49c6-bdc9-98553dd412ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:20:35.089989 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.089964    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b03ca22-5465-49c6-bdc9-98553dd412ea" (UID: "8b03ca22-5465-49c6-bdc9-98553dd412ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:35.188712 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.188669    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-podinfo\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:35.188712 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.188718    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-istio-token\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:35.188905 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.188734    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ds4q\" (UniqueName: \"kubernetes.io/projected/8b03ca22-5465-49c6-bdc9-98553dd412ea-kube-api-access-5ds4q\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:20:35.322300 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.322220    2559 patch_prober.go:28] interesting pod/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 12:20:35.322300 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.322276    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 12:20:35.603159 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.603083    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"]
Sep 16 12:20:35.603533 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.603521    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy"
Sep 16 12:20:35.603576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.603535    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy"
Sep 16 12:20:35.603576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.603556    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy"
Sep 16 12:20:35.603576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.603561    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy"
Sep 16 12:20:35.603576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.603569    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e10ac4-0a88-4882-b5d1-16b6cdfe986d" containerName="payload-pre-processing"
Sep 16 12:20:35.603576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.603575    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e10ac4-0a88-4882-b5d1-16b6cdfe986d" containerName="payload-pre-processing"
Sep 16 12:20:35.603746 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.603652    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy"
Sep 16 12:20:35.603746 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.603663    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="13e10ac4-0a88-4882-b5d1-16b6cdfe986d" containerName="payload-pre-processing"
Sep 16 12:20:35.605956 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.605936    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:20:35.608689 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.608663    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-b6f4a170\""
Sep 16 12:20:35.608828 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.608761    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-b6f4a170-dockercfg-6fd2c\""
Sep 16 12:20:35.617481 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.617459    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"]
Sep 16 12:20:35.650714 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.647689    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"]
Sep 16 12:20:35.650714 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.648432    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerName="istio-proxy"
Sep 16 12:20:35.669716 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.660368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:35.669716 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.664601    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"]
Sep 16 12:20:35.693982 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.693775    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b62e0dbb-d554-4a9d-a96d-25757a380b9f-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt\" (UID: \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\") " pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:35.693982 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.693843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59b9205a-a90f-4df2-b86d-8e10488090a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr\" (UID: \"59b9205a-a90f-4df2-b86d-8e10488090a8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:20:35.693982 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.693901    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk5mk\" (UniqueName: \"kubernetes.io/projected/b62e0dbb-d554-4a9d-a96d-25757a380b9f-kube-api-access-dk5mk\") pod \"payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt\" (UID: \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\") " pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:35.694164 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.693985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlhgg\" (UniqueName: \"kubernetes.io/projected/59b9205a-a90f-4df2-b86d-8e10488090a8-kube-api-access-rlhgg\") pod \"payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr\" (UID: \"59b9205a-a90f-4df2-b86d-8e10488090a8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:20:35.734720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.733131    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"
Sep 16 12:20:35.734720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.733185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" event={"ID":"8b03ca22-5465-49c6-bdc9-98553dd412ea","Type":"ContainerDied","Data":"ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be"}
Sep 16 12:20:35.734720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.733259    2559 scope.go:117] "RemoveContainer" containerID="ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be"
Sep 16 12:20:35.734720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.732879    2559 generic.go:356] "Generic (PLEG): container finished" podID="8b03ca22-5465-49c6-bdc9-98553dd412ea" containerID="ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be" exitCode=0
Sep 16 12:20:35.734720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.734662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5" event={"ID":"8b03ca22-5465-49c6-bdc9-98553dd412ea","Type":"ContainerDied","Data":"6b220045f5ecc1313f541f0fe0c48a491eb44a8a5f37cbf935a5a3ab858d3dd8"}
Sep 16 12:20:35.774947 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.763358    2559 scope.go:117] "RemoveContainer" containerID="280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c"
Sep 16 12:20:35.791749 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.790760    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"]
Sep 16 12:20:35.791749 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.790902    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1ce21877-openshift-default-cf7d965b4-48fw5"]
Sep 16 12:20:35.792536 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.792515    2559 scope.go:117] "RemoveContainer" containerID="ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be"
Sep 16 12:20:35.793030 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:20:35.793010    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be\": container with ID starting with ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be not found: ID does not exist" containerID="ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be"
Sep 16 12:20:35.793108 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.793037    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be"} err="failed to get container status \"ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be\": rpc error: code = NotFound desc = could not find container \"ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be\": container with ID starting with ed326dba4fc515b935d5b68f30208ee958712f36360b916e090405c701bcc8be not found: ID does not exist"
Sep 16 12:20:35.793108 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.793056    2559 scope.go:117] "RemoveContainer" containerID="280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c"
Sep 16 12:20:35.793376 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:20:35.793356    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c\": container with ID starting with 280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c not found: ID does not exist" containerID="280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c"
Sep 16 12:20:35.793430 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.793384    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c"} err="failed to get container status \"280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c\": rpc error: code = NotFound desc = could not find container \"280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c\": container with ID starting with 280ddaac0d04fe08870178ceea70c7035b090cccb2d0d6ccc4aff407efa2584c not found: ID does not exist"
Sep 16 12:20:35.794794 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.794772    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59b9205a-a90f-4df2-b86d-8e10488090a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr\" (UID: \"59b9205a-a90f-4df2-b86d-8e10488090a8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:20:35.794923 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.794909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk5mk\" (UniqueName: \"kubernetes.io/projected/b62e0dbb-d554-4a9d-a96d-25757a380b9f-kube-api-access-dk5mk\") pod \"payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt\" (UID: \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\") " pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:35.795106 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.795089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlhgg\" (UniqueName: \"kubernetes.io/projected/59b9205a-a90f-4df2-b86d-8e10488090a8-kube-api-access-rlhgg\") pod \"payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr\" (UID: \"59b9205a-a90f-4df2-b86d-8e10488090a8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:20:35.795259 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.795246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b62e0dbb-d554-4a9d-a96d-25757a380b9f-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt\" (UID: \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\") " pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:35.795436 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.795419    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59b9205a-a90f-4df2-b86d-8e10488090a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr\" (UID: \"59b9205a-a90f-4df2-b86d-8e10488090a8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:20:35.795919 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.795903    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b62e0dbb-d554-4a9d-a96d-25757a380b9f-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt\" (UID: \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\") " pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:35.803050 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.803034    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk5mk\" (UniqueName: \"kubernetes.io/projected/b62e0dbb-d554-4a9d-a96d-25757a380b9f-kube-api-access-dk5mk\") pod \"payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt\" (UID: \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\") " pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:35.803154 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.803043    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlhgg\" (UniqueName: \"kubernetes.io/projected/59b9205a-a90f-4df2-b86d-8e10488090a8-kube-api-access-rlhgg\") pod \"payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr\" (UID: \"59b9205a-a90f-4df2-b86d-8e10488090a8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:20:35.917497 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.917462    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:20:35.985171 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:35.985140    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:36.033220 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.033183    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b03ca22-5465-49c6-bdc9-98553dd412ea" path="/var/lib/kubelet/pods/8b03ca22-5465-49c6-bdc9-98553dd412ea/volumes"
Sep 16 12:20:36.214534 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.214506    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"]
Sep 16 12:20:36.295722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.295669    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"]
Sep 16 12:20:36.297915 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:20:36.297498    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62e0dbb_d554_4a9d_a96d_25757a380b9f.slice/crio-86676e3feee17b27dd878e83473286c270be1484403baf28512c0aa95c1fd21a WatchSource:0}: Error finding container 86676e3feee17b27dd878e83473286c270be1484403baf28512c0aa95c1fd21a: Status 404 returned error can't find the container with id 86676e3feee17b27dd878e83473286c270be1484403baf28512c0aa95c1fd21a
Sep 16 12:20:36.322289 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.322264    2559 patch_prober.go:28] interesting pod/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 12:20:36.322365 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.322321    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 12:20:36.743512 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.743478    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr" event={"ID":"59b9205a-a90f-4df2-b86d-8e10488090a8","Type":"ContainerStarted","Data":"58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e"}
Sep 16 12:20:36.743669 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.743529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr" event={"ID":"59b9205a-a90f-4df2-b86d-8e10488090a8","Type":"ContainerStarted","Data":"43f332114165779a259c6e8fc05d756230f338ec090eaab5abaa141de45dffb0"}
Sep 16 12:20:36.744103 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.744087    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:20:36.745771 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.745748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt" event={"ID":"b62e0dbb-d554-4a9d-a96d-25757a380b9f","Type":"ContainerStarted","Data":"ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c"}
Sep 16 12:20:36.745890 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.745799    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:36.745890 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.745823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt" event={"ID":"b62e0dbb-d554-4a9d-a96d-25757a380b9f","Type":"ContainerStarted","Data":"86676e3feee17b27dd878e83473286c270be1484403baf28512c0aa95c1fd21a"}
Sep 16 12:20:36.767200 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.767143    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr" podStartSLOduration=1.7671264770000001 podStartE2EDuration="1.767126477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:36.763796191 +0000 UTC m=+1193.206831058" watchObservedRunningTime="2026-09-16 12:20:36.767126477 +0000 UTC m=+1193.210161340"
Sep 16 12:20:36.790981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:36.790931    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt" podStartSLOduration=1.790913641 podStartE2EDuration="1.790913641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:36.787906052 +0000 UTC m=+1193.230940914" watchObservedRunningTime="2026-09-16 12:20:36.790913641 +0000 UTC m=+1193.233948505"
Sep 16 12:20:37.327625 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:37.327586    2559 patch_prober.go:28] interesting pod/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 12:20:37.328466 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:37.328215    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 12:20:38.322027 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:38.321987    2559 patch_prober.go:28] interesting pod/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 12:20:38.322212 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:38.322057    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 12:20:39.326721 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:39.326667    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:39.327135 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:39.326969    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:39.327670 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:39.327651    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:20:47.756821 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:47.756791    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:20:48.761830 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:20:48.761804    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:21:04.176195 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.176157    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"]
Sep 16 12:21:04.177133 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.177094    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt" podUID="b62e0dbb-d554-4a9d-a96d-25757a380b9f" containerName="payload-processing" containerID="cri-o://ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c" gracePeriod=30
Sep 16 12:21:04.180234 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.180207    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"]
Sep 16 12:21:04.181400 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.181105    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr" podUID="59b9205a-a90f-4df2-b86d-8e10488090a8" containerName="payload-pre-processing" containerID="cri-o://58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e" gracePeriod=30
Sep 16 12:21:04.480768 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.480744    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:21:04.507406 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.507386    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:21:04.651377 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.651341    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59b9205a-a90f-4df2-b86d-8e10488090a8-plugins-config-volume\") pod \"59b9205a-a90f-4df2-b86d-8e10488090a8\" (UID: \"59b9205a-a90f-4df2-b86d-8e10488090a8\") "
Sep 16 12:21:04.651561 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.651411    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk5mk\" (UniqueName: \"kubernetes.io/projected/b62e0dbb-d554-4a9d-a96d-25757a380b9f-kube-api-access-dk5mk\") pod \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\" (UID: \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\") "
Sep 16 12:21:04.651561 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.651457    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b62e0dbb-d554-4a9d-a96d-25757a380b9f-plugins-config-volume\") pod \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\" (UID: \"b62e0dbb-d554-4a9d-a96d-25757a380b9f\") "
Sep 16 12:21:04.651561 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.651478    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlhgg\" (UniqueName: \"kubernetes.io/projected/59b9205a-a90f-4df2-b86d-8e10488090a8-kube-api-access-rlhgg\") pod \"59b9205a-a90f-4df2-b86d-8e10488090a8\" (UID: \"59b9205a-a90f-4df2-b86d-8e10488090a8\") "
Sep 16 12:21:04.651812 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.651782    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59b9205a-a90f-4df2-b86d-8e10488090a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "59b9205a-a90f-4df2-b86d-8e10488090a8" (UID: "59b9205a-a90f-4df2-b86d-8e10488090a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:21:04.651894 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.651865    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b62e0dbb-d554-4a9d-a96d-25757a380b9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b62e0dbb-d554-4a9d-a96d-25757a380b9f" (UID: "b62e0dbb-d554-4a9d-a96d-25757a380b9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:21:04.651942 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.651922    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59b9205a-a90f-4df2-b86d-8e10488090a8-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:04.653846 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.653815    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b62e0dbb-d554-4a9d-a96d-25757a380b9f-kube-api-access-dk5mk" (OuterVolumeSpecName: "kube-api-access-dk5mk") pod "b62e0dbb-d554-4a9d-a96d-25757a380b9f" (UID: "b62e0dbb-d554-4a9d-a96d-25757a380b9f"). InnerVolumeSpecName "kube-api-access-dk5mk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:04.653951 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.653858    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59b9205a-a90f-4df2-b86d-8e10488090a8-kube-api-access-rlhgg" (OuterVolumeSpecName: "kube-api-access-rlhgg") pod "59b9205a-a90f-4df2-b86d-8e10488090a8" (UID: "59b9205a-a90f-4df2-b86d-8e10488090a8"). InnerVolumeSpecName "kube-api-access-rlhgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:04.752785 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.752724    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk5mk\" (UniqueName: \"kubernetes.io/projected/b62e0dbb-d554-4a9d-a96d-25757a380b9f-kube-api-access-dk5mk\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:04.752785 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.752745    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b62e0dbb-d554-4a9d-a96d-25757a380b9f-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:04.752785 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.752754    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlhgg\" (UniqueName: \"kubernetes.io/projected/59b9205a-a90f-4df2-b86d-8e10488090a8-kube-api-access-rlhgg\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:04.908400 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.908360    2559 generic.go:356] "Generic (PLEG): container finished" podID="59b9205a-a90f-4df2-b86d-8e10488090a8" containerID="58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e" exitCode=0
Sep 16 12:21:04.908576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.908421    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"
Sep 16 12:21:04.908576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.908447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr" event={"ID":"59b9205a-a90f-4df2-b86d-8e10488090a8","Type":"ContainerDied","Data":"58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e"}
Sep 16 12:21:04.908576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.908518    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr" event={"ID":"59b9205a-a90f-4df2-b86d-8e10488090a8","Type":"ContainerDied","Data":"43f332114165779a259c6e8fc05d756230f338ec090eaab5abaa141de45dffb0"}
Sep 16 12:21:04.908576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.908554    2559 scope.go:117] "RemoveContainer" containerID="58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e"
Sep 16 12:21:04.909786 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.909768    2559 generic.go:356] "Generic (PLEG): container finished" podID="b62e0dbb-d554-4a9d-a96d-25757a380b9f" containerID="ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c" exitCode=0
Sep 16 12:21:04.909872 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.909793    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt" event={"ID":"b62e0dbb-d554-4a9d-a96d-25757a380b9f","Type":"ContainerDied","Data":"ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c"}
Sep 16 12:21:04.909872 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.909828    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"
Sep 16 12:21:04.909872 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.909846    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt" event={"ID":"b62e0dbb-d554-4a9d-a96d-25757a380b9f","Type":"ContainerDied","Data":"86676e3feee17b27dd878e83473286c270be1484403baf28512c0aa95c1fd21a"}
Sep 16 12:21:04.919246 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.919224    2559 scope.go:117] "RemoveContainer" containerID="58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e"
Sep 16 12:21:04.919561 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:21:04.919514    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e\": container with ID starting with 58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e not found: ID does not exist" containerID="58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e"
Sep 16 12:21:04.919561 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.919543    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e"} err="failed to get container status \"58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e\": rpc error: code = NotFound desc = could not find container \"58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e\": container with ID starting with 58f1ebf88c1e3fc53b6abe1924692ff6dead998ce5e7e56d34d13c8209f7946e not found: ID does not exist"
Sep 16 12:21:04.919714 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.919566    2559 scope.go:117] "RemoveContainer" containerID="ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c"
Sep 16 12:21:04.930109 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.930091    2559 scope.go:117] "RemoveContainer" containerID="ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c"
Sep 16 12:21:04.930379 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:21:04.930361    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c\": container with ID starting with ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c not found: ID does not exist" containerID="ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c"
Sep 16 12:21:04.930424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.930385    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c"} err="failed to get container status \"ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c\": rpc error: code = NotFound desc = could not find container \"ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c\": container with ID starting with ccf899a7e3c1fb7cd4598727ef07237b8d88eb235c967b5f7cbe100e6063383c not found: ID does not exist"
Sep 16 12:21:04.931907 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.931886    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"]
Sep 16 12:21:04.935578 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.935558    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6f4a170-5cbf7569fd-k2zbr"]
Sep 16 12:21:04.945598 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.945578    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"]
Sep 16 12:21:04.949521 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:04.949501    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b6f4a170-644cd88d94-49ttt"]
Sep 16 12:21:05.196961 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.196934    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"]
Sep 16 12:21:05.197450 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.197433    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b9205a-a90f-4df2-b86d-8e10488090a8" containerName="payload-pre-processing"
Sep 16 12:21:05.197497 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.197452    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b9205a-a90f-4df2-b86d-8e10488090a8" containerName="payload-pre-processing"
Sep 16 12:21:05.197497 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.197480    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b62e0dbb-d554-4a9d-a96d-25757a380b9f" containerName="payload-processing"
Sep 16 12:21:05.197497 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.197486    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b62e0dbb-d554-4a9d-a96d-25757a380b9f" containerName="payload-processing"
Sep 16 12:21:05.197596 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.197550    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b9205a-a90f-4df2-b86d-8e10488090a8" containerName="payload-pre-processing"
Sep 16 12:21:05.197596 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.197562    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b62e0dbb-d554-4a9d-a96d-25757a380b9f" containerName="payload-processing"
Sep 16 12:21:05.200446 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.200429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.202963 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.202945    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f6101af5-openshift-default-dockercfg-k5n4t\""
Sep 16 12:21:05.211839 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.211763    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"]
Sep 16 12:21:05.358333 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.358298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-socket\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.358333 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.358335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-credential-socket\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.358548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.358397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-data\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.358548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.358436    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istiod-ca-cert\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.358548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.358473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-token\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.358677 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.358571    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-envoy\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.358677 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.358630    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-certs\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.358677 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.358664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b7xb\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-kube-api-access-2b7xb\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.358808 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.358790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-podinfo\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.459904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.459826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-data\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.459904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.459859    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istiod-ca-cert\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.459904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.459891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-token\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460149 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.459948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-envoy\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460149 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.459991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-certs\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460149 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.460017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b7xb\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-kube-api-access-2b7xb\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460149 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.460108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-podinfo\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460358 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.460176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-socket\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460358 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.460203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-credential-socket\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460685 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.460661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istiod-ca-cert\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460858 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.460832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-certs\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460970 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.460872    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-socket\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.460970 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.460927    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-credential-socket\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.461048 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.460997    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-data\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.462627 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.462606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-envoy\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.462730 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.462606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-podinfo\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.468414 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.468383    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b7xb\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-kube-api-access-2b7xb\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.468511 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.468495    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-token\") pod \"e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") " pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.511472 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.511429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:05.813114 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.813089    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"]
Sep 16 12:21:05.814709 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:21:05.814669    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d85b684_da1d_4a5a_a950_1d8dfe6eeca5.slice/crio-21b9693afe0ba980da54acfe1419a5babce82c6a61f4e44ef23285561cc709f2 WatchSource:0}: Error finding container 21b9693afe0ba980da54acfe1419a5babce82c6a61f4e44ef23285561cc709f2: Status 404 returned error can't find the container with id 21b9693afe0ba980da54acfe1419a5babce82c6a61f4e44ef23285561cc709f2
Sep 16 12:21:05.816843 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.816811    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:21:05.817172 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.816884    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:21:05.817172 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.816927    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:21:05.920211 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.920182    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" event={"ID":"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5","Type":"ContainerStarted","Data":"d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d"}
Sep 16 12:21:05.920354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.920229    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" event={"ID":"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5","Type":"ContainerStarted","Data":"21b9693afe0ba980da54acfe1419a5babce82c6a61f4e44ef23285561cc709f2"}
Sep 16 12:21:05.942976 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:05.942917    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" podStartSLOduration=0.942896981 podStartE2EDuration="942.896981ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:05.94180627 +0000 UTC m=+1222.384841150" watchObservedRunningTime="2026-09-16 12:21:05.942896981 +0000 UTC m=+1222.385931844"
Sep 16 12:21:06.030856 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:06.030828    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59b9205a-a90f-4df2-b86d-8e10488090a8" path="/var/lib/kubelet/pods/59b9205a-a90f-4df2-b86d-8e10488090a8/volumes"
Sep 16 12:21:06.031207 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:06.031194    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b62e0dbb-d554-4a9d-a96d-25757a380b9f" path="/var/lib/kubelet/pods/b62e0dbb-d554-4a9d-a96d-25757a380b9f/volumes"
Sep 16 12:21:06.512017 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:06.511979    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:06.517315 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:06.517292    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:06.928206 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:06.928105    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:06.932559 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:06.932533    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:10.275919 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.275889    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"]
Sep 16 12:21:10.279069 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.279052    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:10.281562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.281546    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f6101af5-dockercfg-rm49v\""
Sep 16 12:21:10.281664 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.281597    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f6101af5\""
Sep 16 12:21:10.289352 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.289320    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"]
Sep 16 12:21:10.373571 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.373535    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"]
Sep 16 12:21:10.379320 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.379286    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:10.395873 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.395844    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"]
Sep 16 12:21:10.408315 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.408289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r\" (UID: \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:10.408448 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.408325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzsvv\" (UniqueName: \"kubernetes.io/projected/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-kube-api-access-gzsvv\") pod \"payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r\" (UID: \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:10.509863 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.509833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r\" (UID: \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:10.510013 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.509873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzsvv\" (UniqueName: \"kubernetes.io/projected/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-kube-api-access-gzsvv\") pod \"payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r\" (UID: \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:10.510013 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.509929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lkr8\" (UniqueName: \"kubernetes.io/projected/95e37b52-cdef-48a5-8df1-7075036dc9cc-kube-api-access-8lkr8\") pod \"payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh\" (UID: \"95e37b52-cdef-48a5-8df1-7075036dc9cc\") " pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:10.510013 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.509955    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95e37b52-cdef-48a5-8df1-7075036dc9cc-plugins-config-volume\") pod \"payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh\" (UID: \"95e37b52-cdef-48a5-8df1-7075036dc9cc\") " pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:10.510515 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.510492    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r\" (UID: \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:10.518008 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.517987    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzsvv\" (UniqueName: \"kubernetes.io/projected/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-kube-api-access-gzsvv\") pod \"payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r\" (UID: \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:10.592005 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.591929    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:10.611235 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.611205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lkr8\" (UniqueName: \"kubernetes.io/projected/95e37b52-cdef-48a5-8df1-7075036dc9cc-kube-api-access-8lkr8\") pod \"payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh\" (UID: \"95e37b52-cdef-48a5-8df1-7075036dc9cc\") " pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:10.611378 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.611251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95e37b52-cdef-48a5-8df1-7075036dc9cc-plugins-config-volume\") pod \"payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh\" (UID: \"95e37b52-cdef-48a5-8df1-7075036dc9cc\") " pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:10.611949 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.611925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95e37b52-cdef-48a5-8df1-7075036dc9cc-plugins-config-volume\") pod \"payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh\" (UID: \"95e37b52-cdef-48a5-8df1-7075036dc9cc\") " pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:10.632492 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.632459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lkr8\" (UniqueName: \"kubernetes.io/projected/95e37b52-cdef-48a5-8df1-7075036dc9cc-kube-api-access-8lkr8\") pod \"payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh\" (UID: \"95e37b52-cdef-48a5-8df1-7075036dc9cc\") " pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:10.695517 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.695485    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:10.875755 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.875723    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"]
Sep 16 12:21:10.876782 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:21:10.876757    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7ca9e9_9f19_4a75_8958_8aa06e3d0d5b.slice/crio-1503919f979b5534dd285fd792e39b53c26da72a98440c5df5d66c982cc88133 WatchSource:0}: Error finding container 1503919f979b5534dd285fd792e39b53c26da72a98440c5df5d66c982cc88133: Status 404 returned error can't find the container with id 1503919f979b5534dd285fd792e39b53c26da72a98440c5df5d66c982cc88133
Sep 16 12:21:10.950617 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.950592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r" event={"ID":"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b","Type":"ContainerStarted","Data":"b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297"}
Sep 16 12:21:10.950743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.950649    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r" event={"ID":"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b","Type":"ContainerStarted","Data":"1503919f979b5534dd285fd792e39b53c26da72a98440c5df5d66c982cc88133"}
Sep 16 12:21:10.950743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.950732    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:10.968198 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.968121    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"]
Sep 16 12:21:10.969041 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:10.968999    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r" podStartSLOduration=0.968983213 podStartE2EDuration="968.983213ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:10.968365746 +0000 UTC m=+1227.411400610" watchObservedRunningTime="2026-09-16 12:21:10.968983213 +0000 UTC m=+1227.412018075"
Sep 16 12:21:10.969553 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:21:10.969526    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e37b52_cdef_48a5_8df1_7075036dc9cc.slice/crio-72487ba6ec81960f81590040db0f711a45ade63ba30b34763037cacd9a9f5388 WatchSource:0}: Error finding container 72487ba6ec81960f81590040db0f711a45ade63ba30b34763037cacd9a9f5388: Status 404 returned error can't find the container with id 72487ba6ec81960f81590040db0f711a45ade63ba30b34763037cacd9a9f5388
Sep 16 12:21:11.959025 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:11.958993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh" event={"ID":"95e37b52-cdef-48a5-8df1-7075036dc9cc","Type":"ContainerStarted","Data":"8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37"}
Sep 16 12:21:11.959422 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:11.959084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh" event={"ID":"95e37b52-cdef-48a5-8df1-7075036dc9cc","Type":"ContainerStarted","Data":"72487ba6ec81960f81590040db0f711a45ade63ba30b34763037cacd9a9f5388"}
Sep 16 12:21:11.959422 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:11.959231    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:11.981109 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:11.981063    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh" podStartSLOduration=1.9810509619999999 podStartE2EDuration="1.981050962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:11.978575554 +0000 UTC m=+1228.421610418" watchObservedRunningTime="2026-09-16 12:21:11.981050962 +0000 UTC m=+1228.424085824"
Sep 16 12:21:21.962943 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:21.962904    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:22.967893 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:22.967860    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:30.063872 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:30.063842    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerID="d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d" exitCode=0
Sep 16 12:21:30.064260 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:30.063883    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" event={"ID":"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5","Type":"ContainerDied","Data":"d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d"}
Sep 16 12:21:30.064306 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:30.064289    2559 scope.go:117] "RemoveContainer" containerID="d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d"
Sep 16 12:21:30.065381 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:30.065353    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:21:30.065452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:30.065422    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:21:30.065491 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:30.065452    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 16 12:21:31.075194 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:31.075149    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" event={"ID":"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5","Type":"ContainerStarted","Data":"4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638"}
Sep 16 12:21:31.511763 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:31.511729    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:31.511937 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:31.511917    2559 patch_prober.go:28] interesting pod/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:21:31.512023 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:31.511976    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:21:32.512147 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:32.512111    2559 patch_prober.go:28] interesting pod/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:21:32.512535 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:32.512192    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:21:33.511811 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:33.511778    2559 patch_prober.go:28] interesting pod/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:21:33.511968 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:33.511832    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:21:34.512494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:34.512456    2559 patch_prober.go:28] interesting pod/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:21:34.513019 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:34.512531    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:21:35.512173 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:35.512137    2559 patch_prober.go:28] interesting pod/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:21:35.512421 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:35.512199    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:21:36.516079 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:36.515998    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:36.516538 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:36.516339    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:36.517059 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:36.517036    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:39.254429 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.254397    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"]
Sep 16 12:21:39.254911 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.254632    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh" podUID="95e37b52-cdef-48a5-8df1-7075036dc9cc" containerName="payload-processing" containerID="cri-o://8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37" gracePeriod=30
Sep 16 12:21:39.263482 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.263453    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"]
Sep 16 12:21:39.263764 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.263690    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r" podUID="2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b" containerName="payload-pre-processing" containerID="cri-o://b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297" gracePeriod=30
Sep 16 12:21:39.514632 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.514576    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:39.549829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.549803    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:39.571407 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.571380    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lkr8\" (UniqueName: \"kubernetes.io/projected/95e37b52-cdef-48a5-8df1-7075036dc9cc-kube-api-access-8lkr8\") pod \"95e37b52-cdef-48a5-8df1-7075036dc9cc\" (UID: \"95e37b52-cdef-48a5-8df1-7075036dc9cc\") "
Sep 16 12:21:39.571538 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.571513    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-plugins-config-volume\") pod \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\" (UID: \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\") "
Sep 16 12:21:39.571597 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.571552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzsvv\" (UniqueName: \"kubernetes.io/projected/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-kube-api-access-gzsvv\") pod \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\" (UID: \"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b\") "
Sep 16 12:21:39.571597 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.571591    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95e37b52-cdef-48a5-8df1-7075036dc9cc-plugins-config-volume\") pod \"95e37b52-cdef-48a5-8df1-7075036dc9cc\" (UID: \"95e37b52-cdef-48a5-8df1-7075036dc9cc\") "
Sep 16 12:21:39.572138 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.572099    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b" (UID: "2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:21:39.572264 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.572225    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e37b52-cdef-48a5-8df1-7075036dc9cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95e37b52-cdef-48a5-8df1-7075036dc9cc" (UID: "95e37b52-cdef-48a5-8df1-7075036dc9cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:21:39.573846 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.573824    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e37b52-cdef-48a5-8df1-7075036dc9cc-kube-api-access-8lkr8" (OuterVolumeSpecName: "kube-api-access-8lkr8") pod "95e37b52-cdef-48a5-8df1-7075036dc9cc" (UID: "95e37b52-cdef-48a5-8df1-7075036dc9cc"). InnerVolumeSpecName "kube-api-access-8lkr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:39.573930 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.573897    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-kube-api-access-gzsvv" (OuterVolumeSpecName: "kube-api-access-gzsvv") pod "2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b" (UID: "2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b"). InnerVolumeSpecName "kube-api-access-gzsvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:39.672813 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.672780    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:39.672813 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.672809    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzsvv\" (UniqueName: \"kubernetes.io/projected/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b-kube-api-access-gzsvv\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:39.672813 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.672819    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95e37b52-cdef-48a5-8df1-7075036dc9cc-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:39.673042 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:39.672827    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lkr8\" (UniqueName: \"kubernetes.io/projected/95e37b52-cdef-48a5-8df1-7075036dc9cc-kube-api-access-8lkr8\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:40.124485 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.124451    2559 generic.go:356] "Generic (PLEG): container finished" podID="2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b" containerID="b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297" exitCode=0
Sep 16 12:21:40.124611 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.124492    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"
Sep 16 12:21:40.124611 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.124532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r" event={"ID":"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b","Type":"ContainerDied","Data":"b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297"}
Sep 16 12:21:40.124611 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.124591    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r" event={"ID":"2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b","Type":"ContainerDied","Data":"1503919f979b5534dd285fd792e39b53c26da72a98440c5df5d66c982cc88133"}
Sep 16 12:21:40.124754 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.124614    2559 scope.go:117] "RemoveContainer" containerID="b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297"
Sep 16 12:21:40.125991 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.125973    2559 generic.go:356] "Generic (PLEG): container finished" podID="95e37b52-cdef-48a5-8df1-7075036dc9cc" containerID="8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37" exitCode=0
Sep 16 12:21:40.126076 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.126020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh" event={"ID":"95e37b52-cdef-48a5-8df1-7075036dc9cc","Type":"ContainerDied","Data":"8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37"}
Sep 16 12:21:40.126076 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.126040    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"
Sep 16 12:21:40.126076 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.126064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh" event={"ID":"95e37b52-cdef-48a5-8df1-7075036dc9cc","Type":"ContainerDied","Data":"72487ba6ec81960f81590040db0f711a45ade63ba30b34763037cacd9a9f5388"}
Sep 16 12:21:40.133504 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.133489    2559 scope.go:117] "RemoveContainer" containerID="b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297"
Sep 16 12:21:40.133770 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:21:40.133748    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297\": container with ID starting with b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297 not found: ID does not exist" containerID="b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297"
Sep 16 12:21:40.133852 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.133821    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297"} err="failed to get container status \"b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297\": rpc error: code = NotFound desc = could not find container \"b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297\": container with ID starting with b8f6f25c950d9f5698072ec494689e624412ef85540afad8e195ca14684d5297 not found: ID does not exist"
Sep 16 12:21:40.133852 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.133846    2559 scope.go:117] "RemoveContainer" containerID="8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37"
Sep 16 12:21:40.141493 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.141471    2559 scope.go:117] "RemoveContainer" containerID="8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37"
Sep 16 12:21:40.141917 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:21:40.141894    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37\": container with ID starting with 8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37 not found: ID does not exist" containerID="8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37"
Sep 16 12:21:40.142011 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.141924    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37"} err="failed to get container status \"8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37\": rpc error: code = NotFound desc = could not find container \"8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37\": container with ID starting with 8a38392f22e8d5c9f50fb031e628029077c1949796ac01926e1a1c18def91c37 not found: ID does not exist"
Sep 16 12:21:40.144542 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.144522    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"]
Sep 16 12:21:40.146610 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.146590    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f6101af5-59bcdb547d-ggt5r"]
Sep 16 12:21:40.156356 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.156336    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"]
Sep 16 12:21:40.159427 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.159407    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f6101af5-6494486cc9-9jlkh"]
Sep 16 12:21:40.687644 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.687614    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"]
Sep 16 12:21:40.688079 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:40.687836    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy" containerID="cri-o://4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638" gracePeriod=30
Sep 16 12:21:42.031403 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:42.031363    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b" path="/var/lib/kubelet/pods/2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b/volumes"
Sep 16 12:21:42.031942 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:42.031921    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e37b52-cdef-48a5-8df1-7075036dc9cc" path="/var/lib/kubelet/pods/95e37b52-cdef-48a5-8df1-7075036dc9cc/volumes"
Sep 16 12:21:45.948915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:45.948850    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:46.032845 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.032820    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-token\") pod \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") "
Sep 16 12:21:46.032974 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.032865    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-credential-socket\") pod \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") "
Sep 16 12:21:46.032974 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.032898    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-podinfo\") pod \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") "
Sep 16 12:21:46.032974 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.032955    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-certs\") pod \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") "
Sep 16 12:21:46.033082 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033029    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-socket\") pod \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") "
Sep 16 12:21:46.033082 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033065    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b7xb\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-kube-api-access-2b7xb\") pod \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") "
Sep 16 12:21:46.033163 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033116    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-envoy\") pod \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") "
Sep 16 12:21:46.033163 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033153    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-data\") pod \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") "
Sep 16 12:21:46.033336 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033183    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istiod-ca-cert\") pod \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\" (UID: \"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5\") "
Sep 16 12:21:46.033336 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033201    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" (UID: "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:46.033336 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033224    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" (UID: "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:46.033509 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033407    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" (UID: "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:46.033571 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033552    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-data\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:46.033634 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033573    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-credential-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:46.033634 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033587    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:46.033748 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033656    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" (UID: "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:21:46.033748 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.033349    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" (UID: "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:46.035064 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.035038    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" (UID: "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:46.035178 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.035139    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" (UID: "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:21:46.035239 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.035220    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-kube-api-access-2b7xb" (OuterVolumeSpecName: "kube-api-access-2b7xb") pod "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" (UID: "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5"). InnerVolumeSpecName "kube-api-access-2b7xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:46.035328 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.035308    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" (UID: "9d85b684-da1d-4a5a-a950-1d8dfe6eeca5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:46.134560 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.134541    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-podinfo\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:46.134560 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.134559    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-workload-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:46.134717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.134570    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b7xb\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-kube-api-access-2b7xb\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:46.134717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.134584    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-envoy\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:46.134717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.134596    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istiod-ca-cert\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:46.134717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.134604    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5-istio-token\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:21:46.160327 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.160302    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerID="4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638" exitCode=0
Sep 16 12:21:46.160451 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.160342    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"
Sep 16 12:21:46.160451 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.160393    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" event={"ID":"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5","Type":"ContainerDied","Data":"4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638"}
Sep 16 12:21:46.160451 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.160446    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c" event={"ID":"9d85b684-da1d-4a5a-a950-1d8dfe6eeca5","Type":"ContainerDied","Data":"21b9693afe0ba980da54acfe1419a5babce82c6a61f4e44ef23285561cc709f2"}
Sep 16 12:21:46.160579 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.160472    2559 scope.go:117] "RemoveContainer" containerID="4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638"
Sep 16 12:21:46.169688 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.169667    2559 scope.go:117] "RemoveContainer" containerID="d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d"
Sep 16 12:21:46.177254 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.177237    2559 scope.go:117] "RemoveContainer" containerID="4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638"
Sep 16 12:21:46.177506 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:21:46.177489    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638\": container with ID starting with 4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638 not found: ID does not exist" containerID="4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638"
Sep 16 12:21:46.177554 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.177514    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638"} err="failed to get container status \"4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638\": rpc error: code = NotFound desc = could not find container \"4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638\": container with ID starting with 4aa76abdb046155f5b5edf0d353e5c60602191a332fd83752d159b3bc16e6638 not found: ID does not exist"
Sep 16 12:21:46.177554 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.177532    2559 scope.go:117] "RemoveContainer" containerID="d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d"
Sep 16 12:21:46.177780 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:21:46.177765    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d\": container with ID starting with d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d not found: ID does not exist" containerID="d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d"
Sep 16 12:21:46.177831 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.177784    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d"} err="failed to get container status \"d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d\": rpc error: code = NotFound desc = could not find container \"d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d\": container with ID starting with d0e893b5753d3baa6ff6a3aaea90a3159e132f83bec1a18278527c20ae14bf2d not found: ID does not exist"
Sep 16 12:21:46.182242 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.182221    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"]
Sep 16 12:21:46.188373 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:46.188353    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f6101af5-openshift-default-fc79c786d-lxl2c"]
Sep 16 12:21:48.030125 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:48.030093    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" path="/var/lib/kubelet/pods/9d85b684-da1d-4a5a-a950-1d8dfe6eeca5/volumes"
Sep 16 12:21:49.470041 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470006    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"]
Sep 16 12:21:49.470449 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470435    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e37b52-cdef-48a5-8df1-7075036dc9cc" containerName="payload-processing"
Sep 16 12:21:49.470494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470450    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e37b52-cdef-48a5-8df1-7075036dc9cc" containerName="payload-processing"
Sep 16 12:21:49.470494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470474    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy"
Sep 16 12:21:49.470494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470480    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy"
Sep 16 12:21:49.470494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470489    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b" containerName="payload-pre-processing"
Sep 16 12:21:49.470494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470495    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b" containerName="payload-pre-processing"
Sep 16 12:21:49.470651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470502    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy"
Sep 16 12:21:49.470651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470507    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy"
Sep 16 12:21:49.470651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470566    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e37b52-cdef-48a5-8df1-7075036dc9cc" containerName="payload-processing"
Sep 16 12:21:49.470651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470574    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy"
Sep 16 12:21:49.470651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470582    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e7ca9e9-9f19-4a75-8958-8aa06e3d0d5b" containerName="payload-pre-processing"
Sep 16 12:21:49.470651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.470587    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d85b684-da1d-4a5a-a950-1d8dfe6eeca5" containerName="istio-proxy"
Sep 16 12:21:49.473794 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.473773    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:21:49.476535 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.476516    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-d6af8fa6\""
Sep 16 12:21:49.477589 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.477568    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-d6af8fa6-dockercfg-27trf\""
Sep 16 12:21:49.486596 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.486574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"]
Sep 16 12:21:49.502959 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.502933    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"]
Sep 16 12:21:49.505985 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.505967    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:21:49.524187 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.524164    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"]
Sep 16 12:21:49.568272 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.568239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60894a30-a213-452a-b5cc-3eec5c2c6832-plugins-config-volume\") pod \"payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww\" (UID: \"60894a30-a213-452a-b5cc-3eec5c2c6832\") " pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:21:49.568399 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.568290    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hs9p\" (UniqueName: \"kubernetes.io/projected/60894a30-a213-452a-b5cc-3eec5c2c6832-kube-api-access-5hs9p\") pod \"payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww\" (UID: \"60894a30-a213-452a-b5cc-3eec5c2c6832\") " pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:21:49.568399 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.568374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxwv5\" (UniqueName: \"kubernetes.io/projected/1d721289-8900-460c-a1d1-b07b9417c144-kube-api-access-dxwv5\") pod \"payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c\" (UID: \"1d721289-8900-460c-a1d1-b07b9417c144\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:21:49.568525 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.568443    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d721289-8900-460c-a1d1-b07b9417c144-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c\" (UID: \"1d721289-8900-460c-a1d1-b07b9417c144\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:21:49.669497 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.669460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60894a30-a213-452a-b5cc-3eec5c2c6832-plugins-config-volume\") pod \"payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww\" (UID: \"60894a30-a213-452a-b5cc-3eec5c2c6832\") " pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:21:49.669659 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.669515    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hs9p\" (UniqueName: \"kubernetes.io/projected/60894a30-a213-452a-b5cc-3eec5c2c6832-kube-api-access-5hs9p\") pod \"payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww\" (UID: \"60894a30-a213-452a-b5cc-3eec5c2c6832\") " pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:21:49.669659 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.669594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxwv5\" (UniqueName: \"kubernetes.io/projected/1d721289-8900-460c-a1d1-b07b9417c144-kube-api-access-dxwv5\") pod \"payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c\" (UID: \"1d721289-8900-460c-a1d1-b07b9417c144\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:21:49.669659 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.669652    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d721289-8900-460c-a1d1-b07b9417c144-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c\" (UID: \"1d721289-8900-460c-a1d1-b07b9417c144\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:21:49.670290 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.670269    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60894a30-a213-452a-b5cc-3eec5c2c6832-plugins-config-volume\") pod \"payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww\" (UID: \"60894a30-a213-452a-b5cc-3eec5c2c6832\") " pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:21:49.670376 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.670356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d721289-8900-460c-a1d1-b07b9417c144-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c\" (UID: \"1d721289-8900-460c-a1d1-b07b9417c144\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:21:49.677963 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.677935    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hs9p\" (UniqueName: \"kubernetes.io/projected/60894a30-a213-452a-b5cc-3eec5c2c6832-kube-api-access-5hs9p\") pod \"payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww\" (UID: \"60894a30-a213-452a-b5cc-3eec5c2c6832\") " pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:21:49.678069 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.678007    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxwv5\" (UniqueName: \"kubernetes.io/projected/1d721289-8900-460c-a1d1-b07b9417c144-kube-api-access-dxwv5\") pod \"payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c\" (UID: \"1d721289-8900-460c-a1d1-b07b9417c144\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:21:49.784797 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.784734    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:21:49.815988 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:49.815952    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:21:50.058715 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.058676    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"]
Sep 16 12:21:50.060748 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:21:50.060688    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d721289_8900_460c_a1d1_b07b9417c144.slice/crio-8ff5f79528f3ec615c59fd2c0e4c53427053fe25c42d2625b9bd88d156cae943 WatchSource:0}: Error finding container 8ff5f79528f3ec615c59fd2c0e4c53427053fe25c42d2625b9bd88d156cae943: Status 404 returned error can't find the container with id 8ff5f79528f3ec615c59fd2c0e4c53427053fe25c42d2625b9bd88d156cae943
Sep 16 12:21:50.100653 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.100628    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"]
Sep 16 12:21:50.102040 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:21:50.102016    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60894a30_a213_452a_b5cc_3eec5c2c6832.slice/crio-20be9190ac8b2be67af7f8c0a3aa9268c577f1515c2385a803046dd25fd1e6be WatchSource:0}: Error finding container 20be9190ac8b2be67af7f8c0a3aa9268c577f1515c2385a803046dd25fd1e6be: Status 404 returned error can't find the container with id 20be9190ac8b2be67af7f8c0a3aa9268c577f1515c2385a803046dd25fd1e6be
Sep 16 12:21:50.184488 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.184452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c" event={"ID":"1d721289-8900-460c-a1d1-b07b9417c144","Type":"ContainerStarted","Data":"8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664"}
Sep 16 12:21:50.184631 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.184521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c" event={"ID":"1d721289-8900-460c-a1d1-b07b9417c144","Type":"ContainerStarted","Data":"8ff5f79528f3ec615c59fd2c0e4c53427053fe25c42d2625b9bd88d156cae943"}
Sep 16 12:21:50.184726 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.184650    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:21:50.186198 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.186173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww" event={"ID":"60894a30-a213-452a-b5cc-3eec5c2c6832","Type":"ContainerStarted","Data":"7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5"}
Sep 16 12:21:50.186292 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.186217    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww" event={"ID":"60894a30-a213-452a-b5cc-3eec5c2c6832","Type":"ContainerStarted","Data":"20be9190ac8b2be67af7f8c0a3aa9268c577f1515c2385a803046dd25fd1e6be"}
Sep 16 12:21:50.186292 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.186255    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:21:50.199472 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.199434    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c" podStartSLOduration=1.19942142 podStartE2EDuration="1.19942142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:50.198922243 +0000 UTC m=+1266.641957104" watchObservedRunningTime="2026-09-16 12:21:50.19942142 +0000 UTC m=+1266.642456282"
Sep 16 12:21:50.217017 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:21:50.216972    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww" podStartSLOduration=1.216955843 podStartE2EDuration="1.216955843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:50.214659926 +0000 UTC m=+1266.657694787" watchObservedRunningTime="2026-09-16 12:21:50.216955843 +0000 UTC m=+1266.659990706"
Sep 16 12:22:01.193454 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:01.193421    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:22:01.193914 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:01.193544    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:22:26.732405 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:26.732360    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"]
Sep 16 12:22:26.732951 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:26.732618    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww" podUID="60894a30-a213-452a-b5cc-3eec5c2c6832" containerName="payload-processing" containerID="cri-o://7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5" gracePeriod=30
Sep 16 12:22:26.739459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:26.739434    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"]
Sep 16 12:22:26.739669 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:26.739637    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c" podUID="1d721289-8900-460c-a1d1-b07b9417c144" containerName="payload-pre-processing" containerID="cri-o://8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664" gracePeriod=30
Sep 16 12:22:26.813494 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:22:26.813452    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60894a30_a213_452a_b5cc_3eec5c2c6832.slice/crio-conmon-7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5.scope\": RecentStats: unable to find data in memory cache]"
Sep 16 12:22:27.044785 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.044751    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:22:27.048459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.048433    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:22:27.177722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.177680    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d721289-8900-460c-a1d1-b07b9417c144-plugins-config-volume\") pod \"1d721289-8900-460c-a1d1-b07b9417c144\" (UID: \"1d721289-8900-460c-a1d1-b07b9417c144\") "
Sep 16 12:22:27.177917 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.177745    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60894a30-a213-452a-b5cc-3eec5c2c6832-plugins-config-volume\") pod \"60894a30-a213-452a-b5cc-3eec5c2c6832\" (UID: \"60894a30-a213-452a-b5cc-3eec5c2c6832\") "
Sep 16 12:22:27.177917 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.177824    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxwv5\" (UniqueName: \"kubernetes.io/projected/1d721289-8900-460c-a1d1-b07b9417c144-kube-api-access-dxwv5\") pod \"1d721289-8900-460c-a1d1-b07b9417c144\" (UID: \"1d721289-8900-460c-a1d1-b07b9417c144\") "
Sep 16 12:22:27.177917 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.177855    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hs9p\" (UniqueName: \"kubernetes.io/projected/60894a30-a213-452a-b5cc-3eec5c2c6832-kube-api-access-5hs9p\") pod \"60894a30-a213-452a-b5cc-3eec5c2c6832\" (UID: \"60894a30-a213-452a-b5cc-3eec5c2c6832\") "
Sep 16 12:22:27.178149 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.178114    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60894a30-a213-452a-b5cc-3eec5c2c6832-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "60894a30-a213-452a-b5cc-3eec5c2c6832" (UID: "60894a30-a213-452a-b5cc-3eec5c2c6832"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:22:27.178260 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.178127    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d721289-8900-460c-a1d1-b07b9417c144-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d721289-8900-460c-a1d1-b07b9417c144" (UID: "1d721289-8900-460c-a1d1-b07b9417c144"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:22:27.178337 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.178299    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60894a30-a213-452a-b5cc-3eec5c2c6832-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:22:27.178337 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.178321    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d721289-8900-460c-a1d1-b07b9417c144-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:22:27.179934 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.179910    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d721289-8900-460c-a1d1-b07b9417c144-kube-api-access-dxwv5" (OuterVolumeSpecName: "kube-api-access-dxwv5") pod "1d721289-8900-460c-a1d1-b07b9417c144" (UID: "1d721289-8900-460c-a1d1-b07b9417c144"). InnerVolumeSpecName "kube-api-access-dxwv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:22:27.180167 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.180145    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60894a30-a213-452a-b5cc-3eec5c2c6832-kube-api-access-5hs9p" (OuterVolumeSpecName: "kube-api-access-5hs9p") pod "60894a30-a213-452a-b5cc-3eec5c2c6832" (UID: "60894a30-a213-452a-b5cc-3eec5c2c6832"). InnerVolumeSpecName "kube-api-access-5hs9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:22:27.279369 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.279305    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxwv5\" (UniqueName: \"kubernetes.io/projected/1d721289-8900-460c-a1d1-b07b9417c144-kube-api-access-dxwv5\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:22:27.279369 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.279334    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hs9p\" (UniqueName: \"kubernetes.io/projected/60894a30-a213-452a-b5cc-3eec5c2c6832-kube-api-access-5hs9p\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:22:27.394122 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.394089    2559 generic.go:356] "Generic (PLEG): container finished" podID="60894a30-a213-452a-b5cc-3eec5c2c6832" containerID="7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5" exitCode=0
Sep 16 12:22:27.394301 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.394133    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"
Sep 16 12:22:27.394301 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.394171    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww" event={"ID":"60894a30-a213-452a-b5cc-3eec5c2c6832","Type":"ContainerDied","Data":"7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5"}
Sep 16 12:22:27.394301 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.394249    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww" event={"ID":"60894a30-a213-452a-b5cc-3eec5c2c6832","Type":"ContainerDied","Data":"20be9190ac8b2be67af7f8c0a3aa9268c577f1515c2385a803046dd25fd1e6be"}
Sep 16 12:22:27.394301 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.394273    2559 scope.go:117] "RemoveContainer" containerID="7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5"
Sep 16 12:22:27.395655 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.395634    2559 generic.go:356] "Generic (PLEG): container finished" podID="1d721289-8900-460c-a1d1-b07b9417c144" containerID="8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664" exitCode=0
Sep 16 12:22:27.395768 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.395683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c" event={"ID":"1d721289-8900-460c-a1d1-b07b9417c144","Type":"ContainerDied","Data":"8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664"}
Sep 16 12:22:27.395768 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.395714    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"
Sep 16 12:22:27.395768 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.395738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c" event={"ID":"1d721289-8900-460c-a1d1-b07b9417c144","Type":"ContainerDied","Data":"8ff5f79528f3ec615c59fd2c0e4c53427053fe25c42d2625b9bd88d156cae943"}
Sep 16 12:22:27.404037 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.404019    2559 scope.go:117] "RemoveContainer" containerID="7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5"
Sep 16 12:22:27.404313 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:22:27.404295    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5\": container with ID starting with 7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5 not found: ID does not exist" containerID="7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5"
Sep 16 12:22:27.404357 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.404321    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5"} err="failed to get container status \"7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5\": rpc error: code = NotFound desc = could not find container \"7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5\": container with ID starting with 7f122925495fbc565a2ffaea459b3802bb85a45f19b5423be90f12818673edf5 not found: ID does not exist"
Sep 16 12:22:27.404357 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.404338    2559 scope.go:117] "RemoveContainer" containerID="8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664"
Sep 16 12:22:27.412045 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.412031    2559 scope.go:117] "RemoveContainer" containerID="8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664"
Sep 16 12:22:27.412287 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:22:27.412270    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664\": container with ID starting with 8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664 not found: ID does not exist" containerID="8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664"
Sep 16 12:22:27.412353 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.412293    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664"} err="failed to get container status \"8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664\": rpc error: code = NotFound desc = could not find container \"8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664\": container with ID starting with 8e052e4b1ceacb158cb936be3b0d193bb92ea052ede1046ddc72dffb048f1664 not found: ID does not exist"
Sep 16 12:22:27.418875 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.418854    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"]
Sep 16 12:22:27.422946 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.422927    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d6af8fa6-7f869ff94-8nb5c"]
Sep 16 12:22:27.436251 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.436227    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"]
Sep 16 12:22:27.439772 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:27.439753    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d6af8fa6-779455574f-ltkww"]
Sep 16 12:22:28.030825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:28.030743    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d721289-8900-460c-a1d1-b07b9417c144" path="/var/lib/kubelet/pods/1d721289-8900-460c-a1d1-b07b9417c144/volumes"
Sep 16 12:22:28.031299 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:22:28.031277    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60894a30-a213-452a-b5cc-3eec5c2c6832" path="/var/lib/kubelet/pods/60894a30-a213-452a-b5cc-3eec5c2c6832/volumes"
Sep 16 12:23:34.975537 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:34.975502    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"]
Sep 16 12:23:34.976423 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:34.976362    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv" podUID="17223d07-8fcd-4116-a4a0-e6362fe587e0" containerName="payload-pre-processing" containerID="cri-o://ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf" gracePeriod=30
Sep 16 12:23:35.003317 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:23:35.003286    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17223d07_8fcd_4116_a4a0_e6362fe587e0.slice/crio-ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17223d07_8fcd_4116_a4a0_e6362fe587e0.slice/crio-conmon-ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf.scope\": RecentStats: unable to find data in memory cache]"
Sep 16 12:23:35.243067 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.243041    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:23:35.249768 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.249736    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17223d07-8fcd-4116-a4a0-e6362fe587e0-plugins-config-volume\") pod \"17223d07-8fcd-4116-a4a0-e6362fe587e0\" (UID: \"17223d07-8fcd-4116-a4a0-e6362fe587e0\") "
Sep 16 12:23:35.249917 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.249865    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl6ll\" (UniqueName: \"kubernetes.io/projected/17223d07-8fcd-4116-a4a0-e6362fe587e0-kube-api-access-hl6ll\") pod \"17223d07-8fcd-4116-a4a0-e6362fe587e0\" (UID: \"17223d07-8fcd-4116-a4a0-e6362fe587e0\") "
Sep 16 12:23:35.250119 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.250096    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17223d07-8fcd-4116-a4a0-e6362fe587e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "17223d07-8fcd-4116-a4a0-e6362fe587e0" (UID: "17223d07-8fcd-4116-a4a0-e6362fe587e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:23:35.250269 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.250251    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17223d07-8fcd-4116-a4a0-e6362fe587e0-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:35.252048 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.252018    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17223d07-8fcd-4116-a4a0-e6362fe587e0-kube-api-access-hl6ll" (OuterVolumeSpecName: "kube-api-access-hl6ll") pod "17223d07-8fcd-4116-a4a0-e6362fe587e0" (UID: "17223d07-8fcd-4116-a4a0-e6362fe587e0"). InnerVolumeSpecName "kube-api-access-hl6ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:23:35.351375 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.351341    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl6ll\" (UniqueName: \"kubernetes.io/projected/17223d07-8fcd-4116-a4a0-e6362fe587e0-kube-api-access-hl6ll\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:35.752187 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.752154    2559 generic.go:356] "Generic (PLEG): container finished" podID="17223d07-8fcd-4116-a4a0-e6362fe587e0" containerID="ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf" exitCode=0
Sep 16 12:23:35.752345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.752209    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"
Sep 16 12:23:35.752345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.752247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv" event={"ID":"17223d07-8fcd-4116-a4a0-e6362fe587e0","Type":"ContainerDied","Data":"ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf"}
Sep 16 12:23:35.752345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.752316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv" event={"ID":"17223d07-8fcd-4116-a4a0-e6362fe587e0","Type":"ContainerDied","Data":"ca36b78e82a29d33146c391fbcc19643d4a80b1db82e2f526b632591bc01db9b"}
Sep 16 12:23:35.752468 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.752348    2559 scope.go:117] "RemoveContainer" containerID="ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf"
Sep 16 12:23:35.761234 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.761217    2559 scope.go:117] "RemoveContainer" containerID="ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf"
Sep 16 12:23:35.761559 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:23:35.761517    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf\": container with ID starting with ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf not found: ID does not exist" containerID="ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf"
Sep 16 12:23:35.761655 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.761565    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf"} err="failed to get container status \"ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf\": rpc error: code = NotFound desc = could not find container \"ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf\": container with ID starting with ea9a7b3a6c41d9b0906ecd8efaf610841877810014089e6a90ce10588f5055cf not found: ID does not exist"
Sep 16 12:23:35.774981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.774953    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"]
Sep 16 12:23:35.777090 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:35.777070    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-0e8ffe-f55fb445d-c9hxv"]
Sep 16 12:23:36.030465 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:36.030387    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17223d07-8fcd-4116-a4a0-e6362fe587e0" path="/var/lib/kubelet/pods/17223d07-8fcd-4116-a4a0-e6362fe587e0/volumes"
Sep 16 12:23:41.538716 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:41.538667    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"]
Sep 16 12:23:41.539081 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:41.538905    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy" containerID="cri-o://634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28" gracePeriod=30
Sep 16 12:23:44.816830 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:44.816793    2559 patch_prober.go:28] interesting pod/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:23:44.817239 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:44.816860    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:23:46.798044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.798021    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:23:46.810344 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.810286    2559 generic.go:356] "Generic (PLEG): container finished" podID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerID="634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28" exitCode=0
Sep 16 12:23:46.810344 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.810325    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"
Sep 16 12:23:46.810489 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.810362    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" event={"ID":"e6c114c5-cb69-4eff-a4ae-b0a49370b918","Type":"ContainerDied","Data":"634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28"}
Sep 16 12:23:46.810489 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.810416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s" event={"ID":"e6c114c5-cb69-4eff-a4ae-b0a49370b918","Type":"ContainerDied","Data":"bc3a5bb8b71b5a984eae464f06b84e20296f32a44986daadb9cb0a2da1b1d141"}
Sep 16 12:23:46.810489 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.810438    2559 scope.go:117] "RemoveContainer" containerID="634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28"
Sep 16 12:23:46.819817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.819790    2559 scope.go:117] "RemoveContainer" containerID="ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182"
Sep 16 12:23:46.828078 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.828061    2559 scope.go:117] "RemoveContainer" containerID="634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28"
Sep 16 12:23:46.828360 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:23:46.828340    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28\": container with ID starting with 634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28 not found: ID does not exist" containerID="634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28"
Sep 16 12:23:46.828424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.828368    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28"} err="failed to get container status \"634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28\": rpc error: code = NotFound desc = could not find container \"634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28\": container with ID starting with 634a58d1b19ef2d0b90ca799eb7e490f268316a3959d2b0ab6e8793886a70e28 not found: ID does not exist"
Sep 16 12:23:46.828424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.828392    2559 scope.go:117] "RemoveContainer" containerID="ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182"
Sep 16 12:23:46.828636 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:23:46.828620    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182\": container with ID starting with ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182 not found: ID does not exist" containerID="ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182"
Sep 16 12:23:46.828723 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.828640    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182"} err="failed to get container status \"ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182\": rpc error: code = NotFound desc = could not find container \"ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182\": container with ID starting with ed628d4ac8b58b38104a057e16eb78cf82a6dc949a1a9597ff52b2fa89431182 not found: ID does not exist"
Sep 16 12:23:46.848149 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848127    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-envoy\") pod \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") "
Sep 16 12:23:46.848252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848176    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-socket\") pod \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") "
Sep 16 12:23:46.848252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848205    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-podinfo\") pod \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") "
Sep 16 12:23:46.848252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848233    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-credential-socket\") pod \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") "
Sep 16 12:23:46.848422 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848257    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2c9m\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-kube-api-access-q2c9m\") pod \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") "
Sep 16 12:23:46.848422 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848299    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istiod-ca-cert\") pod \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") "
Sep 16 12:23:46.848422 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848355    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-certs\") pod \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") "
Sep 16 12:23:46.848422 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848392    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-data\") pod \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") "
Sep 16 12:23:46.848625 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848461    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-token\") pod \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\" (UID: \"e6c114c5-cb69-4eff-a4ae-b0a49370b918\") "
Sep 16 12:23:46.849426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.848822    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6c114c5-cb69-4eff-a4ae-b0a49370b918" (UID: "e6c114c5-cb69-4eff-a4ae-b0a49370b918"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:23:46.849426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.849090    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6c114c5-cb69-4eff-a4ae-b0a49370b918" (UID: "e6c114c5-cb69-4eff-a4ae-b0a49370b918"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:23:46.849426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.849126    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6c114c5-cb69-4eff-a4ae-b0a49370b918" (UID: "e6c114c5-cb69-4eff-a4ae-b0a49370b918"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:23:46.849426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.849155    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6c114c5-cb69-4eff-a4ae-b0a49370b918" (UID: "e6c114c5-cb69-4eff-a4ae-b0a49370b918"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:23:46.849426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.849394    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6c114c5-cb69-4eff-a4ae-b0a49370b918" (UID: "e6c114c5-cb69-4eff-a4ae-b0a49370b918"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:23:46.851235 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.851206    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6c114c5-cb69-4eff-a4ae-b0a49370b918" (UID: "e6c114c5-cb69-4eff-a4ae-b0a49370b918"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:23:46.852054 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.852028    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6c114c5-cb69-4eff-a4ae-b0a49370b918" (UID: "e6c114c5-cb69-4eff-a4ae-b0a49370b918"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:23:46.852054 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.852043    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-kube-api-access-q2c9m" (OuterVolumeSpecName: "kube-api-access-q2c9m") pod "e6c114c5-cb69-4eff-a4ae-b0a49370b918" (UID: "e6c114c5-cb69-4eff-a4ae-b0a49370b918"). InnerVolumeSpecName "kube-api-access-q2c9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:23:46.854986 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.854967    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6c114c5-cb69-4eff-a4ae-b0a49370b918" (UID: "e6c114c5-cb69-4eff-a4ae-b0a49370b918"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:23:46.957300 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.957267    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-envoy\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:46.957440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.957311    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:46.957440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.957326    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-podinfo\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:46.957440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.957339    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-credential-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:46.957440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.957353    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2c9m\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-kube-api-access-q2c9m\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:46.957440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.957370    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istiod-ca-cert\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:46.957440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.957383    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-workload-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:46.957440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.957395    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-data\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:46.957440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:46.957406    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6c114c5-cb69-4eff-a4ae-b0a49370b918-istio-token\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:23:47.132252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:47.132221    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"]
Sep 16 12:23:47.136483 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:47.136463    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-0e8ffe-openshift-default-7d749bd7f6-r7x7s"]
Sep 16 12:23:48.030254 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:23:48.030224    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" path="/var/lib/kubelet/pods/e6c114c5-cb69-4eff-a4ae-b0a49370b918/volumes"
Sep 16 12:24:00.541797 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:00.541760    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"]
Sep 16 12:24:00.542202 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:00.542026    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy" containerID="cri-o://bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538" gracePeriod=30
Sep 16 12:24:05.783055 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.783026    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:24:05.908352 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.908323    2559 generic.go:356] "Generic (PLEG): container finished" podID="5eb220df-8108-4e59-846f-d70f288396c7" containerID="bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538" exitCode=0
Sep 16 12:24:05.908518 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.908366    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"
Sep 16 12:24:05.908518 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.908400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" event={"ID":"5eb220df-8108-4e59-846f-d70f288396c7","Type":"ContainerDied","Data":"bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538"}
Sep 16 12:24:05.908518 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.908457    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw" event={"ID":"5eb220df-8108-4e59-846f-d70f288396c7","Type":"ContainerDied","Data":"2ba2e5007958dfc4304faef88f53026cf93e78f96b4d846a45326b401c29dbea"}
Sep 16 12:24:05.908518 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.908485    2559 scope.go:117] "RemoveContainer" containerID="bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538"
Sep 16 12:24:05.916933 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.916919    2559 scope.go:117] "RemoveContainer" containerID="dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135"
Sep 16 12:24:05.924457 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.924437    2559 scope.go:117] "RemoveContainer" containerID="bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538"
Sep 16 12:24:05.924742 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:24:05.924719    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538\": container with ID starting with bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538 not found: ID does not exist" containerID="bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538"
Sep 16 12:24:05.924835 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.924753    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538"} err="failed to get container status \"bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538\": rpc error: code = NotFound desc = could not find container \"bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538\": container with ID starting with bff8dadddbcc9b0958bccdb33d0dd2f93b86b94684a305a4d8a2f86feedf5538 not found: ID does not exist"
Sep 16 12:24:05.924835 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.924775    2559 scope.go:117] "RemoveContainer" containerID="dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135"
Sep 16 12:24:05.925029 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:24:05.925012    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135\": container with ID starting with dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135 not found: ID does not exist" containerID="dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135"
Sep 16 12:24:05.925077 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.925034    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135"} err="failed to get container status \"dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135\": rpc error: code = NotFound desc = could not find container \"dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135\": container with ID starting with dface9d60c56ae397b4f6a8551c72278314c61b9dc91611cfa2d0a4544f45135 not found: ID does not exist"
Sep 16 12:24:05.935347 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935330    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-envoy\") pod \"5eb220df-8108-4e59-846f-d70f288396c7\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") "
Sep 16 12:24:05.935423 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935366    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb220df-8108-4e59-846f-d70f288396c7-istio-podinfo\") pod \"5eb220df-8108-4e59-846f-d70f288396c7\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") "
Sep 16 12:24:05.935423 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935388    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blx8x\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-kube-api-access-blx8x\") pod \"5eb220df-8108-4e59-846f-d70f288396c7\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") "
Sep 16 12:24:05.935503 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935460    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb220df-8108-4e59-846f-d70f288396c7-istiod-ca-cert\") pod \"5eb220df-8108-4e59-846f-d70f288396c7\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") "
Sep 16 12:24:05.935503 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935491    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-socket\") pod \"5eb220df-8108-4e59-846f-d70f288396c7\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") "
Sep 16 12:24:05.935577 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935534    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-data\") pod \"5eb220df-8108-4e59-846f-d70f288396c7\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") "
Sep 16 12:24:05.935577 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935564    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-credential-socket\") pod \"5eb220df-8108-4e59-846f-d70f288396c7\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") "
Sep 16 12:24:05.935665 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935605    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-istio-token\") pod \"5eb220df-8108-4e59-846f-d70f288396c7\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") "
Sep 16 12:24:05.935665 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935636    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-certs\") pod \"5eb220df-8108-4e59-846f-d70f288396c7\" (UID: \"5eb220df-8108-4e59-846f-d70f288396c7\") "
Sep 16 12:24:05.936007 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935914    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "5eb220df-8108-4e59-846f-d70f288396c7" (UID: "5eb220df-8108-4e59-846f-d70f288396c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:24:05.936007 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935929    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5eb220df-8108-4e59-846f-d70f288396c7" (UID: "5eb220df-8108-4e59-846f-d70f288396c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:24:05.936007 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.935954    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb220df-8108-4e59-846f-d70f288396c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5eb220df-8108-4e59-846f-d70f288396c7" (UID: "5eb220df-8108-4e59-846f-d70f288396c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:24:05.936196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.936058    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5eb220df-8108-4e59-846f-d70f288396c7" (UID: "5eb220df-8108-4e59-846f-d70f288396c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:24:05.936196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.936091    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5eb220df-8108-4e59-846f-d70f288396c7" (UID: "5eb220df-8108-4e59-846f-d70f288396c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:24:05.936196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.936119    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb220df-8108-4e59-846f-d70f288396c7-istiod-ca-cert\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:24:05.936196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.936131    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:24:05.936196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.936140    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-data\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:24:05.937489 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.937469    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5eb220df-8108-4e59-846f-d70f288396c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5eb220df-8108-4e59-846f-d70f288396c7" (UID: "5eb220df-8108-4e59-846f-d70f288396c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:24:05.937731 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.937683    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "5eb220df-8108-4e59-846f-d70f288396c7" (UID: "5eb220df-8108-4e59-846f-d70f288396c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:24:05.937844 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.937822    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5eb220df-8108-4e59-846f-d70f288396c7" (UID: "5eb220df-8108-4e59-846f-d70f288396c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:24:05.938094 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:05.938067    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-kube-api-access-blx8x" (OuterVolumeSpecName: "kube-api-access-blx8x") pod "5eb220df-8108-4e59-846f-d70f288396c7" (UID: "5eb220df-8108-4e59-846f-d70f288396c7"). InnerVolumeSpecName "kube-api-access-blx8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:24:06.037959 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.037930    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb220df-8108-4e59-846f-d70f288396c7-istio-podinfo\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:24:06.037959 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.037957    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blx8x\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-kube-api-access-blx8x\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:24:06.038109 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.037972    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-credential-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:24:06.038109 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.037984    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eb220df-8108-4e59-846f-d70f288396c7-istio-token\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:24:06.038109 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.037995    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-workload-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:24:06.038109 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.038007    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb220df-8108-4e59-846f-d70f288396c7-istio-envoy\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:24:06.233469 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.233390    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"]
Sep 16 12:24:06.242057 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.242022    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-7c3429-openshift-default-54b4bc4bb6-rrpnw"]
Sep 16 12:24:06.919951 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.919920    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"]
Sep 16 12:24:06.920318 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920302    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17223d07-8fcd-4116-a4a0-e6362fe587e0" containerName="payload-pre-processing"
Sep 16 12:24:06.920318 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920319    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17223d07-8fcd-4116-a4a0-e6362fe587e0" containerName="payload-pre-processing"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920329    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920335    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920352    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920357    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920365    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d721289-8900-460c-a1d1-b07b9417c144" containerName="payload-pre-processing"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920369    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d721289-8900-460c-a1d1-b07b9417c144" containerName="payload-pre-processing"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920389    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60894a30-a213-452a-b5cc-3eec5c2c6832" containerName="payload-processing"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920395    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="60894a30-a213-452a-b5cc-3eec5c2c6832" containerName="payload-processing"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920406    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy"
Sep 16 12:24:06.920408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920411    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy"
Sep 16 12:24:06.920722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920417    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy"
Sep 16 12:24:06.920722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920422    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy"
Sep 16 12:24:06.920722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920478    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy"
Sep 16 12:24:06.920722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920486    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6c114c5-cb69-4eff-a4ae-b0a49370b918" containerName="istio-proxy"
Sep 16 12:24:06.920722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920493    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="60894a30-a213-452a-b5cc-3eec5c2c6832" containerName="payload-processing"
Sep 16 12:24:06.920722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920499    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d721289-8900-460c-a1d1-b07b9417c144" containerName="payload-pre-processing"
Sep 16 12:24:06.920722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920504    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy"
Sep 16 12:24:06.920722 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.920511    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="17223d07-8fcd-4116-a4a0-e6362fe587e0" containerName="payload-pre-processing"
Sep 16 12:24:06.925073 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.925058    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:06.927573 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.927546    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-4915f8\""
Sep 16 12:24:06.927724 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.927642    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-4915f8-dockercfg-qtqc9\""
Sep 16 12:24:06.934478 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.934459    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"]
Sep 16 12:24:06.940633 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.940608    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"]
Sep 16 12:24:06.941129 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.941112    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb220df-8108-4e59-846f-d70f288396c7" containerName="istio-proxy"
Sep 16 12:24:06.944081 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.944064    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:06.955957 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:06.955937    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"]
Sep 16 12:24:07.048069 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.048025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2db95d2-5054-4424-b964-74a724ea7abf-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp\" (UID: \"c2db95d2-5054-4424-b964-74a724ea7abf\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:07.048273 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.048094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pn82\" (UniqueName: \"kubernetes.io/projected/c2db95d2-5054-4424-b964-74a724ea7abf-kube-api-access-9pn82\") pod \"payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp\" (UID: \"c2db95d2-5054-4424-b964-74a724ea7abf\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:07.048273 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.048156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3de8ea4-cf14-4abe-9988-a80e14d47be2-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld\" (UID: \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\") " pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:07.048404 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.048273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prsv5\" (UniqueName: \"kubernetes.io/projected/b3de8ea4-cf14-4abe-9988-a80e14d47be2-kube-api-access-prsv5\") pod \"payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld\" (UID: \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\") " pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:07.148917 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.148877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2db95d2-5054-4424-b964-74a724ea7abf-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp\" (UID: \"c2db95d2-5054-4424-b964-74a724ea7abf\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:07.149088 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.148928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn82\" (UniqueName: \"kubernetes.io/projected/c2db95d2-5054-4424-b964-74a724ea7abf-kube-api-access-9pn82\") pod \"payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp\" (UID: \"c2db95d2-5054-4424-b964-74a724ea7abf\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:07.149088 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.148972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3de8ea4-cf14-4abe-9988-a80e14d47be2-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld\" (UID: \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\") " pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:07.149214 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.149163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prsv5\" (UniqueName: \"kubernetes.io/projected/b3de8ea4-cf14-4abe-9988-a80e14d47be2-kube-api-access-prsv5\") pod \"payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld\" (UID: \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\") " pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:07.149857 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.149835    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3de8ea4-cf14-4abe-9988-a80e14d47be2-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld\" (UID: \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\") " pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:07.149857 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.149851    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2db95d2-5054-4424-b964-74a724ea7abf-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp\" (UID: \"c2db95d2-5054-4424-b964-74a724ea7abf\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:07.157211 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.157186    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prsv5\" (UniqueName: \"kubernetes.io/projected/b3de8ea4-cf14-4abe-9988-a80e14d47be2-kube-api-access-prsv5\") pod \"payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld\" (UID: \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\") " pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:07.157541 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.157524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pn82\" (UniqueName: \"kubernetes.io/projected/c2db95d2-5054-4424-b964-74a724ea7abf-kube-api-access-9pn82\") pod \"payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp\" (UID: \"c2db95d2-5054-4424-b964-74a724ea7abf\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:07.236279 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.236218    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:07.256574 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.256549    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:07.514501 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.514476    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"]
Sep 16 12:24:07.515979 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:24:07.515953    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2db95d2_5054_4424_b964_74a724ea7abf.slice/crio-411d6f700cac0de5a6c18f7c4b568c8afdf97ff5512f4f51c5d52db899b36060 WatchSource:0}: Error finding container 411d6f700cac0de5a6c18f7c4b568c8afdf97ff5512f4f51c5d52db899b36060: Status 404 returned error can't find the container with id 411d6f700cac0de5a6c18f7c4b568c8afdf97ff5512f4f51c5d52db899b36060
Sep 16 12:24:07.540497 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.540476    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"]
Sep 16 12:24:07.552894 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:24:07.552869    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3de8ea4_cf14_4abe_9988_a80e14d47be2.slice/crio-10965369ed8f9b1cab7fe306edd62d0fefe8503eae3963bc3f3a55563b885c49 WatchSource:0}: Error finding container 10965369ed8f9b1cab7fe306edd62d0fefe8503eae3963bc3f3a55563b885c49: Status 404 returned error can't find the container with id 10965369ed8f9b1cab7fe306edd62d0fefe8503eae3963bc3f3a55563b885c49
Sep 16 12:24:07.922611 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.922573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp" event={"ID":"c2db95d2-5054-4424-b964-74a724ea7abf","Type":"ContainerStarted","Data":"02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96"}
Sep 16 12:24:07.923030 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.922626    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp" event={"ID":"c2db95d2-5054-4424-b964-74a724ea7abf","Type":"ContainerStarted","Data":"411d6f700cac0de5a6c18f7c4b568c8afdf97ff5512f4f51c5d52db899b36060"}
Sep 16 12:24:07.923030 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.922686    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:07.924277 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.924257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld" event={"ID":"b3de8ea4-cf14-4abe-9988-a80e14d47be2","Type":"ContainerStarted","Data":"e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2"}
Sep 16 12:24:07.924389 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.924290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld" event={"ID":"b3de8ea4-cf14-4abe-9988-a80e14d47be2","Type":"ContainerStarted","Data":"10965369ed8f9b1cab7fe306edd62d0fefe8503eae3963bc3f3a55563b885c49"}
Sep 16 12:24:07.924389 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.924385    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:07.940065 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.940012    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp" podStartSLOduration=1.9399998969999999 podStartE2EDuration="1.939999897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:24:07.939325318 +0000 UTC m=+1404.382360187" watchObservedRunningTime="2026-09-16 12:24:07.939999897 +0000 UTC m=+1404.383034758"
Sep 16 12:24:07.957408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:07.957359    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld" podStartSLOduration=1.957342514 podStartE2EDuration="1.957342514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:24:07.955442911 +0000 UTC m=+1404.398477778" watchObservedRunningTime="2026-09-16 12:24:07.957342514 +0000 UTC m=+1404.400377379"
Sep 16 12:24:08.030519 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:08.030494    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb220df-8108-4e59-846f-d70f288396c7" path="/var/lib/kubelet/pods/5eb220df-8108-4e59-846f-d70f288396c7/volumes"
Sep 16 12:24:18.932231 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:18.932197    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:24:18.932615 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:18.932393    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:24:33.459456 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.459418    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"]
Sep 16 12:24:33.462730 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.462706    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:33.465472 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.465450    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f2bc0450\""
Sep 16 12:24:33.465559 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.465449    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f2bc0450-dockercfg-6s6mv\""
Sep 16 12:24:33.473575 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.473554    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"]
Sep 16 12:24:33.508907 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.508882    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"]
Sep 16 12:24:33.512253 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.512236    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:33.524482 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.524461    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"]
Sep 16 12:24:33.583674 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.583652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d420d8d-ca28-482f-b975-053e8d4751ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz\" (UID: \"2d420d8d-ca28-482f-b975-053e8d4751ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:33.583807 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.583728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zt8h\" (UniqueName: \"kubernetes.io/projected/2d420d8d-ca28-482f-b975-053e8d4751ac-kube-api-access-9zt8h\") pod \"payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz\" (UID: \"2d420d8d-ca28-482f-b975-053e8d4751ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:33.583807 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.583777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b97ffa70-4f68-4065-aade-623fdd8ec908-plugins-config-volume\") pod \"payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn\" (UID: \"b97ffa70-4f68-4065-aade-623fdd8ec908\") " pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:33.583921 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.583857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcbxl\" (UniqueName: \"kubernetes.io/projected/b97ffa70-4f68-4065-aade-623fdd8ec908-kube-api-access-kcbxl\") pod \"payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn\" (UID: \"b97ffa70-4f68-4065-aade-623fdd8ec908\") " pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:33.685106 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.685065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d420d8d-ca28-482f-b975-053e8d4751ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz\" (UID: \"2d420d8d-ca28-482f-b975-053e8d4751ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:33.685298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.685129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zt8h\" (UniqueName: \"kubernetes.io/projected/2d420d8d-ca28-482f-b975-053e8d4751ac-kube-api-access-9zt8h\") pod \"payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz\" (UID: \"2d420d8d-ca28-482f-b975-053e8d4751ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:33.685298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.685168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b97ffa70-4f68-4065-aade-623fdd8ec908-plugins-config-volume\") pod \"payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn\" (UID: \"b97ffa70-4f68-4065-aade-623fdd8ec908\") " pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:33.685298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.685227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcbxl\" (UniqueName: \"kubernetes.io/projected/b97ffa70-4f68-4065-aade-623fdd8ec908-kube-api-access-kcbxl\") pod \"payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn\" (UID: \"b97ffa70-4f68-4065-aade-623fdd8ec908\") " pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:33.685831 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.685807    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d420d8d-ca28-482f-b975-053e8d4751ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz\" (UID: \"2d420d8d-ca28-482f-b975-053e8d4751ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:33.685910 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.685881    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b97ffa70-4f68-4065-aade-623fdd8ec908-plugins-config-volume\") pod \"payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn\" (UID: \"b97ffa70-4f68-4065-aade-623fdd8ec908\") " pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:33.694419 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.694392    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zt8h\" (UniqueName: \"kubernetes.io/projected/2d420d8d-ca28-482f-b975-053e8d4751ac-kube-api-access-9zt8h\") pod \"payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz\" (UID: \"2d420d8d-ca28-482f-b975-053e8d4751ac\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:33.694523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.694423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcbxl\" (UniqueName: \"kubernetes.io/projected/b97ffa70-4f68-4065-aade-623fdd8ec908-kube-api-access-kcbxl\") pod \"payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn\" (UID: \"b97ffa70-4f68-4065-aade-623fdd8ec908\") " pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:33.774651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.774585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:33.823647 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:33.823610    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:34.044418 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:34.044394    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"]
Sep 16 12:24:34.046389 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:24:34.046364    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d420d8d_ca28_482f_b975_053e8d4751ac.slice/crio-43cdd1ad7da02e846d8ac98098ee45e0f5e918587f429e593b5afeab43802875 WatchSource:0}: Error finding container 43cdd1ad7da02e846d8ac98098ee45e0f5e918587f429e593b5afeab43802875: Status 404 returned error can't find the container with id 43cdd1ad7da02e846d8ac98098ee45e0f5e918587f429e593b5afeab43802875
Sep 16 12:24:34.062273 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:34.062241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz" event={"ID":"2d420d8d-ca28-482f-b975-053e8d4751ac","Type":"ContainerStarted","Data":"43cdd1ad7da02e846d8ac98098ee45e0f5e918587f429e593b5afeab43802875"}
Sep 16 12:24:34.120539 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:34.120514    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"]
Sep 16 12:24:34.122034 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:24:34.122007    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97ffa70_4f68_4065_aade_623fdd8ec908.slice/crio-4bb9d787e3f61d609c9425f5396b7b0ce5c4155ca9a2c7732680c2f893c2e777 WatchSource:0}: Error finding container 4bb9d787e3f61d609c9425f5396b7b0ce5c4155ca9a2c7732680c2f893c2e777: Status 404 returned error can't find the container with id 4bb9d787e3f61d609c9425f5396b7b0ce5c4155ca9a2c7732680c2f893c2e777
Sep 16 12:24:35.070319 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:35.070283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz" event={"ID":"2d420d8d-ca28-482f-b975-053e8d4751ac","Type":"ContainerStarted","Data":"e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71"}
Sep 16 12:24:35.070734 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:35.070361    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:35.071973 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:35.071948    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn" event={"ID":"b97ffa70-4f68-4065-aade-623fdd8ec908","Type":"ContainerStarted","Data":"bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165"}
Sep 16 12:24:35.072100 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:35.071994    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn" event={"ID":"b97ffa70-4f68-4065-aade-623fdd8ec908","Type":"ContainerStarted","Data":"4bb9d787e3f61d609c9425f5396b7b0ce5c4155ca9a2c7732680c2f893c2e777"}
Sep 16 12:24:35.072100 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:35.072022    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:35.087682 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:35.087639    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz" podStartSLOduration=2.08762428 podStartE2EDuration="2.08762428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:24:35.085586337 +0000 UTC m=+1431.528621199" watchObservedRunningTime="2026-09-16 12:24:35.08762428 +0000 UTC m=+1431.530659141"
Sep 16 12:24:35.103833 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:35.103792    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn" podStartSLOduration=2.103779619 podStartE2EDuration="2.103779619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:24:35.101931066 +0000 UTC m=+1431.544965927" watchObservedRunningTime="2026-09-16 12:24:35.103779619 +0000 UTC m=+1431.546814480"
Sep 16 12:24:46.078608 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:46.078578    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:24:46.079058 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:46.078836    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:24:51.408034 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.408001    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"]
Sep 16 12:24:51.411633 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.411616    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.415808 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.415782    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-7a4d5c\"/\"default-dockercfg-mml7v\""
Sep 16 12:24:51.415808 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.415782    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-7a4d5c\"/\"e2e-conflict-a-808e27b0-kserve-self-signed-certs\""
Sep 16 12:24:51.415808 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.415818    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-7a4d5c\"/\"kube-root-ca.crt\""
Sep 16 12:24:51.416054 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.415786    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-7a4d5c\"/\"openshift-service-ca.crt\""
Sep 16 12:24:51.420923 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.420900    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"]
Sep 16 12:24:51.537218 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.537187    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-home\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.537385 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.537221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-dshm\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.537385 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.537243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tmp-dir\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.537385 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.537259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tls-certs\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.537385 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.537344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-model-cache\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.537540 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.537416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdgf6\" (UniqueName: \"kubernetes.io/projected/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-kube-api-access-kdgf6\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.638422 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.638386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-model-cache\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.638619 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.638441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdgf6\" (UniqueName: \"kubernetes.io/projected/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-kube-api-access-kdgf6\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.638619 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.638498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-home\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.638619 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.638514    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-dshm\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.638619 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.638533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tmp-dir\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.638619 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.638557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tls-certs\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.639051 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.638938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-model-cache\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.639051 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.638957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-home\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.639051 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.638992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tmp-dir\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.640733 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.640715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-dshm\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.641060 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.641044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tls-certs\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.646134 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.646111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdgf6\" (UniqueName: \"kubernetes.io/projected/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-kube-api-access-kdgf6\") pod \"e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.722326 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.722273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:24:51.995908 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:51.995867    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"]
Sep 16 12:24:51.998081 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:24:51.998050    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd2742f6_42fc_4c1a_9097_55b56e6f2ad6.slice/crio-4de9265843b90e9e6a6b04ff644a7b449aa934c17cc79a667e779fc233afe748 WatchSource:0}: Error finding container 4de9265843b90e9e6a6b04ff644a7b449aa934c17cc79a667e779fc233afe748: Status 404 returned error can't find the container with id 4de9265843b90e9e6a6b04ff644a7b449aa934c17cc79a667e779fc233afe748
Sep 16 12:24:52.167047 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:52.167014    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2" event={"ID":"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6","Type":"ContainerStarted","Data":"d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308"}
Sep 16 12:24:52.167185 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:52.167054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2" event={"ID":"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6","Type":"ContainerStarted","Data":"4de9265843b90e9e6a6b04ff644a7b449aa934c17cc79a667e779fc233afe748"}
Sep 16 12:24:52.183513 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:24:52.183462    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2" podStartSLOduration=1.18344536 podStartE2EDuration="1.18344536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:24:52.181721076 +0000 UTC m=+1448.624755929" watchObservedRunningTime="2026-09-16 12:24:52.18344536 +0000 UTC m=+1448.626480222"
Sep 16 12:25:01.723105 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:01.723071    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:25:01.723483 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:01.723121    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:25:01.735382 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:01.735359    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:25:02.230709 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:02.230666    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:25:13.571208 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.571174    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"]
Sep 16 12:25:13.571660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.571430    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn" podUID="b97ffa70-4f68-4065-aade-623fdd8ec908" containerName="payload-processing" containerID="cri-o://bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165" gracePeriod=30
Sep 16 12:25:13.576170 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.576098    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"]
Sep 16 12:25:13.576430 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.576379    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz" podUID="2d420d8d-ca28-482f-b975-053e8d4751ac" containerName="payload-pre-processing" containerID="cri-o://e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71" gracePeriod=30
Sep 16 12:25:13.849793 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.849761    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:25:13.878356 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.878329    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:25:13.942429 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.942402    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b97ffa70-4f68-4065-aade-623fdd8ec908-plugins-config-volume\") pod \"b97ffa70-4f68-4065-aade-623fdd8ec908\" (UID: \"b97ffa70-4f68-4065-aade-623fdd8ec908\") "
Sep 16 12:25:13.942592 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.942467    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcbxl\" (UniqueName: \"kubernetes.io/projected/b97ffa70-4f68-4065-aade-623fdd8ec908-kube-api-access-kcbxl\") pod \"b97ffa70-4f68-4065-aade-623fdd8ec908\" (UID: \"b97ffa70-4f68-4065-aade-623fdd8ec908\") "
Sep 16 12:25:13.942592 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.942570    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zt8h\" (UniqueName: \"kubernetes.io/projected/2d420d8d-ca28-482f-b975-053e8d4751ac-kube-api-access-9zt8h\") pod \"2d420d8d-ca28-482f-b975-053e8d4751ac\" (UID: \"2d420d8d-ca28-482f-b975-053e8d4751ac\") "
Sep 16 12:25:13.942767 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.942607    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d420d8d-ca28-482f-b975-053e8d4751ac-plugins-config-volume\") pod \"2d420d8d-ca28-482f-b975-053e8d4751ac\" (UID: \"2d420d8d-ca28-482f-b975-053e8d4751ac\") "
Sep 16 12:25:13.942977 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.942937    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97ffa70-4f68-4065-aade-623fdd8ec908-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b97ffa70-4f68-4065-aade-623fdd8ec908" (UID: "b97ffa70-4f68-4065-aade-623fdd8ec908"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:13.943092 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.943004    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d420d8d-ca28-482f-b975-053e8d4751ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d420d8d-ca28-482f-b975-053e8d4751ac" (UID: "2d420d8d-ca28-482f-b975-053e8d4751ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:13.943092 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.943075    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b97ffa70-4f68-4065-aade-623fdd8ec908-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:25:13.944532 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.944507    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97ffa70-4f68-4065-aade-623fdd8ec908-kube-api-access-kcbxl" (OuterVolumeSpecName: "kube-api-access-kcbxl") pod "b97ffa70-4f68-4065-aade-623fdd8ec908" (UID: "b97ffa70-4f68-4065-aade-623fdd8ec908"). InnerVolumeSpecName "kube-api-access-kcbxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:13.944619 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:13.944561    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d420d8d-ca28-482f-b975-053e8d4751ac-kube-api-access-9zt8h" (OuterVolumeSpecName: "kube-api-access-9zt8h") pod "2d420d8d-ca28-482f-b975-053e8d4751ac" (UID: "2d420d8d-ca28-482f-b975-053e8d4751ac"). InnerVolumeSpecName "kube-api-access-9zt8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:14.043748 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.043728    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcbxl\" (UniqueName: \"kubernetes.io/projected/b97ffa70-4f68-4065-aade-623fdd8ec908-kube-api-access-kcbxl\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:25:14.043748 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.043749    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zt8h\" (UniqueName: \"kubernetes.io/projected/2d420d8d-ca28-482f-b975-053e8d4751ac-kube-api-access-9zt8h\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:25:14.043868 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.043758    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d420d8d-ca28-482f-b975-053e8d4751ac-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:25:14.281310 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.281280    2559 generic.go:356] "Generic (PLEG): container finished" podID="b97ffa70-4f68-4065-aade-623fdd8ec908" containerID="bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165" exitCode=0
Sep 16 12:25:14.281484 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.281322    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"
Sep 16 12:25:14.281484 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.281361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn" event={"ID":"b97ffa70-4f68-4065-aade-623fdd8ec908","Type":"ContainerDied","Data":"bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165"}
Sep 16 12:25:14.281484 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.281422    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn" event={"ID":"b97ffa70-4f68-4065-aade-623fdd8ec908","Type":"ContainerDied","Data":"4bb9d787e3f61d609c9425f5396b7b0ce5c4155ca9a2c7732680c2f893c2e777"}
Sep 16 12:25:14.281484 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.281458    2559 scope.go:117] "RemoveContainer" containerID="bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165"
Sep 16 12:25:14.283520 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.283016    2559 generic.go:356] "Generic (PLEG): container finished" podID="2d420d8d-ca28-482f-b975-053e8d4751ac" containerID="e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71" exitCode=0
Sep 16 12:25:14.283520 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.283051    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz" event={"ID":"2d420d8d-ca28-482f-b975-053e8d4751ac","Type":"ContainerDied","Data":"e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71"}
Sep 16 12:25:14.283520 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.283075    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"
Sep 16 12:25:14.283520 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.283102    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz" event={"ID":"2d420d8d-ca28-482f-b975-053e8d4751ac","Type":"ContainerDied","Data":"43cdd1ad7da02e846d8ac98098ee45e0f5e918587f429e593b5afeab43802875"}
Sep 16 12:25:14.291909 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.291894    2559 scope.go:117] "RemoveContainer" containerID="bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165"
Sep 16 12:25:14.292181 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:25:14.292163    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165\": container with ID starting with bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165 not found: ID does not exist" containerID="bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165"
Sep 16 12:25:14.292233 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.292188    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165"} err="failed to get container status \"bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165\": rpc error: code = NotFound desc = could not find container \"bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165\": container with ID starting with bd2542b50aedc181d8524097902a19a27181584c3d9292440598883587f7f165 not found: ID does not exist"
Sep 16 12:25:14.292233 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.292208    2559 scope.go:117] "RemoveContainer" containerID="e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71"
Sep 16 12:25:14.301570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.301557    2559 scope.go:117] "RemoveContainer" containerID="e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71"
Sep 16 12:25:14.301813 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:25:14.301792    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71\": container with ID starting with e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71 not found: ID does not exist" containerID="e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71"
Sep 16 12:25:14.301882 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.301819    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71"} err="failed to get container status \"e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71\": rpc error: code = NotFound desc = could not find container \"e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71\": container with ID starting with e07e9ae0358429e414d2a57f9f1dc997a478fdab1e00d0622892c256f715df71 not found: ID does not exist"
Sep 16 12:25:14.302576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.302518    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"]
Sep 16 12:25:14.305472 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.305451    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2bc0450-676bc9d9f4-lb9qz"]
Sep 16 12:25:14.315897 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.315875    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"]
Sep 16 12:25:14.321103 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:14.321079    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2bc0450-69bbbdc77-88gsn"]
Sep 16 12:25:16.031288 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:16.031251    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d420d8d-ca28-482f-b975-053e8d4751ac" path="/var/lib/kubelet/pods/2d420d8d-ca28-482f-b975-053e8d4751ac/volumes"
Sep 16 12:25:16.031739 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:16.031612    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97ffa70-4f68-4065-aade-623fdd8ec908" path="/var/lib/kubelet/pods/b97ffa70-4f68-4065-aade-623fdd8ec908/volumes"
Sep 16 12:25:35.791957 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:35.791922    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"]
Sep 16 12:25:35.792500 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:35.792197    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld" podUID="b3de8ea4-cf14-4abe-9988-a80e14d47be2" containerName="payload-processing" containerID="cri-o://e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2" gracePeriod=30
Sep 16 12:25:35.800762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:35.800144    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"]
Sep 16 12:25:35.800762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:35.800393    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp" podUID="c2db95d2-5054-4424-b964-74a724ea7abf" containerName="payload-pre-processing" containerID="cri-o://02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96" gracePeriod=30
Sep 16 12:25:36.098662 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.098636    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:25:36.102096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.102076    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:25:36.240459 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.240432    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2db95d2-5054-4424-b964-74a724ea7abf-plugins-config-volume\") pod \"c2db95d2-5054-4424-b964-74a724ea7abf\" (UID: \"c2db95d2-5054-4424-b964-74a724ea7abf\") "
Sep 16 12:25:36.240613 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.240473    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pn82\" (UniqueName: \"kubernetes.io/projected/c2db95d2-5054-4424-b964-74a724ea7abf-kube-api-access-9pn82\") pod \"c2db95d2-5054-4424-b964-74a724ea7abf\" (UID: \"c2db95d2-5054-4424-b964-74a724ea7abf\") "
Sep 16 12:25:36.240613 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.240552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3de8ea4-cf14-4abe-9988-a80e14d47be2-plugins-config-volume\") pod \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\" (UID: \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\") "
Sep 16 12:25:36.240613 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.240600    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prsv5\" (UniqueName: \"kubernetes.io/projected/b3de8ea4-cf14-4abe-9988-a80e14d47be2-kube-api-access-prsv5\") pod \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\" (UID: \"b3de8ea4-cf14-4abe-9988-a80e14d47be2\") "
Sep 16 12:25:36.240872 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.240838    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2db95d2-5054-4424-b964-74a724ea7abf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2db95d2-5054-4424-b964-74a724ea7abf" (UID: "c2db95d2-5054-4424-b964-74a724ea7abf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:36.240983 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.240967    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3de8ea4-cf14-4abe-9988-a80e14d47be2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3de8ea4-cf14-4abe-9988-a80e14d47be2" (UID: "b3de8ea4-cf14-4abe-9988-a80e14d47be2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:36.242505 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.242483    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2db95d2-5054-4424-b964-74a724ea7abf-kube-api-access-9pn82" (OuterVolumeSpecName: "kube-api-access-9pn82") pod "c2db95d2-5054-4424-b964-74a724ea7abf" (UID: "c2db95d2-5054-4424-b964-74a724ea7abf"). InnerVolumeSpecName "kube-api-access-9pn82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:36.242571 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.242506    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3de8ea4-cf14-4abe-9988-a80e14d47be2-kube-api-access-prsv5" (OuterVolumeSpecName: "kube-api-access-prsv5") pod "b3de8ea4-cf14-4abe-9988-a80e14d47be2" (UID: "b3de8ea4-cf14-4abe-9988-a80e14d47be2"). InnerVolumeSpecName "kube-api-access-prsv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:36.341976 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.341918    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3de8ea4-cf14-4abe-9988-a80e14d47be2-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:25:36.341976 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.341940    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prsv5\" (UniqueName: \"kubernetes.io/projected/b3de8ea4-cf14-4abe-9988-a80e14d47be2-kube-api-access-prsv5\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:25:36.341976 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.341951    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2db95d2-5054-4424-b964-74a724ea7abf-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:25:36.341976 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.341959    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pn82\" (UniqueName: \"kubernetes.io/projected/c2db95d2-5054-4424-b964-74a724ea7abf-kube-api-access-9pn82\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:25:36.405767 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.405735    2559 generic.go:356] "Generic (PLEG): container finished" podID="c2db95d2-5054-4424-b964-74a724ea7abf" containerID="02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96" exitCode=0
Sep 16 12:25:36.405900 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.405774    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"
Sep 16 12:25:36.405900 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.405826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp" event={"ID":"c2db95d2-5054-4424-b964-74a724ea7abf","Type":"ContainerDied","Data":"02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96"}
Sep 16 12:25:36.405900 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.405888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp" event={"ID":"c2db95d2-5054-4424-b964-74a724ea7abf","Type":"ContainerDied","Data":"411d6f700cac0de5a6c18f7c4b568c8afdf97ff5512f4f51c5d52db899b36060"}
Sep 16 12:25:36.406124 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.405919    2559 scope.go:117] "RemoveContainer" containerID="02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96"
Sep 16 12:25:36.407241 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.407221    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3de8ea4-cf14-4abe-9988-a80e14d47be2" containerID="e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2" exitCode=0
Sep 16 12:25:36.407325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.407259    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld" event={"ID":"b3de8ea4-cf14-4abe-9988-a80e14d47be2","Type":"ContainerDied","Data":"e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2"}
Sep 16 12:25:36.407325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.407268    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"
Sep 16 12:25:36.407325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.407289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld" event={"ID":"b3de8ea4-cf14-4abe-9988-a80e14d47be2","Type":"ContainerDied","Data":"10965369ed8f9b1cab7fe306edd62d0fefe8503eae3963bc3f3a55563b885c49"}
Sep 16 12:25:36.414682 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.414665    2559 scope.go:117] "RemoveContainer" containerID="02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96"
Sep 16 12:25:36.414966 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:25:36.414943    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96\": container with ID starting with 02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96 not found: ID does not exist" containerID="02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96"
Sep 16 12:25:36.415028 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.414978    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96"} err="failed to get container status \"02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96\": rpc error: code = NotFound desc = could not find container \"02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96\": container with ID starting with 02d2e9cf2e5a7b802277779ec9eb6468f97039f723912140e5b904697a608d96 not found: ID does not exist"
Sep 16 12:25:36.415028 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.415000    2559 scope.go:117] "RemoveContainer" containerID="e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2"
Sep 16 12:25:36.422769 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.422753    2559 scope.go:117] "RemoveContainer" containerID="e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2"
Sep 16 12:25:36.423038 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:25:36.423023    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2\": container with ID starting with e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2 not found: ID does not exist" containerID="e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2"
Sep 16 12:25:36.423083 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.423044    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2"} err="failed to get container status \"e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2\": rpc error: code = NotFound desc = could not find container \"e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2\": container with ID starting with e49e7edc4a7772c865fb50fc71271c925059bc8118f0d0aa3caf524c299056d2 not found: ID does not exist"
Sep 16 12:25:36.432207 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.432188    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"]
Sep 16 12:25:36.436217 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.436192    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4915f8-87fcf949d-gb4fp"]
Sep 16 12:25:36.451590 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.451567    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"]
Sep 16 12:25:36.464520 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:36.464488    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4915f8-59d587c745-pw4ld"]
Sep 16 12:25:38.031169 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:38.031137    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3de8ea4-cf14-4abe-9988-a80e14d47be2" path="/var/lib/kubelet/pods/b3de8ea4-cf14-4abe-9988-a80e14d47be2/volumes"
Sep 16 12:25:38.031505 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:38.031482    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2db95d2-5054-4424-b964-74a724ea7abf" path="/var/lib/kubelet/pods/c2db95d2-5054-4424-b964-74a724ea7abf/volumes"
Sep 16 12:25:40.173399 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173368    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"]
Sep 16 12:25:40.173832 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173816    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2db95d2-5054-4424-b964-74a724ea7abf" containerName="payload-pre-processing"
Sep 16 12:25:40.173832 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173833    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2db95d2-5054-4424-b964-74a724ea7abf" containerName="payload-pre-processing"
Sep 16 12:25:40.173923 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173844    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d420d8d-ca28-482f-b975-053e8d4751ac" containerName="payload-pre-processing"
Sep 16 12:25:40.173923 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173851    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d420d8d-ca28-482f-b975-053e8d4751ac" containerName="payload-pre-processing"
Sep 16 12:25:40.173923 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173880    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97ffa70-4f68-4065-aade-623fdd8ec908" containerName="payload-processing"
Sep 16 12:25:40.173923 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173885    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97ffa70-4f68-4065-aade-623fdd8ec908" containerName="payload-processing"
Sep 16 12:25:40.173923 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173896    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3de8ea4-cf14-4abe-9988-a80e14d47be2" containerName="payload-processing"
Sep 16 12:25:40.173923 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173901    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3de8ea4-cf14-4abe-9988-a80e14d47be2" containerName="payload-processing"
Sep 16 12:25:40.174116 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173988    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2db95d2-5054-4424-b964-74a724ea7abf" containerName="payload-pre-processing"
Sep 16 12:25:40.174116 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.173996    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b97ffa70-4f68-4065-aade-623fdd8ec908" containerName="payload-processing"
Sep 16 12:25:40.174116 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.174003    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3de8ea4-cf14-4abe-9988-a80e14d47be2" containerName="payload-processing"
Sep 16 12:25:40.174116 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.174009    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d420d8d-ca28-482f-b975-053e8d4751ac" containerName="payload-pre-processing"
Sep 16 12:25:40.178620 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.178601    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:40.181863 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.181834    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-65d8af\""
Sep 16 12:25:40.181992 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.181907    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-65d8af-dockercfg-sx5g9\""
Sep 16 12:25:40.186865 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.186838    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"]
Sep 16 12:25:40.202226 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.202202    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"]
Sep 16 12:25:40.205990 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.205973    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.208365 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.208339    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-7a4d5c\"/\"e2e-conflict-b-808e27b0-kserve-self-signed-certs\""
Sep 16 12:25:40.212913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.212891    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"]
Sep 16 12:25:40.216586 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.216566    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"]
Sep 16 12:25:40.216685 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.216633    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:25:40.227478 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.227456    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"]
Sep 16 12:25:40.278875 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.278823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6605a5-ee9e-4b7b-b893-c18070974850-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl\" (UID: \"bc6605a5-ee9e-4b7b-b893-c18070974850\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:40.279060 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.278889    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhjl8\" (UniqueName: \"kubernetes.io/projected/bc6605a5-ee9e-4b7b-b893-c18070974850-kube-api-access-jhjl8\") pod \"payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl\" (UID: \"bc6605a5-ee9e-4b7b-b893-c18070974850\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:40.379608 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.379577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e05eb6-2e04-4e61-8c05-845a735b0310-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp\" (UID: \"37e05eb6-2e04-4e61-8c05-845a735b0310\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:25:40.379777 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.379629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-home\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.379777 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.379657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tmp-dir\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.379777 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.379713    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-model-cache\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.379777 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.379745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6605a5-ee9e-4b7b-b893-c18070974850-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl\" (UID: \"bc6605a5-ee9e-4b7b-b893-c18070974850\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:40.379777 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.379776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhjl8\" (UniqueName: \"kubernetes.io/projected/bc6605a5-ee9e-4b7b-b893-c18070974850-kube-api-access-jhjl8\") pod \"payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl\" (UID: \"bc6605a5-ee9e-4b7b-b893-c18070974850\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:40.379977 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.379830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h268\" (UniqueName: \"kubernetes.io/projected/37e05eb6-2e04-4e61-8c05-845a735b0310-kube-api-access-5h268\") pod \"payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp\" (UID: \"37e05eb6-2e04-4e61-8c05-845a735b0310\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:25:40.379977 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.379878    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tls-certs\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.379977 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.379960    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjllm\" (UniqueName: \"kubernetes.io/projected/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-kube-api-access-cjllm\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.380107 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.380002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-dshm\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.380487 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.380468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6605a5-ee9e-4b7b-b893-c18070974850-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl\" (UID: \"bc6605a5-ee9e-4b7b-b893-c18070974850\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:40.388248 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.388227    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhjl8\" (UniqueName: \"kubernetes.io/projected/bc6605a5-ee9e-4b7b-b893-c18070974850-kube-api-access-jhjl8\") pod \"payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl\" (UID: \"bc6605a5-ee9e-4b7b-b893-c18070974850\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:40.481366 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481302    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e05eb6-2e04-4e61-8c05-845a735b0310-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp\" (UID: \"37e05eb6-2e04-4e61-8c05-845a735b0310\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:25:40.481366 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-home\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.481556 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tmp-dir\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.481556 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-model-cache\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.481556 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h268\" (UniqueName: \"kubernetes.io/projected/37e05eb6-2e04-4e61-8c05-845a735b0310-kube-api-access-5h268\") pod \"payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp\" (UID: \"37e05eb6-2e04-4e61-8c05-845a735b0310\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:25:40.481556 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tls-certs\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.481556 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481511    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjllm\" (UniqueName: \"kubernetes.io/projected/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-kube-api-access-cjllm\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.481556 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-dshm\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.481897 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tmp-dir\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.481897 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481804    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-model-cache\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.481897 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.481878    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-home\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.482262 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.482240    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e05eb6-2e04-4e61-8c05-845a735b0310-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp\" (UID: \"37e05eb6-2e04-4e61-8c05-845a735b0310\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:25:40.483675 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.483655    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-dshm\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.483954 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.483934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tls-certs\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.489424 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.489403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h268\" (UniqueName: \"kubernetes.io/projected/37e05eb6-2e04-4e61-8c05-845a735b0310-kube-api-access-5h268\") pod \"payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp\" (UID: \"37e05eb6-2e04-4e61-8c05-845a735b0310\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:25:40.489777 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.489756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjllm\" (UniqueName: \"kubernetes.io/projected/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-kube-api-access-cjllm\") pod \"e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") " pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.489893 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.489880    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:40.516255 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.516048    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:40.526825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.526612    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:25:40.777411 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.777385    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"]
Sep 16 12:25:40.779346 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:25:40.779320    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6605a5_ee9e_4b7b_b893_c18070974850.slice/crio-4dcab94ccd142c68dbc11cd3e945629dbf979151ce88f6d92d12953debeed009 WatchSource:0}: Error finding container 4dcab94ccd142c68dbc11cd3e945629dbf979151ce88f6d92d12953debeed009: Status 404 returned error can't find the container with id 4dcab94ccd142c68dbc11cd3e945629dbf979151ce88f6d92d12953debeed009
Sep 16 12:25:40.815181 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.815105    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"]
Sep 16 12:25:40.815897 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:25:40.815863    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e05eb6_2e04_4e61_8c05_845a735b0310.slice/crio-b3d40e8714035ef78b2153965487b780877d2b4dddce7f5839c8967d110891ab WatchSource:0}: Error finding container b3d40e8714035ef78b2153965487b780877d2b4dddce7f5839c8967d110891ab: Status 404 returned error can't find the container with id b3d40e8714035ef78b2153965487b780877d2b4dddce7f5839c8967d110891ab
Sep 16 12:25:40.817576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:40.817557    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"]
Sep 16 12:25:40.819265 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:25:40.819240    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e94e49f_d4f9_463f_8ce5_58bbe42598b1.slice/crio-6079d7b9894a1797fdc1cd7a016b7c666040fb70c8bd0847a1a671a6e4ec92a7 WatchSource:0}: Error finding container 6079d7b9894a1797fdc1cd7a016b7c666040fb70c8bd0847a1a671a6e4ec92a7: Status 404 returned error can't find the container with id 6079d7b9894a1797fdc1cd7a016b7c666040fb70c8bd0847a1a671a6e4ec92a7
Sep 16 12:25:41.437046 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.437010    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm" event={"ID":"5e94e49f-d4f9-463f-8ce5-58bbe42598b1","Type":"ContainerStarted","Data":"b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678"}
Sep 16 12:25:41.437500 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.437060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm" event={"ID":"5e94e49f-d4f9-463f-8ce5-58bbe42598b1","Type":"ContainerStarted","Data":"6079d7b9894a1797fdc1cd7a016b7c666040fb70c8bd0847a1a671a6e4ec92a7"}
Sep 16 12:25:41.438723 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.438674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp" event={"ID":"37e05eb6-2e04-4e61-8c05-845a735b0310","Type":"ContainerStarted","Data":"56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919"}
Sep 16 12:25:41.438864 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.438741    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp" event={"ID":"37e05eb6-2e04-4e61-8c05-845a735b0310","Type":"ContainerStarted","Data":"b3d40e8714035ef78b2153965487b780877d2b4dddce7f5839c8967d110891ab"}
Sep 16 12:25:41.438864 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.438768    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:25:41.440334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.440307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl" event={"ID":"bc6605a5-ee9e-4b7b-b893-c18070974850","Type":"ContainerStarted","Data":"f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8"}
Sep 16 12:25:41.440467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.440362    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl" event={"ID":"bc6605a5-ee9e-4b7b-b893-c18070974850","Type":"ContainerStarted","Data":"4dcab94ccd142c68dbc11cd3e945629dbf979151ce88f6d92d12953debeed009"}
Sep 16 12:25:41.440467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.440394    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:41.455685 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.455638    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm" podStartSLOduration=1.455619099 podStartE2EDuration="1.455619099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:25:41.452359132 +0000 UTC m=+1497.895393984" watchObservedRunningTime="2026-09-16 12:25:41.455619099 +0000 UTC m=+1497.898653966"
Sep 16 12:25:41.468389 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.468339    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl" podStartSLOduration=1.468325864 podStartE2EDuration="1.468325864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:25:41.467063704 +0000 UTC m=+1497.910098567" watchObservedRunningTime="2026-09-16 12:25:41.468325864 +0000 UTC m=+1497.911360726"
Sep 16 12:25:41.485930 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:41.485884    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp" podStartSLOduration=1.485872523 podStartE2EDuration="1.485872523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:25:41.484868327 +0000 UTC m=+1497.927903190" watchObservedRunningTime="2026-09-16 12:25:41.485872523 +0000 UTC m=+1497.928907386"
Sep 16 12:25:50.516567 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:50.516533    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:50.516960 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:50.516592    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:50.529299 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:50.529276    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:51.505248 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:51.505222    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:25:52.447354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:52.447320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:25:52.447779 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:25:52.447412    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:26:00.486605 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.486571    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"]
Sep 16 12:26:00.490206 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.490188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:00.492758 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.492735    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f9133e\""
Sep 16 12:26:00.498735 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.498670    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"]
Sep 16 12:26:00.559528 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.559495    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr47n\" (UniqueName: \"kubernetes.io/projected/bc19a45e-5766-462c-878f-e06aea73dfda-kube-api-access-wr47n\") pod \"payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6\" (UID: \"bc19a45e-5766-462c-878f-e06aea73dfda\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:00.559669 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.559542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc19a45e-5766-462c-878f-e06aea73dfda-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6\" (UID: \"bc19a45e-5766-462c-878f-e06aea73dfda\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:00.660964 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.660922    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr47n\" (UniqueName: \"kubernetes.io/projected/bc19a45e-5766-462c-878f-e06aea73dfda-kube-api-access-wr47n\") pod \"payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6\" (UID: \"bc19a45e-5766-462c-878f-e06aea73dfda\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:00.660964 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.660967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc19a45e-5766-462c-878f-e06aea73dfda-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6\" (UID: \"bc19a45e-5766-462c-878f-e06aea73dfda\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:00.661676 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.661654    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc19a45e-5766-462c-878f-e06aea73dfda-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6\" (UID: \"bc19a45e-5766-462c-878f-e06aea73dfda\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:00.668631 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.668612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr47n\" (UniqueName: \"kubernetes.io/projected/bc19a45e-5766-462c-878f-e06aea73dfda-kube-api-access-wr47n\") pod \"payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6\" (UID: \"bc19a45e-5766-462c-878f-e06aea73dfda\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:00.801034 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:00.800969    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:01.074254 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:01.074227    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"]
Sep 16 12:26:01.076113 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:26:01.076082    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc19a45e_5766_462c_878f_e06aea73dfda.slice/crio-b1323a7a0db05c69910e88faafc7f164492b95384da339bc6999dfeefb97971e WatchSource:0}: Error finding container b1323a7a0db05c69910e88faafc7f164492b95384da339bc6999dfeefb97971e: Status 404 returned error can't find the container with id b1323a7a0db05c69910e88faafc7f164492b95384da339bc6999dfeefb97971e
Sep 16 12:26:01.569867 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:01.569832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6" event={"ID":"bc19a45e-5766-462c-878f-e06aea73dfda","Type":"ContainerStarted","Data":"3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81"}
Sep 16 12:26:01.570257 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:01.569908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6" event={"ID":"bc19a45e-5766-462c-878f-e06aea73dfda","Type":"ContainerStarted","Data":"b1323a7a0db05c69910e88faafc7f164492b95384da339bc6999dfeefb97971e"}
Sep 16 12:26:01.570257 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:01.569949    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:01.585530 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:01.585481    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6" podStartSLOduration=1.585467682 podStartE2EDuration="1.585467682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:01.585136187 +0000 UTC m=+1518.028171049" watchObservedRunningTime="2026-09-16 12:26:01.585467682 +0000 UTC m=+1518.028502543"
Sep 16 12:26:12.578183 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:12.578100    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:26:15.900580 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:15.900545    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"]
Sep 16 12:26:15.901083 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:15.900809    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498" podUID="87e16b26-1853-4634-af3e-e99ef8276eb7" containerName="payload-processing" containerID="cri-o://493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7" gracePeriod=30
Sep 16 12:26:15.907804 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:15.907729    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"]
Sep 16 12:26:15.908052 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:15.907942    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5" podUID="c270dd46-7c44-47c9-b99c-17748434f2c5" containerName="payload-pre-processing" containerID="cri-o://fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a" gracePeriod=30
Sep 16 12:26:16.163532 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.163475    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:26:16.194635 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.194615    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:26:16.302828 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.302799    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmv8w\" (UniqueName: \"kubernetes.io/projected/c270dd46-7c44-47c9-b99c-17748434f2c5-kube-api-access-qmv8w\") pod \"c270dd46-7c44-47c9-b99c-17748434f2c5\" (UID: \"c270dd46-7c44-47c9-b99c-17748434f2c5\") "
Sep 16 12:26:16.302988 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.302887    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv9bc\" (UniqueName: \"kubernetes.io/projected/87e16b26-1853-4634-af3e-e99ef8276eb7-kube-api-access-dv9bc\") pod \"87e16b26-1853-4634-af3e-e99ef8276eb7\" (UID: \"87e16b26-1853-4634-af3e-e99ef8276eb7\") "
Sep 16 12:26:16.302988 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.302923    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c270dd46-7c44-47c9-b99c-17748434f2c5-plugins-config-volume\") pod \"c270dd46-7c44-47c9-b99c-17748434f2c5\" (UID: \"c270dd46-7c44-47c9-b99c-17748434f2c5\") "
Sep 16 12:26:16.302988 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.302971    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e16b26-1853-4634-af3e-e99ef8276eb7-plugins-config-volume\") pod \"87e16b26-1853-4634-af3e-e99ef8276eb7\" (UID: \"87e16b26-1853-4634-af3e-e99ef8276eb7\") "
Sep 16 12:26:16.303334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.303293    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c270dd46-7c44-47c9-b99c-17748434f2c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c270dd46-7c44-47c9-b99c-17748434f2c5" (UID: "c270dd46-7c44-47c9-b99c-17748434f2c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:26:16.303436 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.303352    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87e16b26-1853-4634-af3e-e99ef8276eb7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87e16b26-1853-4634-af3e-e99ef8276eb7" (UID: "87e16b26-1853-4634-af3e-e99ef8276eb7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:26:16.305072 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.305045    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87e16b26-1853-4634-af3e-e99ef8276eb7-kube-api-access-dv9bc" (OuterVolumeSpecName: "kube-api-access-dv9bc") pod "87e16b26-1853-4634-af3e-e99ef8276eb7" (UID: "87e16b26-1853-4634-af3e-e99ef8276eb7"). InnerVolumeSpecName "kube-api-access-dv9bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:26:16.305192 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.305075    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c270dd46-7c44-47c9-b99c-17748434f2c5-kube-api-access-qmv8w" (OuterVolumeSpecName: "kube-api-access-qmv8w") pod "c270dd46-7c44-47c9-b99c-17748434f2c5" (UID: "c270dd46-7c44-47c9-b99c-17748434f2c5"). InnerVolumeSpecName "kube-api-access-qmv8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:26:16.404776 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.404750    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv9bc\" (UniqueName: \"kubernetes.io/projected/87e16b26-1853-4634-af3e-e99ef8276eb7-kube-api-access-dv9bc\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:16.404776 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.404770    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c270dd46-7c44-47c9-b99c-17748434f2c5-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:16.404919 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.404783    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87e16b26-1853-4634-af3e-e99ef8276eb7-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:16.404919 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.404792    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmv8w\" (UniqueName: \"kubernetes.io/projected/c270dd46-7c44-47c9-b99c-17748434f2c5-kube-api-access-qmv8w\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:16.651614 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.651583    2559 generic.go:356] "Generic (PLEG): container finished" podID="87e16b26-1853-4634-af3e-e99ef8276eb7" containerID="493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7" exitCode=0
Sep 16 12:26:16.651804 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.651642    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"
Sep 16 12:26:16.651804 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.651690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498" event={"ID":"87e16b26-1853-4634-af3e-e99ef8276eb7","Type":"ContainerDied","Data":"493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7"}
Sep 16 12:26:16.651804 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.651772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498" event={"ID":"87e16b26-1853-4634-af3e-e99ef8276eb7","Type":"ContainerDied","Data":"382d9d01f2cbf6106df78818095c309d95c7d7d8ac676359d63e2238f019f596"}
Sep 16 12:26:16.651804 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.651803    2559 scope.go:117] "RemoveContainer" containerID="493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7"
Sep 16 12:26:16.653335 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.653311    2559 generic.go:356] "Generic (PLEG): container finished" podID="c270dd46-7c44-47c9-b99c-17748434f2c5" containerID="fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a" exitCode=0
Sep 16 12:26:16.653441 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.653369    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5" event={"ID":"c270dd46-7c44-47c9-b99c-17748434f2c5","Type":"ContainerDied","Data":"fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a"}
Sep 16 12:26:16.653441 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.653415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5" event={"ID":"c270dd46-7c44-47c9-b99c-17748434f2c5","Type":"ContainerDied","Data":"98bfc16a8f046e9155bcce01b00232b19f6ddb67d4a7400a190fc4f4791bf222"}
Sep 16 12:26:16.653558 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.653481    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"
Sep 16 12:26:16.663285 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.663262    2559 scope.go:117] "RemoveContainer" containerID="493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7"
Sep 16 12:26:16.663570 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:26:16.663549    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7\": container with ID starting with 493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7 not found: ID does not exist" containerID="493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7"
Sep 16 12:26:16.663636 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.663578    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7"} err="failed to get container status \"493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7\": rpc error: code = NotFound desc = could not find container \"493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7\": container with ID starting with 493bb1a72278b0a552530d48d0c4809a0a9af0b72f13e9520e2c111161f7d4b7 not found: ID does not exist"
Sep 16 12:26:16.663636 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.663597    2559 scope.go:117] "RemoveContainer" containerID="fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a"
Sep 16 12:26:16.673746 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.673730    2559 scope.go:117] "RemoveContainer" containerID="fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a"
Sep 16 12:26:16.674008 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:26:16.673991    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a\": container with ID starting with fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a not found: ID does not exist" containerID="fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a"
Sep 16 12:26:16.674057 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.674014    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a"} err="failed to get container status \"fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a\": rpc error: code = NotFound desc = could not find container \"fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a\": container with ID starting with fba0c447c5312d9958a9adda9cced1f2bf06b88ff390a2cf97843879b646d21a not found: ID does not exist"
Sep 16 12:26:16.677384 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.677363    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"]
Sep 16 12:26:16.682808 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.682789    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4bef4d-6dd8c86645-jm498"]
Sep 16 12:26:16.701209 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.701187    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"]
Sep 16 12:26:16.705314 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:16.705295    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4bef4d-dcd47bd78-5kjc5"]
Sep 16 12:26:18.031543 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:18.031514    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87e16b26-1853-4634-af3e-e99ef8276eb7" path="/var/lib/kubelet/pods/87e16b26-1853-4634-af3e-e99ef8276eb7/volumes"
Sep 16 12:26:18.031930 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:18.031905    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c270dd46-7c44-47c9-b99c-17748434f2c5" path="/var/lib/kubelet/pods/c270dd46-7c44-47c9-b99c-17748434f2c5/volumes"
Sep 16 12:26:23.098566 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:23.098536    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"]
Sep 16 12:26:23.098964 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:23.098807    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy" containerID="cri-o://04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45" gracePeriod=30
Sep 16 12:26:24.328913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:24.328879    2559 patch_prober.go:28] interesting pod/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:26:24.329382 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:24.328946    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:26:28.349839 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.349808    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:26:28.517060 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517021    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-credential-socket\") pod \"02ff6e86-96bd-476a-b556-52ac3710372e\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") "
Sep 16 12:26:28.517060 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517065    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-istio-token\") pod \"02ff6e86-96bd-476a-b556-52ac3710372e\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") "
Sep 16 12:26:28.517313 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517118    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-data\") pod \"02ff6e86-96bd-476a-b556-52ac3710372e\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") "
Sep 16 12:26:28.517313 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517155    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-socket\") pod \"02ff6e86-96bd-476a-b556-52ac3710372e\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") "
Sep 16 12:26:28.517313 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517186    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ff6e86-96bd-476a-b556-52ac3710372e-istio-podinfo\") pod \"02ff6e86-96bd-476a-b556-52ac3710372e\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") "
Sep 16 12:26:28.517313 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517218    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ff6e86-96bd-476a-b556-52ac3710372e-istiod-ca-cert\") pod \"02ff6e86-96bd-476a-b556-52ac3710372e\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") "
Sep 16 12:26:28.517313 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-certs\") pod \"02ff6e86-96bd-476a-b556-52ac3710372e\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") "
Sep 16 12:26:28.517562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517308    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02ff6e86-96bd-476a-b556-52ac3710372e" (UID: "02ff6e86-96bd-476a-b556-52ac3710372e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:28.517562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517344    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-envoy\") pod \"02ff6e86-96bd-476a-b556-52ac3710372e\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") "
Sep 16 12:26:28.517562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517373    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmd9f\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-kube-api-access-bmd9f\") pod \"02ff6e86-96bd-476a-b556-52ac3710372e\" (UID: \"02ff6e86-96bd-476a-b556-52ac3710372e\") "
Sep 16 12:26:28.517562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517398    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-data" (OuterVolumeSpecName: "istio-data") pod "02ff6e86-96bd-476a-b556-52ac3710372e" (UID: "02ff6e86-96bd-476a-b556-52ac3710372e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:28.517562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517408    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02ff6e86-96bd-476a-b556-52ac3710372e" (UID: "02ff6e86-96bd-476a-b556-52ac3710372e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:28.517562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517464    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02ff6e86-96bd-476a-b556-52ac3710372e" (UID: "02ff6e86-96bd-476a-b556-52ac3710372e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:28.517891 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517650    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ff6e86-96bd-476a-b556-52ac3710372e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02ff6e86-96bd-476a-b556-52ac3710372e" (UID: "02ff6e86-96bd-476a-b556-52ac3710372e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:26:28.517891 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517795    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-data\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:28.517891 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517819    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:28.517891 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517834    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ff6e86-96bd-476a-b556-52ac3710372e-istiod-ca-cert\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:28.517891 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517847    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-workload-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:28.517891 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.517860    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-credential-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:28.519311 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.519283    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-istio-token" (OuterVolumeSpecName: "istio-token") pod "02ff6e86-96bd-476a-b556-52ac3710372e" (UID: "02ff6e86-96bd-476a-b556-52ac3710372e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:26:28.519431 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.519392    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02ff6e86-96bd-476a-b556-52ac3710372e" (UID: "02ff6e86-96bd-476a-b556-52ac3710372e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:26:28.519652 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.519630    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02ff6e86-96bd-476a-b556-52ac3710372e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02ff6e86-96bd-476a-b556-52ac3710372e" (UID: "02ff6e86-96bd-476a-b556-52ac3710372e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:26:28.519734 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.519665    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-kube-api-access-bmd9f" (OuterVolumeSpecName: "kube-api-access-bmd9f") pod "02ff6e86-96bd-476a-b556-52ac3710372e" (UID: "02ff6e86-96bd-476a-b556-52ac3710372e"). InnerVolumeSpecName "kube-api-access-bmd9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:26:28.618915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.618891    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ff6e86-96bd-476a-b556-52ac3710372e-istio-envoy\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:28.618915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.618913    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmd9f\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-kube-api-access-bmd9f\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:28.619049 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.618922    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ff6e86-96bd-476a-b556-52ac3710372e-istio-token\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:28.619049 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.618931    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ff6e86-96bd-476a-b556-52ac3710372e-istio-podinfo\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:26:28.719232 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.719202    2559 generic.go:356] "Generic (PLEG): container finished" podID="02ff6e86-96bd-476a-b556-52ac3710372e" containerID="04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45" exitCode=0
Sep 16 12:26:28.719323 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.719256    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"
Sep 16 12:26:28.719323 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.719298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" event={"ID":"02ff6e86-96bd-476a-b556-52ac3710372e","Type":"ContainerDied","Data":"04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45"}
Sep 16 12:26:28.719400 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.719367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k" event={"ID":"02ff6e86-96bd-476a-b556-52ac3710372e","Type":"ContainerDied","Data":"b33223594b2f619700dd0e90546a87b378ea546a305c81c3c4d8c33a7f7482fa"}
Sep 16 12:26:28.719400 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.719393    2559 scope.go:117] "RemoveContainer" containerID="04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45"
Sep 16 12:26:28.728438 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.728419    2559 scope.go:117] "RemoveContainer" containerID="edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627"
Sep 16 12:26:28.736295 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.736276    2559 scope.go:117] "RemoveContainer" containerID="04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45"
Sep 16 12:26:28.736567 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:26:28.736549    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45\": container with ID starting with 04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45 not found: ID does not exist" containerID="04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45"
Sep 16 12:26:28.736644 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.736578    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45"} err="failed to get container status \"04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45\": rpc error: code = NotFound desc = could not find container \"04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45\": container with ID starting with 04f0586b6ee75d86f172597cf99154a5e719cbdbcc1c524cdbe0ce64b28a4a45 not found: ID does not exist"
Sep 16 12:26:28.736644 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.736602    2559 scope.go:117] "RemoveContainer" containerID="edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627"
Sep 16 12:26:28.736904 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:26:28.736881    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627\": container with ID starting with edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627 not found: ID does not exist" containerID="edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627"
Sep 16 12:26:28.736984 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.736912    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627"} err="failed to get container status \"edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627\": rpc error: code = NotFound desc = could not find container \"edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627\": container with ID starting with edc268b3018aa4cf0e0f6d27eb925e0b4c1d482112024fa3ab19a02156276627 not found: ID does not exist"
Sep 16 12:26:28.744143 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.744123    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"]
Sep 16 12:26:28.747362 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:28.747341    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4bef4d-openshift-default-64c768b77d-75c6k"]
Sep 16 12:26:30.031483 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.031450    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" path="/var/lib/kubelet/pods/02ff6e86-96bd-476a-b556-52ac3710372e/volumes"
Sep 16 12:26:30.305856 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.305780    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"]
Sep 16 12:26:30.306208 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.306195    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy"
Sep 16 12:26:30.306255 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.306209    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy"
Sep 16 12:26:30.306255 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.306224    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e16b26-1853-4634-af3e-e99ef8276eb7" containerName="payload-processing"
Sep 16 12:26:30.306255 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.306230    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e16b26-1853-4634-af3e-e99ef8276eb7" containerName="payload-processing"
Sep 16 12:26:30.306255 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.306244    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c270dd46-7c44-47c9-b99c-17748434f2c5" containerName="payload-pre-processing"
Sep 16 12:26:30.306255 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.306249    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c270dd46-7c44-47c9-b99c-17748434f2c5" containerName="payload-pre-processing"
Sep 16 12:26:30.306432 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.306309    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy"
Sep 16 12:26:30.306432 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.306319    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="87e16b26-1853-4634-af3e-e99ef8276eb7" containerName="payload-processing"
Sep 16 12:26:30.306432 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.306325    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c270dd46-7c44-47c9-b99c-17748434f2c5" containerName="payload-pre-processing"
Sep 16 12:26:30.309568 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.309551    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:30.312637 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.312614    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-72eee5-dockercfg-vxml6\""
Sep 16 12:26:30.312825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.312806    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-72eee5\""
Sep 16 12:26:30.322460 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.322439    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"]
Sep 16 12:26:30.332573 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.332551    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"]
Sep 16 12:26:30.333002 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.332986    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy"
Sep 16 12:26:30.333051 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.333004    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy"
Sep 16 12:26:30.333097 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.333084    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ff6e86-96bd-476a-b556-52ac3710372e" containerName="istio-proxy"
Sep 16 12:26:30.336230 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.336212    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:30.348311 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.348290    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"]
Sep 16 12:26:30.437324 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.437288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/392537c3-e3bc-4b48-b097-9251d34ee2aa-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z\" (UID: \"392537c3-e3bc-4b48-b097-9251d34ee2aa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:30.437482 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.437338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtpgs\" (UniqueName: \"kubernetes.io/projected/392537c3-e3bc-4b48-b097-9251d34ee2aa-kube-api-access-wtpgs\") pod \"payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z\" (UID: \"392537c3-e3bc-4b48-b097-9251d34ee2aa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:30.437482 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.437429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ph85\" (UniqueName: \"kubernetes.io/projected/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-kube-api-access-7ph85\") pod \"payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7\" (UID: \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:30.437586 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.437566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7\" (UID: \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:30.538106 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.538078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7\" (UID: \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:30.538277 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.538118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/392537c3-e3bc-4b48-b097-9251d34ee2aa-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z\" (UID: \"392537c3-e3bc-4b48-b097-9251d34ee2aa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:30.538277 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.538143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtpgs\" (UniqueName: \"kubernetes.io/projected/392537c3-e3bc-4b48-b097-9251d34ee2aa-kube-api-access-wtpgs\") pod \"payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z\" (UID: \"392537c3-e3bc-4b48-b097-9251d34ee2aa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:30.538277 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.538174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ph85\" (UniqueName: \"kubernetes.io/projected/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-kube-api-access-7ph85\") pod \"payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7\" (UID: \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:30.539059 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.539036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7\" (UID: \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:30.539113 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.539039    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/392537c3-e3bc-4b48-b097-9251d34ee2aa-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z\" (UID: \"392537c3-e3bc-4b48-b097-9251d34ee2aa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:30.546204 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.546183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtpgs\" (UniqueName: \"kubernetes.io/projected/392537c3-e3bc-4b48-b097-9251d34ee2aa-kube-api-access-wtpgs\") pod \"payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z\" (UID: \"392537c3-e3bc-4b48-b097-9251d34ee2aa\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:30.546376 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.546357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ph85\" (UniqueName: \"kubernetes.io/projected/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-kube-api-access-7ph85\") pod \"payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7\" (UID: \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:30.620654 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.620592    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:30.646836 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.646809    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:30.895143 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.895115    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"]
Sep 16 12:26:30.898517 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:26:30.898486    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1dd122d_4cb3_4e56_bea5_1b6275d4ec2f.slice/crio-773adf050146b2f94cd9b321674964af98028df656e6d237c394464492a575f8 WatchSource:0}: Error finding container 773adf050146b2f94cd9b321674964af98028df656e6d237c394464492a575f8: Status 404 returned error can't find the container with id 773adf050146b2f94cd9b321674964af98028df656e6d237c394464492a575f8
Sep 16 12:26:30.946362 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:30.946341    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"]
Sep 16 12:26:30.949032 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:26:30.949001    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392537c3_e3bc_4b48_b097_9251d34ee2aa.slice/crio-4e2986c2ef9ccb082e66ccefe08a4ac9847ae65e84bc5b958e6e1a2b4abec303 WatchSource:0}: Error finding container 4e2986c2ef9ccb082e66ccefe08a4ac9847ae65e84bc5b958e6e1a2b4abec303: Status 404 returned error can't find the container with id 4e2986c2ef9ccb082e66ccefe08a4ac9847ae65e84bc5b958e6e1a2b4abec303
Sep 16 12:26:31.749562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:31.749517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7" event={"ID":"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f","Type":"ContainerStarted","Data":"ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108"}
Sep 16 12:26:31.750052 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:31.749586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7" event={"ID":"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f","Type":"ContainerStarted","Data":"773adf050146b2f94cd9b321674964af98028df656e6d237c394464492a575f8"}
Sep 16 12:26:31.750052 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:31.749632    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:31.751850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:31.751823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z" event={"ID":"392537c3-e3bc-4b48-b097-9251d34ee2aa","Type":"ContainerStarted","Data":"c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3"}
Sep 16 12:26:31.751990 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:31.751872    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z" event={"ID":"392537c3-e3bc-4b48-b097-9251d34ee2aa","Type":"ContainerStarted","Data":"4e2986c2ef9ccb082e66ccefe08a4ac9847ae65e84bc5b958e6e1a2b4abec303"}
Sep 16 12:26:31.751990 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:31.751924    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:31.772221 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:31.772182    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7" podStartSLOduration=1.772169634 podStartE2EDuration="1.772169634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:31.770007604 +0000 UTC m=+1548.213042469" watchObservedRunningTime="2026-09-16 12:26:31.772169634 +0000 UTC m=+1548.215204497"
Sep 16 12:26:31.789566 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:31.789525    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z" podStartSLOduration=1.78951168 podStartE2EDuration="1.78951168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:31.786672582 +0000 UTC m=+1548.229707446" watchObservedRunningTime="2026-09-16 12:26:31.78951168 +0000 UTC m=+1548.232546569"
Sep 16 12:26:37.561704 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.561674    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"]
Sep 16 12:26:37.565782 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.565761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:37.568329 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.568305    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b1650816\""
Sep 16 12:26:37.568436 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.568409    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b1650816-dockercfg-nvgcz\""
Sep 16 12:26:37.573585 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.573558    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"]
Sep 16 12:26:37.600538 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.600515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f2834a7-8628-4e1b-aab1-150460161398-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz\" (UID: \"6f2834a7-8628-4e1b-aab1-150460161398\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:37.600647 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.600616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzs8j\" (UniqueName: \"kubernetes.io/projected/6f2834a7-8628-4e1b-aab1-150460161398-kube-api-access-nzs8j\") pod \"payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz\" (UID: \"6f2834a7-8628-4e1b-aab1-150460161398\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:37.603905 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.603884    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"]
Sep 16 12:26:37.607337 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.607324    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:37.618229 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.618209    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"]
Sep 16 12:26:37.702080 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.702050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrv57\" (UniqueName: \"kubernetes.io/projected/63d490c8-3e5c-4e04-b029-814d8e313409-kube-api-access-hrv57\") pod \"payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv\" (UID: \"63d490c8-3e5c-4e04-b029-814d8e313409\") " pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:37.702208 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.702102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f2834a7-8628-4e1b-aab1-150460161398-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz\" (UID: \"6f2834a7-8628-4e1b-aab1-150460161398\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:37.702208 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.702167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63d490c8-3e5c-4e04-b029-814d8e313409-plugins-config-volume\") pod \"payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv\" (UID: \"63d490c8-3e5c-4e04-b029-814d8e313409\") " pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:37.702313 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.702238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzs8j\" (UniqueName: \"kubernetes.io/projected/6f2834a7-8628-4e1b-aab1-150460161398-kube-api-access-nzs8j\") pod \"payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz\" (UID: \"6f2834a7-8628-4e1b-aab1-150460161398\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:37.702788 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.702770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f2834a7-8628-4e1b-aab1-150460161398-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz\" (UID: \"6f2834a7-8628-4e1b-aab1-150460161398\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:37.710610 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.710592    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzs8j\" (UniqueName: \"kubernetes.io/projected/6f2834a7-8628-4e1b-aab1-150460161398-kube-api-access-nzs8j\") pod \"payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz\" (UID: \"6f2834a7-8628-4e1b-aab1-150460161398\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:37.803158 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.803122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrv57\" (UniqueName: \"kubernetes.io/projected/63d490c8-3e5c-4e04-b029-814d8e313409-kube-api-access-hrv57\") pod \"payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv\" (UID: \"63d490c8-3e5c-4e04-b029-814d8e313409\") " pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:37.803347 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.803192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63d490c8-3e5c-4e04-b029-814d8e313409-plugins-config-volume\") pod \"payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv\" (UID: \"63d490c8-3e5c-4e04-b029-814d8e313409\") " pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:37.803902 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.803882    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63d490c8-3e5c-4e04-b029-814d8e313409-plugins-config-volume\") pod \"payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv\" (UID: \"63d490c8-3e5c-4e04-b029-814d8e313409\") " pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:37.811800 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.811739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrv57\" (UniqueName: \"kubernetes.io/projected/63d490c8-3e5c-4e04-b029-814d8e313409-kube-api-access-hrv57\") pod \"payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv\" (UID: \"63d490c8-3e5c-4e04-b029-814d8e313409\") " pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:37.877979 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.877949    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:37.917601 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:37.917569    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:38.150217 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.150183    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"]
Sep 16 12:26:38.152370 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:26:38.152328    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2834a7_8628_4e1b_aab1_150460161398.slice/crio-d764c7d19c3dff19c049b3b13a6821352f1a32a8accdcb1b279353ca36a998f5 WatchSource:0}: Error finding container d764c7d19c3dff19c049b3b13a6821352f1a32a8accdcb1b279353ca36a998f5: Status 404 returned error can't find the container with id d764c7d19c3dff19c049b3b13a6821352f1a32a8accdcb1b279353ca36a998f5
Sep 16 12:26:38.201345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.201322    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"]
Sep 16 12:26:38.202304 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:26:38.202282    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d490c8_3e5c_4e04_b029_814d8e313409.slice/crio-1bd808ec7ac91c6467f1e3a7d07ea9c9e8577c65212b14bd4c1231617b85d3bf WatchSource:0}: Error finding container 1bd808ec7ac91c6467f1e3a7d07ea9c9e8577c65212b14bd4c1231617b85d3bf: Status 404 returned error can't find the container with id 1bd808ec7ac91c6467f1e3a7d07ea9c9e8577c65212b14bd4c1231617b85d3bf
Sep 16 12:26:38.796261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.796207    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv" event={"ID":"63d490c8-3e5c-4e04-b029-814d8e313409","Type":"ContainerStarted","Data":"78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672"}
Sep 16 12:26:38.796758 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.796284    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:38.796758 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.796310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv" event={"ID":"63d490c8-3e5c-4e04-b029-814d8e313409","Type":"ContainerStarted","Data":"1bd808ec7ac91c6467f1e3a7d07ea9c9e8577c65212b14bd4c1231617b85d3bf"}
Sep 16 12:26:38.797992 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.797953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz" event={"ID":"6f2834a7-8628-4e1b-aab1-150460161398","Type":"ContainerStarted","Data":"000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f"}
Sep 16 12:26:38.798112 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.798005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz" event={"ID":"6f2834a7-8628-4e1b-aab1-150460161398","Type":"ContainerStarted","Data":"d764c7d19c3dff19c049b3b13a6821352f1a32a8accdcb1b279353ca36a998f5"}
Sep 16 12:26:38.798112 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.798046    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:38.819159 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.819112    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv" podStartSLOduration=1.819096399 podStartE2EDuration="1.819096399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:38.817296998 +0000 UTC m=+1555.260331885" watchObservedRunningTime="2026-09-16 12:26:38.819096399 +0000 UTC m=+1555.262131262"
Sep 16 12:26:38.838867 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:38.838828    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz" podStartSLOduration=1.838813561 podStartE2EDuration="1.838813561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:38.836789142 +0000 UTC m=+1555.279824017" watchObservedRunningTime="2026-09-16 12:26:38.838813561 +0000 UTC m=+1555.281848424"
Sep 16 12:26:42.759345 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:42.759316    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:26:42.759743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:42.759398    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:26:49.805321 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:49.805286    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:26:49.805712 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:49.805360    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:26:57.512185 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:57.512151    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"]
Sep 16 12:26:59.600939 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:26:59.600904    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"]
Sep 16 12:27:00.669506 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.669472    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"]
Sep 16 12:27:00.673169 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.673153    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:00.675746 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.675723    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-3be0c5-dockercfg-vgl9p\""
Sep 16 12:27:00.675878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.675781    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-3be0c5\""
Sep 16 12:27:00.683949 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.683927    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"]
Sep 16 12:27:00.700237 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.700212    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"]
Sep 16 12:27:00.704574 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.704553    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:00.716524 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.716499    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"]
Sep 16 12:27:00.806340 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.806300    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k\" (UID: \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:00.806517 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.806374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6\" (UID: \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:00.806574 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.806513    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9cvm\" (UniqueName: \"kubernetes.io/projected/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-kube-api-access-v9cvm\") pod \"payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k\" (UID: \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:00.806628 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.806567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74z5c\" (UniqueName: \"kubernetes.io/projected/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-kube-api-access-74z5c\") pod \"payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6\" (UID: \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:00.908010 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.907976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74z5c\" (UniqueName: \"kubernetes.io/projected/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-kube-api-access-74z5c\") pod \"payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6\" (UID: \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:00.908159 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.908041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k\" (UID: \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:00.908159 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.908081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6\" (UID: \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:00.908159 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.908140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cvm\" (UniqueName: \"kubernetes.io/projected/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-kube-api-access-v9cvm\") pod \"payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k\" (UID: \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:00.909019 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.908997    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k\" (UID: \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:00.909078 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.908997    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6\" (UID: \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:00.920776 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.920678    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9cvm\" (UniqueName: \"kubernetes.io/projected/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-kube-api-access-v9cvm\") pod \"payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k\" (UID: \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:00.920888 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.920870    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74z5c\" (UniqueName: \"kubernetes.io/projected/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-kube-api-access-74z5c\") pod \"payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6\" (UID: \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:00.984600 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:00.984575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:01.014752 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.014725    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:01.260007 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.259950    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"]
Sep 16 12:27:01.262368 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:27:01.262343    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d1ede0_89f6_4b6a_9e83_c0a08c090130.slice/crio-c3852c487e70f574976b170c42496ad61b96dcd8248221862b6cf4f14e93d91b WatchSource:0}: Error finding container c3852c487e70f574976b170c42496ad61b96dcd8248221862b6cf4f14e93d91b: Status 404 returned error can't find the container with id c3852c487e70f574976b170c42496ad61b96dcd8248221862b6cf4f14e93d91b
Sep 16 12:27:01.304171 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.304140    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"]
Sep 16 12:27:01.306307 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:27:01.306281    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209d2bdc_d6a9_486e_8d12_18c6feb5f2dd.slice/crio-7fec578ae8a83d6cd5d0556ec985e0c48a3b258e52c4c4b04aa0be30cfcbea83 WatchSource:0}: Error finding container 7fec578ae8a83d6cd5d0556ec985e0c48a3b258e52c4c4b04aa0be30cfcbea83: Status 404 returned error can't find the container with id 7fec578ae8a83d6cd5d0556ec985e0c48a3b258e52c4c4b04aa0be30cfcbea83
Sep 16 12:27:01.929196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.929164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k" event={"ID":"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd","Type":"ContainerStarted","Data":"9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18"}
Sep 16 12:27:01.929604 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.929215    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k" event={"ID":"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd","Type":"ContainerStarted","Data":"7fec578ae8a83d6cd5d0556ec985e0c48a3b258e52c4c4b04aa0be30cfcbea83"}
Sep 16 12:27:01.929604 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.929254    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:01.931257 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.931225    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6" event={"ID":"f9d1ede0-89f6-4b6a-9e83-c0a08c090130","Type":"ContainerStarted","Data":"29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e"}
Sep 16 12:27:01.931388 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.931275    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6" event={"ID":"f9d1ede0-89f6-4b6a-9e83-c0a08c090130","Type":"ContainerStarted","Data":"c3852c487e70f574976b170c42496ad61b96dcd8248221862b6cf4f14e93d91b"}
Sep 16 12:27:01.931388 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.931295    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:01.972292 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.972244    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k" podStartSLOduration=1.9722308769999999 podStartE2EDuration="1.972230877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:27:01.951067538 +0000 UTC m=+1578.394102400" watchObservedRunningTime="2026-09-16 12:27:01.972230877 +0000 UTC m=+1578.415265738"
Sep 16 12:27:01.973443 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:01.973415    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6" podStartSLOduration=1.97340655 podStartE2EDuration="1.97340655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:27:01.971087839 +0000 UTC m=+1578.414122704" watchObservedRunningTime="2026-09-16 12:27:01.97340655 +0000 UTC m=+1578.416441413"
Sep 16 12:27:12.530938 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.530880    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm" podUID="5e94e49f-d4f9-463f-8ce5-58bbe42598b1" containerName="main" containerID="cri-o://b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678" gracePeriod=45
Sep 16 12:27:12.773286 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.773261    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:27:12.909170 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909143    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-model-cache\") pod \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") "
Sep 16 12:27:12.909290 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909185    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-home\") pod \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") "
Sep 16 12:27:12.909290 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909215    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-dshm\") pod \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") "
Sep 16 12:27:12.909290 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909260    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tls-certs\") pod \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") "
Sep 16 12:27:12.909407 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909315    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjllm\" (UniqueName: \"kubernetes.io/projected/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-kube-api-access-cjllm\") pod \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") "
Sep 16 12:27:12.909407 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909347    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tmp-dir\") pod \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\" (UID: \"5e94e49f-d4f9-463f-8ce5-58bbe42598b1\") "
Sep 16 12:27:12.909407 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909388    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e94e49f-d4f9-463f-8ce5-58bbe42598b1" (UID: "5e94e49f-d4f9-463f-8ce5-58bbe42598b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:12.909561 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909397    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-home" (OuterVolumeSpecName: "home") pod "5e94e49f-d4f9-463f-8ce5-58bbe42598b1" (UID: "5e94e49f-d4f9-463f-8ce5-58bbe42598b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:12.909616 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909559    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e94e49f-d4f9-463f-8ce5-58bbe42598b1" (UID: "5e94e49f-d4f9-463f-8ce5-58bbe42598b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:12.909673 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909615    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-home\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:12.909673 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.909637    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-model-cache\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:12.911383 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.911358    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-kube-api-access-cjllm" (OuterVolumeSpecName: "kube-api-access-cjllm") pod "5e94e49f-d4f9-463f-8ce5-58bbe42598b1" (UID: "5e94e49f-d4f9-463f-8ce5-58bbe42598b1"). InnerVolumeSpecName "kube-api-access-cjllm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:12.911454 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.911356    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e94e49f-d4f9-463f-8ce5-58bbe42598b1" (UID: "5e94e49f-d4f9-463f-8ce5-58bbe42598b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:27:12.911454 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.911370    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-dshm" (OuterVolumeSpecName: "dshm") pod "5e94e49f-d4f9-463f-8ce5-58bbe42598b1" (UID: "5e94e49f-d4f9-463f-8ce5-58bbe42598b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:12.938576 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.938555    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:27:12.938660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.938616    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:27:12.994303 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.994278    2559 generic.go:356] "Generic (PLEG): container finished" podID="5e94e49f-d4f9-463f-8ce5-58bbe42598b1" containerID="b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678" exitCode=0
Sep 16 12:27:12.994441 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.994330    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"
Sep 16 12:27:12.994441 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.994349    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm" event={"ID":"5e94e49f-d4f9-463f-8ce5-58bbe42598b1","Type":"ContainerDied","Data":"b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678"}
Sep 16 12:27:12.994441 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.994377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm" event={"ID":"5e94e49f-d4f9-463f-8ce5-58bbe42598b1","Type":"ContainerDied","Data":"6079d7b9894a1797fdc1cd7a016b7c666040fb70c8bd0847a1a671a6e4ec92a7"}
Sep 16 12:27:12.994441 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:12.994392    2559 scope.go:117] "RemoveContainer" containerID="b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678"
Sep 16 12:27:13.004513 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:13.004494    2559 scope.go:117] "RemoveContainer" containerID="b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678"
Sep 16 12:27:13.004834 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:27:13.004804    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678\": container with ID starting with b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678 not found: ID does not exist" containerID="b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678"
Sep 16 12:27:13.004931 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:13.004843    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678"} err="failed to get container status \"b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678\": rpc error: code = NotFound desc = could not find container \"b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678\": container with ID starting with b37fe9ab4474c913cd56a0e2f031e1a6b6a6f3fc8ba03cda19d53130ae333678 not found: ID does not exist"
Sep 16 12:27:13.010845 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:13.010821    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-dshm\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:13.010845 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:13.010848    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tls-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:13.010980 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:13.010863    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjllm\" (UniqueName: \"kubernetes.io/projected/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-kube-api-access-cjllm\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:13.010980 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:13.010877    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e94e49f-d4f9-463f-8ce5-58bbe42598b1-tmp-dir\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:13.015506 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:13.015486    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"]
Sep 16 12:27:13.019466 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:13.019447    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-b-808e27b0-kserve-679c64f64f-jwztm"]
Sep 16 12:27:14.030511 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:14.030481    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e94e49f-d4f9-463f-8ce5-58bbe42598b1" path="/var/lib/kubelet/pods/5e94e49f-d4f9-463f-8ce5-58bbe42598b1/volumes"
Sep 16 12:27:14.619810 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:14.619774    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2" podUID="bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" containerName="main" containerID="cri-o://d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308" gracePeriod=45
Sep 16 12:27:14.879092 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:14.879034    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:27:15.007569 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.007538    2559 generic.go:356] "Generic (PLEG): container finished" podID="bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" containerID="d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308" exitCode=0
Sep 16 12:27:15.007732 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.007576    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"
Sep 16 12:27:15.007732 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.007578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2" event={"ID":"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6","Type":"ContainerDied","Data":"d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308"}
Sep 16 12:27:15.007829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.007730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2" event={"ID":"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6","Type":"ContainerDied","Data":"4de9265843b90e9e6a6b04ff644a7b449aa934c17cc79a667e779fc233afe748"}
Sep 16 12:27:15.007829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.007758    2559 scope.go:117] "RemoveContainer" containerID="d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308"
Sep 16 12:27:15.016227 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.016213    2559 scope.go:117] "RemoveContainer" containerID="d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308"
Sep 16 12:27:15.016500 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:27:15.016480    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308\": container with ID starting with d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308 not found: ID does not exist" containerID="d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308"
Sep 16 12:27:15.016564 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.016512    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308"} err="failed to get container status \"d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308\": rpc error: code = NotFound desc = could not find container \"d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308\": container with ID starting with d3aa1a113b454cd4852571c23d4151a8c13a6effeee66666d7df8c74d61aa308 not found: ID does not exist"
Sep 16 12:27:15.036854 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.036835    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-home\") pod \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") "
Sep 16 12:27:15.037180 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.036874    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdgf6\" (UniqueName: \"kubernetes.io/projected/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-kube-api-access-kdgf6\") pod \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") "
Sep 16 12:27:15.037180 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.036908    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-dshm\") pod \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") "
Sep 16 12:27:15.037180 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.036933    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-model-cache\") pod \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") "
Sep 16 12:27:15.037180 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.036965    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tmp-dir\") pod \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") "
Sep 16 12:27:15.037180 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.037050    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tls-certs\") pod \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\" (UID: \"bd2742f6-42fc-4c1a-9097-55b56e6f2ad6\") "
Sep 16 12:27:15.037180 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.037076    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-home" (OuterVolumeSpecName: "home") pod "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" (UID: "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:15.037473 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.037186    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" (UID: "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:15.037473 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.037256    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" (UID: "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:15.037473 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.037461    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-home\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:15.037605 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.037483    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-model-cache\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:15.037605 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.037521    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tmp-dir\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:15.038944 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.038924    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-dshm" (OuterVolumeSpecName: "dshm") pod "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" (UID: "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:15.039033 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.038964    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-kube-api-access-kdgf6" (OuterVolumeSpecName: "kube-api-access-kdgf6") pod "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" (UID: "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6"). InnerVolumeSpecName "kube-api-access-kdgf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:15.039033 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.039023    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" (UID: "bd2742f6-42fc-4c1a-9097-55b56e6f2ad6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:27:15.138968 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.138948    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-tls-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:15.139056 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.138970    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdgf6\" (UniqueName: \"kubernetes.io/projected/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-kube-api-access-kdgf6\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:15.139056 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.138981    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6-dshm\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:27:15.331054 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.331031    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"]
Sep 16 12:27:15.333346 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:15.333325    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/e2e-conflict-a-808e27b0-kserve-59576ffb95-ppbg2"]
Sep 16 12:27:16.029989 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:27:16.029959    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" path="/var/lib/kubelet/pods/bd2742f6-42fc-4c1a-9097-55b56e6f2ad6/volumes"
Sep 16 12:28:15.650821 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:15.650786    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"]
Sep 16 12:28:15.651800 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:15.651768    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv" podUID="63d490c8-3e5c-4e04-b029-814d8e313409" containerName="payload-processing" containerID="cri-o://78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672" gracePeriod=30
Sep 16 12:28:15.660934 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:15.659119    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"]
Sep 16 12:28:15.661044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:15.660938    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz" podUID="6f2834a7-8628-4e1b-aab1-150460161398" containerName="payload-pre-processing" containerID="cri-o://000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f" gracePeriod=30
Sep 16 12:28:15.932774 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:15.932749    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:28:15.958901 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:15.958876    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:28:16.047117 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.047092    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f2834a7-8628-4e1b-aab1-150460161398-plugins-config-volume\") pod \"6f2834a7-8628-4e1b-aab1-150460161398\" (UID: \"6f2834a7-8628-4e1b-aab1-150460161398\") "
Sep 16 12:28:16.047284 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.047181    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63d490c8-3e5c-4e04-b029-814d8e313409-plugins-config-volume\") pod \"63d490c8-3e5c-4e04-b029-814d8e313409\" (UID: \"63d490c8-3e5c-4e04-b029-814d8e313409\") "
Sep 16 12:28:16.047284 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.047203    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrv57\" (UniqueName: \"kubernetes.io/projected/63d490c8-3e5c-4e04-b029-814d8e313409-kube-api-access-hrv57\") pod \"63d490c8-3e5c-4e04-b029-814d8e313409\" (UID: \"63d490c8-3e5c-4e04-b029-814d8e313409\") "
Sep 16 12:28:16.047284 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.047256    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzs8j\" (UniqueName: \"kubernetes.io/projected/6f2834a7-8628-4e1b-aab1-150460161398-kube-api-access-nzs8j\") pod \"6f2834a7-8628-4e1b-aab1-150460161398\" (UID: \"6f2834a7-8628-4e1b-aab1-150460161398\") "
Sep 16 12:28:16.047557 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.047530    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2834a7-8628-4e1b-aab1-150460161398-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f2834a7-8628-4e1b-aab1-150460161398" (UID: "6f2834a7-8628-4e1b-aab1-150460161398"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:28:16.047656 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.047571    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d490c8-3e5c-4e04-b029-814d8e313409-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63d490c8-3e5c-4e04-b029-814d8e313409" (UID: "63d490c8-3e5c-4e04-b029-814d8e313409"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:28:16.047789 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.047769    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f2834a7-8628-4e1b-aab1-150460161398-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:28:16.047854 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.047794    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63d490c8-3e5c-4e04-b029-814d8e313409-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:28:16.049380 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.049350    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d490c8-3e5c-4e04-b029-814d8e313409-kube-api-access-hrv57" (OuterVolumeSpecName: "kube-api-access-hrv57") pod "63d490c8-3e5c-4e04-b029-814d8e313409" (UID: "63d490c8-3e5c-4e04-b029-814d8e313409"). InnerVolumeSpecName "kube-api-access-hrv57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:28:16.049488 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.049444    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f2834a7-8628-4e1b-aab1-150460161398-kube-api-access-nzs8j" (OuterVolumeSpecName: "kube-api-access-nzs8j") pod "6f2834a7-8628-4e1b-aab1-150460161398" (UID: "6f2834a7-8628-4e1b-aab1-150460161398"). InnerVolumeSpecName "kube-api-access-nzs8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:28:16.148584 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.148561    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrv57\" (UniqueName: \"kubernetes.io/projected/63d490c8-3e5c-4e04-b029-814d8e313409-kube-api-access-hrv57\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:28:16.148584 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.148581    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzs8j\" (UniqueName: \"kubernetes.io/projected/6f2834a7-8628-4e1b-aab1-150460161398-kube-api-access-nzs8j\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:28:16.330158 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.330061    2559 generic.go:356] "Generic (PLEG): container finished" podID="63d490c8-3e5c-4e04-b029-814d8e313409" containerID="78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672" exitCode=0
Sep 16 12:28:16.330158 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.330114    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"
Sep 16 12:28:16.330158 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.330145    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv" event={"ID":"63d490c8-3e5c-4e04-b029-814d8e313409","Type":"ContainerDied","Data":"78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672"}
Sep 16 12:28:16.330429 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.330205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv" event={"ID":"63d490c8-3e5c-4e04-b029-814d8e313409","Type":"ContainerDied","Data":"1bd808ec7ac91c6467f1e3a7d07ea9c9e8577c65212b14bd4c1231617b85d3bf"}
Sep 16 12:28:16.330429 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.330240    2559 scope.go:117] "RemoveContainer" containerID="78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672"
Sep 16 12:28:16.331651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.331631    2559 generic.go:356] "Generic (PLEG): container finished" podID="6f2834a7-8628-4e1b-aab1-150460161398" containerID="000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f" exitCode=0
Sep 16 12:28:16.331771 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.331678    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"
Sep 16 12:28:16.331771 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.331723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz" event={"ID":"6f2834a7-8628-4e1b-aab1-150460161398","Type":"ContainerDied","Data":"000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f"}
Sep 16 12:28:16.331771 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.331761    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz" event={"ID":"6f2834a7-8628-4e1b-aab1-150460161398","Type":"ContainerDied","Data":"d764c7d19c3dff19c049b3b13a6821352f1a32a8accdcb1b279353ca36a998f5"}
Sep 16 12:28:16.340871 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.340851    2559 scope.go:117] "RemoveContainer" containerID="78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672"
Sep 16 12:28:16.341156 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:28:16.341130    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672\": container with ID starting with 78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672 not found: ID does not exist" containerID="78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672"
Sep 16 12:28:16.341270 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.341163    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672"} err="failed to get container status \"78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672\": rpc error: code = NotFound desc = could not find container \"78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672\": container with ID starting with 78b0379b0c0e65e5c46836460c2ccaf35ffc4847112e81b3d609090d1a990672 not found: ID does not exist"
Sep 16 12:28:16.341270 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.341184    2559 scope.go:117] "RemoveContainer" containerID="000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f"
Sep 16 12:28:16.349206 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.349190    2559 scope.go:117] "RemoveContainer" containerID="000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f"
Sep 16 12:28:16.349454 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:28:16.349434    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f\": container with ID starting with 000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f not found: ID does not exist" containerID="000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f"
Sep 16 12:28:16.349530 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.349460    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f"} err="failed to get container status \"000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f\": rpc error: code = NotFound desc = could not find container \"000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f\": container with ID starting with 000e84320b1e5476d1e89aa6920761ca4708d2bd090313c3c3c3095af896432f not found: ID does not exist"
Sep 16 12:28:16.353993 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.353973    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"]
Sep 16 12:28:16.360137 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.360107    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b1650816-5cbbd65f9c-dv6vv"]
Sep 16 12:28:16.373713 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.373676    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"]
Sep 16 12:28:16.375547 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:16.375528    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b1650816-b6855766-2bgsz"]
Sep 16 12:28:18.030509 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:18.030474    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63d490c8-3e5c-4e04-b029-814d8e313409" path="/var/lib/kubelet/pods/63d490c8-3e5c-4e04-b029-814d8e313409/volumes"
Sep 16 12:28:18.030907 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:18.030891    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f2834a7-8628-4e1b-aab1-150460161398" path="/var/lib/kubelet/pods/6f2834a7-8628-4e1b-aab1-150460161398/volumes"
Sep 16 12:28:35.006106 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006071    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"]
Sep 16 12:28:35.006784 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006765    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e94e49f-d4f9-463f-8ce5-58bbe42598b1" containerName="main"
Sep 16 12:28:35.006878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006786    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e94e49f-d4f9-463f-8ce5-58bbe42598b1" containerName="main"
Sep 16 12:28:35.006878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006820    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d490c8-3e5c-4e04-b029-814d8e313409" containerName="payload-processing"
Sep 16 12:28:35.006878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006829    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d490c8-3e5c-4e04-b029-814d8e313409" containerName="payload-processing"
Sep 16 12:28:35.006878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006842    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2834a7-8628-4e1b-aab1-150460161398" containerName="payload-pre-processing"
Sep 16 12:28:35.006878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006852    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2834a7-8628-4e1b-aab1-150460161398" containerName="payload-pre-processing"
Sep 16 12:28:35.006878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006864    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" containerName="main"
Sep 16 12:28:35.006878 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006872    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" containerName="main"
Sep 16 12:28:35.007223 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006970    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd2742f6-42fc-4c1a-9097-55b56e6f2ad6" containerName="main"
Sep 16 12:28:35.007223 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006982    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d490c8-3e5c-4e04-b029-814d8e313409" containerName="payload-processing"
Sep 16 12:28:35.007223 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.006993    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f2834a7-8628-4e1b-aab1-150460161398" containerName="payload-pre-processing"
Sep 16 12:28:35.007223 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.007007    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e94e49f-d4f9-463f-8ce5-58bbe42598b1" containerName="main"
Sep 16 12:28:35.013520 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.013493    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.016353 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.016320    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-7a4d5c\"/\"kube-root-ca.crt\""
Sep 16 12:28:35.017229 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.017203    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"]
Sep 16 12:28:35.017736 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.017715    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-7a4d5c\"/\"default-dockercfg-mml7v\""
Sep 16 12:28:35.017736 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.017727    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-7a4d5c\"/\"openshift-service-ca.crt\""
Sep 16 12:28:35.018042 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.018022    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-7a4d5c\"/\"distinct-2-w4-7a4d5c-kserve-self-signed-certs\""
Sep 16 12:28:35.203432 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.203394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-dshm\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.203432 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.203431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-home\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.203637 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.203448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tls-certs\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.203637 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.203603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-model-cache\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.203726 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.203658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24c7k\" (UniqueName: \"kubernetes.io/projected/8a63d980-82e9-4b6d-bb72-5df214af3ec4-kube-api-access-24c7k\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.203796 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.203781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tmp-dir\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.304848 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.304787    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-dshm\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.304848 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.304815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-home\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.304848 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.304830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tls-certs\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.305083 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.304852    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-model-cache\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.305083 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.304894    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24c7k\" (UniqueName: \"kubernetes.io/projected/8a63d980-82e9-4b6d-bb72-5df214af3ec4-kube-api-access-24c7k\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.305083 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.304970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tmp-dir\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.305229 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.305212    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-home\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.305283 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.305236    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-model-cache\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.305343 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.305285    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tmp-dir\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.306994 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.306972    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-dshm\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.307322 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.307306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tls-certs\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.313823 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.313798    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24c7k\" (UniqueName: \"kubernetes.io/projected/8a63d980-82e9-4b6d-bb72-5df214af3ec4-kube-api-access-24c7k\") pod \"distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") " pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.324650 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.324631    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:35.598758 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:35.598734    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"]
Sep 16 12:28:35.600085 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:28:35.600057    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a63d980_82e9_4b6d_bb72_5df214af3ec4.slice/crio-b5bab7be7a614b51a8b227cba28fcb7656f2500cc1fdeb6469d8b2efc65e8486 WatchSource:0}: Error finding container b5bab7be7a614b51a8b227cba28fcb7656f2500cc1fdeb6469d8b2efc65e8486: Status 404 returned error can't find the container with id b5bab7be7a614b51a8b227cba28fcb7656f2500cc1fdeb6469d8b2efc65e8486
Sep 16 12:28:36.436299 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:36.436260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86" event={"ID":"8a63d980-82e9-4b6d-bb72-5df214af3ec4","Type":"ContainerStarted","Data":"2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f"}
Sep 16 12:28:36.436646 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:36.436310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86" event={"ID":"8a63d980-82e9-4b6d-bb72-5df214af3ec4","Type":"ContainerStarted","Data":"b5bab7be7a614b51a8b227cba28fcb7656f2500cc1fdeb6469d8b2efc65e8486"}
Sep 16 12:28:36.457121 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:36.457069    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86" podStartSLOduration=2.457053348 podStartE2EDuration="2.457053348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:28:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:28:36.454985256 +0000 UTC m=+1672.898020118" watchObservedRunningTime="2026-09-16 12:28:36.457053348 +0000 UTC m=+1672.900088210"
Sep 16 12:28:45.325219 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:45.325185    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:45.325564 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:45.325239    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:45.337374 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:45.337355    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:28:45.492047 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:28:45.492021    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:30:00.153647 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.153613    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm"]
Sep 16 12:30:00.157146 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.157128    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c"]
Sep 16 12:30:00.157261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.157242    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm"
Sep 16 12:30:00.159997 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.159978    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:30:00.160308 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.160287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c"
Sep 16 12:30:00.175904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.175881    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm"]
Sep 16 12:30:00.180014 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.178035    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm"
Sep 16 12:30:00.181575 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.181325    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c"]
Sep 16 12:30:00.184135 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.184116    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd"]
Sep 16 12:30:00.186320 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.186305    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c"
Sep 16 12:30:00.187837 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.187816    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd"
Sep 16 12:30:00.190816 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.190795    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd"]
Sep 16 12:30:00.225187 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.225162    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd"
Sep 16 12:30:00.471413 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.471384    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c"]
Sep 16 12:30:00.473961 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:30:00.473896    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd830db_8fd4_40b0_b220_88108d4e7ee0.slice/crio-1d68145029f1a82fc19ad22066b608d9776a852b430e5440d661140095ce8796 WatchSource:0}: Error finding container 1d68145029f1a82fc19ad22066b608d9776a852b430e5440d661140095ce8796: Status 404 returned error can't find the container with id 1d68145029f1a82fc19ad22066b608d9776a852b430e5440d661140095ce8796
Sep 16 12:30:00.474217 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.474194    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm"]
Sep 16 12:30:00.476100 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.476082    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:30:00.476429 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:30:00.476409    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e2b0cc_c106_44db_9221_2f25f71e65c0.slice/crio-6e64218ed1c19bf5111411e1098306233fc9e3520547c9eba16c98447ec83289 WatchSource:0}: Error finding container 6e64218ed1c19bf5111411e1098306233fc9e3520547c9eba16c98447ec83289: Status 404 returned error can't find the container with id 6e64218ed1c19bf5111411e1098306233fc9e3520547c9eba16c98447ec83289
Sep 16 12:30:00.516652 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.516630    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd"]
Sep 16 12:30:00.518241 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:30:00.518215    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f4c923_ef07_48e2_8b98_b27674d9c3a9.slice/crio-47a9b8193d2449c36098990652f4e7e69c040af9c4ac57a0a2ab314afcd8d57b WatchSource:0}: Error finding container 47a9b8193d2449c36098990652f4e7e69c040af9c4ac57a0a2ab314afcd8d57b: Status 404 returned error can't find the container with id 47a9b8193d2449c36098990652f4e7e69c040af9c4ac57a0a2ab314afcd8d57b
Sep 16 12:30:00.874912 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.874830    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm" event={"ID":"06e2b0cc-c106-44db-9221-2f25f71e65c0","Type":"ContainerStarted","Data":"6e64218ed1c19bf5111411e1098306233fc9e3520547c9eba16c98447ec83289"}
Sep 16 12:30:00.876066 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.876041    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c" event={"ID":"5bd830db-8fd4-40b0-b220-88108d4e7ee0","Type":"ContainerStarted","Data":"1d68145029f1a82fc19ad22066b608d9776a852b430e5440d661140095ce8796"}
Sep 16 12:30:00.877204 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:00.877181    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd" event={"ID":"05f4c923-ef07-48e2-8b98-b27674d9c3a9","Type":"ContainerStarted","Data":"47a9b8193d2449c36098990652f4e7e69c040af9c4ac57a0a2ab314afcd8d57b"}
Sep 16 12:30:03.900506 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:03.900471    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm" event={"ID":"06e2b0cc-c106-44db-9221-2f25f71e65c0","Type":"ContainerStarted","Data":"26837bd069d4283bbeff38e55dd0102ee765a8f926c342547a6882b6e70a65b1"}
Sep 16 12:30:03.902230 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:03.902207    2559 generic.go:356] "Generic (PLEG): container finished" podID="5bd830db-8fd4-40b0-b220-88108d4e7ee0" containerID="3575f16801c756eba9841c67d2aed2bbfd94d1390cdf40242a6dc237485116d9" exitCode=0
Sep 16 12:30:03.902330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:03.902245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c" event={"ID":"5bd830db-8fd4-40b0-b220-88108d4e7ee0","Type":"ContainerDied","Data":"3575f16801c756eba9841c67d2aed2bbfd94d1390cdf40242a6dc237485116d9"}
Sep 16 12:30:03.916829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:03.916785    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm" podStartSLOduration=1.481924877 podStartE2EDuration="3.916769558s" totalImagesPullingTime="2.434844681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:03.914861775 +0000 UTC m=+1760.357896639" watchObservedRunningTime="2026-09-16 12:30:03.916769558 +0000 UTC m=+1760.359804420"
Sep 16 12:30:04.908751 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:04.908714    2559 generic.go:356] "Generic (PLEG): container finished" podID="06e2b0cc-c106-44db-9221-2f25f71e65c0" containerID="26837bd069d4283bbeff38e55dd0102ee765a8f926c342547a6882b6e70a65b1" exitCode=0
Sep 16 12:30:04.909157 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:04.908794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm" event={"ID":"06e2b0cc-c106-44db-9221-2f25f71e65c0","Type":"ContainerDied","Data":"26837bd069d4283bbeff38e55dd0102ee765a8f926c342547a6882b6e70a65b1"}
Sep 16 12:30:05.063944 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:05.063920    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c"
Sep 16 12:30:05.915861 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:05.915825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c" event={"ID":"5bd830db-8fd4-40b0-b220-88108d4e7ee0","Type":"ContainerDied","Data":"1d68145029f1a82fc19ad22066b608d9776a852b430e5440d661140095ce8796"}
Sep 16 12:30:05.915861 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:05.915846    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c"
Sep 16 12:30:05.916274 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:05.915876    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d68145029f1a82fc19ad22066b608d9776a852b430e5440d661140095ce8796"
Sep 16 12:30:06.049120 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:06.049093    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm"
Sep 16 12:30:06.922668 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:06.922640    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm"
Sep 16 12:30:06.923066 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:06.922639    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm" event={"ID":"06e2b0cc-c106-44db-9221-2f25f71e65c0","Type":"ContainerDied","Data":"6e64218ed1c19bf5111411e1098306233fc9e3520547c9eba16c98447ec83289"}
Sep 16 12:30:06.923066 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:06.922759    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e64218ed1c19bf5111411e1098306233fc9e3520547c9eba16c98447ec83289"
Sep 16 12:30:08.937762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:08.937722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd" event={"ID":"05f4c923-ef07-48e2-8b98-b27674d9c3a9","Type":"ContainerStarted","Data":"8e949be5e695708f046da62062bc1241ba9e716be871ad5bd6e326fe7a8d7f26"}
Sep 16 12:30:08.956123 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:08.956076    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd" podStartSLOduration=1.263684926 podStartE2EDuration="8.956056151s" totalImagesPullingTime="7.692371225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:08.953072381 +0000 UTC m=+1765.396107244" watchObservedRunningTime="2026-09-16 12:30:08.956056151 +0000 UTC m=+1765.399091015"
Sep 16 12:30:09.953136 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:09.953098    2559 generic.go:356] "Generic (PLEG): container finished" podID="05f4c923-ef07-48e2-8b98-b27674d9c3a9" containerID="8e949be5e695708f046da62062bc1241ba9e716be871ad5bd6e326fe7a8d7f26" exitCode=0
Sep 16 12:30:09.953579 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:09.953184    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd" event={"ID":"05f4c923-ef07-48e2-8b98-b27674d9c3a9","Type":"ContainerDied","Data":"8e949be5e695708f046da62062bc1241ba9e716be871ad5bd6e326fe7a8d7f26"}
Sep 16 12:30:11.092126 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:11.092102    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd"
Sep 16 12:30:11.966017 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:11.965987    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd"
Sep 16 12:30:11.966017 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:11.966001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd" event={"ID":"05f4c923-ef07-48e2-8b98-b27674d9c3a9","Type":"ContainerDied","Data":"47a9b8193d2449c36098990652f4e7e69c040af9c4ac57a0a2ab314afcd8d57b"}
Sep 16 12:30:11.966239 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:11.966043    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47a9b8193d2449c36098990652f4e7e69c040af9c4ac57a0a2ab314afcd8d57b"
Sep 16 12:30:24.790624 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.790589    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"]
Sep 16 12:30:24.791293 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.791276    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e2b0cc-c106-44db-9221-2f25f71e65c0" containerName="cleanup"
Sep 16 12:30:24.791339 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.791295    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e2b0cc-c106-44db-9221-2f25f71e65c0" containerName="cleanup"
Sep 16 12:30:24.791339 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.791316    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd830db-8fd4-40b0-b220-88108d4e7ee0" containerName="cleanup"
Sep 16 12:30:24.791339 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.791324    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd830db-8fd4-40b0-b220-88108d4e7ee0" containerName="cleanup"
Sep 16 12:30:24.791339 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.791335    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f4c923-ef07-48e2-8b98-b27674d9c3a9" containerName="cleanup"
Sep 16 12:30:24.791466 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.791343    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f4c923-ef07-48e2-8b98-b27674d9c3a9" containerName="cleanup"
Sep 16 12:30:24.791466 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.791440    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f4c923-ef07-48e2-8b98-b27674d9c3a9" containerName="cleanup"
Sep 16 12:30:24.791466 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.791456    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd830db-8fd4-40b0-b220-88108d4e7ee0" containerName="cleanup"
Sep 16 12:30:24.791556 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.791465    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e2b0cc-c106-44db-9221-2f25f71e65c0" containerName="cleanup"
Sep 16 12:30:24.794732 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.794713    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:24.797392 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.797368    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-835ec8\""
Sep 16 12:30:24.797508 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.797407    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-835ec8-dockercfg-9j7x4\""
Sep 16 12:30:24.803046 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.803026    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"]
Sep 16 12:30:24.854224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.854196    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"]
Sep 16 12:30:24.858351 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.858333    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:24.866210 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.866188    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"]
Sep 16 12:30:24.915550 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.915515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngq47\" (UniqueName: \"kubernetes.io/projected/2615cc28-af14-4dd1-aed9-28be11ff8f73-kube-api-access-ngq47\") pod \"payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq\" (UID: \"2615cc28-af14-4dd1-aed9-28be11ff8f73\") " pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:24.915550 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:24.915558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2615cc28-af14-4dd1-aed9-28be11ff8f73-plugins-config-volume\") pod \"payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq\" (UID: \"2615cc28-af14-4dd1-aed9-28be11ff8f73\") " pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:25.017021 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.016988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd\" (UID: \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:25.017021 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.017033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngq47\" (UniqueName: \"kubernetes.io/projected/2615cc28-af14-4dd1-aed9-28be11ff8f73-kube-api-access-ngq47\") pod \"payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq\" (UID: \"2615cc28-af14-4dd1-aed9-28be11ff8f73\") " pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:25.017247 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.017065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2615cc28-af14-4dd1-aed9-28be11ff8f73-plugins-config-volume\") pod \"payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq\" (UID: \"2615cc28-af14-4dd1-aed9-28be11ff8f73\") " pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:25.017247 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.017175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzmhc\" (UniqueName: \"kubernetes.io/projected/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-kube-api-access-rzmhc\") pod \"payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd\" (UID: \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:25.017786 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.017768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2615cc28-af14-4dd1-aed9-28be11ff8f73-plugins-config-volume\") pod \"payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq\" (UID: \"2615cc28-af14-4dd1-aed9-28be11ff8f73\") " pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:25.024488 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.024469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngq47\" (UniqueName: \"kubernetes.io/projected/2615cc28-af14-4dd1-aed9-28be11ff8f73-kube-api-access-ngq47\") pod \"payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq\" (UID: \"2615cc28-af14-4dd1-aed9-28be11ff8f73\") " pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:25.106295 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.106229    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:25.118549 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.118520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzmhc\" (UniqueName: \"kubernetes.io/projected/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-kube-api-access-rzmhc\") pod \"payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd\" (UID: \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:25.118674 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.118583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd\" (UID: \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:25.119198 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.119179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd\" (UID: \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:25.125915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.125895    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzmhc\" (UniqueName: \"kubernetes.io/projected/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-kube-api-access-rzmhc\") pod \"payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd\" (UID: \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:25.170386 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.170072    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:25.383724 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.380674    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"]
Sep 16 12:30:25.454741 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:25.454712    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"]
Sep 16 12:30:25.455409 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:30:25.455379    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0d8463_aed2_4b43_bffb_a1c49a1b6da8.slice/crio-cb47144e084d6d0adad7ef4d70af4abb79d5438ead51c9bd6c68398cee58a021 WatchSource:0}: Error finding container cb47144e084d6d0adad7ef4d70af4abb79d5438ead51c9bd6c68398cee58a021: Status 404 returned error can't find the container with id cb47144e084d6d0adad7ef4d70af4abb79d5438ead51c9bd6c68398cee58a021
Sep 16 12:30:26.042129 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:26.042091    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd" event={"ID":"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8","Type":"ContainerStarted","Data":"08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400"}
Sep 16 12:30:26.042523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:26.042141    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd" event={"ID":"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8","Type":"ContainerStarted","Data":"cb47144e084d6d0adad7ef4d70af4abb79d5438ead51c9bd6c68398cee58a021"}
Sep 16 12:30:26.042523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:26.042240    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:26.043653 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:26.043631    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq" event={"ID":"2615cc28-af14-4dd1-aed9-28be11ff8f73","Type":"ContainerStarted","Data":"0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed"}
Sep 16 12:30:26.043801 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:26.043665    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq" event={"ID":"2615cc28-af14-4dd1-aed9-28be11ff8f73","Type":"ContainerStarted","Data":"720c00a4ffd590ac4342574782be2a50ef2b8d9f69878d8ca0c92eacf4c23359"}
Sep 16 12:30:26.043801 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:26.043734    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:26.060028 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:26.059986    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd" podStartSLOduration=2.059973582 podStartE2EDuration="2.059973582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:26.058012123 +0000 UTC m=+1782.501047000" watchObservedRunningTime="2026-09-16 12:30:26.059973582 +0000 UTC m=+1782.503008440"
Sep 16 12:30:26.073762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:26.073690    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq" podStartSLOduration=2.073673439 podStartE2EDuration="2.073673439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:26.072667487 +0000 UTC m=+1782.515702354" watchObservedRunningTime="2026-09-16 12:30:26.073673439 +0000 UTC m=+1782.516708305"
Sep 16 12:30:37.052789 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:37.052686    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:30:37.053370 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:37.052804    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:30:59.578591 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.578556    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"]
Sep 16 12:30:59.582712 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.582679    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:30:59.585070 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.585049    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-5c41db\""
Sep 16 12:30:59.585334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.585306    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-5c41db-dockercfg-q4tf8\""
Sep 16 12:30:59.592070 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.592044    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"]
Sep 16 12:30:59.611263 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.611229    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"]
Sep 16 12:30:59.614760 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.614742    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:30:59.624726 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.624690    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"]
Sep 16 12:30:59.717563 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.717520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c00d09d-7d29-405f-baae-3ec1a8a93490-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p\" (UID: \"7c00d09d-7d29-405f-baae-3ec1a8a93490\") " pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:30:59.717785 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.717600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzxd7\" (UniqueName: \"kubernetes.io/projected/784b6879-eb93-4ea6-be73-203a846e6f20-kube-api-access-mzxd7\") pod \"payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf\" (UID: \"784b6879-eb93-4ea6-be73-203a846e6f20\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:30:59.717785 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.717659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/784b6879-eb93-4ea6-be73-203a846e6f20-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf\" (UID: \"784b6879-eb93-4ea6-be73-203a846e6f20\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:30:59.717785 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.717683    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdtph\" (UniqueName: \"kubernetes.io/projected/7c00d09d-7d29-405f-baae-3ec1a8a93490-kube-api-access-mdtph\") pod \"payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p\" (UID: \"7c00d09d-7d29-405f-baae-3ec1a8a93490\") " pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:30:59.818772 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.818736    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdtph\" (UniqueName: \"kubernetes.io/projected/7c00d09d-7d29-405f-baae-3ec1a8a93490-kube-api-access-mdtph\") pod \"payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p\" (UID: \"7c00d09d-7d29-405f-baae-3ec1a8a93490\") " pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:30:59.818939 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.818799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c00d09d-7d29-405f-baae-3ec1a8a93490-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p\" (UID: \"7c00d09d-7d29-405f-baae-3ec1a8a93490\") " pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:30:59.818939 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.818858    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzxd7\" (UniqueName: \"kubernetes.io/projected/784b6879-eb93-4ea6-be73-203a846e6f20-kube-api-access-mzxd7\") pod \"payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf\" (UID: \"784b6879-eb93-4ea6-be73-203a846e6f20\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:30:59.818939 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.818920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/784b6879-eb93-4ea6-be73-203a846e6f20-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf\" (UID: \"784b6879-eb93-4ea6-be73-203a846e6f20\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:30:59.819558 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.819532    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c00d09d-7d29-405f-baae-3ec1a8a93490-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p\" (UID: \"7c00d09d-7d29-405f-baae-3ec1a8a93490\") " pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:30:59.819649 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.819573    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/784b6879-eb93-4ea6-be73-203a846e6f20-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf\" (UID: \"784b6879-eb93-4ea6-be73-203a846e6f20\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:30:59.828067 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.828045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzxd7\" (UniqueName: \"kubernetes.io/projected/784b6879-eb93-4ea6-be73-203a846e6f20-kube-api-access-mzxd7\") pod \"payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf\" (UID: \"784b6879-eb93-4ea6-be73-203a846e6f20\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:30:59.828169 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.828130    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdtph\" (UniqueName: \"kubernetes.io/projected/7c00d09d-7d29-405f-baae-3ec1a8a93490-kube-api-access-mdtph\") pod \"payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p\" (UID: \"7c00d09d-7d29-405f-baae-3ec1a8a93490\") " pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:30:59.894521 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.894499    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:30:59.924887 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:30:59.924859    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:31:00.168791 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:00.168770    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"]
Sep 16 12:31:00.170406 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:31:00.170380    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784b6879_eb93_4ea6_be73_203a846e6f20.slice/crio-8a2c26bb1e2c39a3fd0fceab4b0ea462c7e734e3927f1ca78ee7b0b264df3458 WatchSource:0}: Error finding container 8a2c26bb1e2c39a3fd0fceab4b0ea462c7e734e3927f1ca78ee7b0b264df3458: Status 404 returned error can't find the container with id 8a2c26bb1e2c39a3fd0fceab4b0ea462c7e734e3927f1ca78ee7b0b264df3458
Sep 16 12:31:00.207166 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:00.207142    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"]
Sep 16 12:31:00.218906 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:31:00.218881    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c00d09d_7d29_405f_baae_3ec1a8a93490.slice/crio-c9223fc0f08bc56fccf537ed27e4e8f9fb17a7b30d2179aafdb6639340a136ac WatchSource:0}: Error finding container c9223fc0f08bc56fccf537ed27e4e8f9fb17a7b30d2179aafdb6639340a136ac: Status 404 returned error can't find the container with id c9223fc0f08bc56fccf537ed27e4e8f9fb17a7b30d2179aafdb6639340a136ac
Sep 16 12:31:00.233538 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:00.233514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf" event={"ID":"784b6879-eb93-4ea6-be73-203a846e6f20","Type":"ContainerStarted","Data":"8a2c26bb1e2c39a3fd0fceab4b0ea462c7e734e3927f1ca78ee7b0b264df3458"}
Sep 16 12:31:00.234924 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:00.234899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p" event={"ID":"7c00d09d-7d29-405f-baae-3ec1a8a93490","Type":"ContainerStarted","Data":"c9223fc0f08bc56fccf537ed27e4e8f9fb17a7b30d2179aafdb6639340a136ac"}
Sep 16 12:31:01.242336 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:01.242292    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf" event={"ID":"784b6879-eb93-4ea6-be73-203a846e6f20","Type":"ContainerStarted","Data":"a1a2ae5a68e4b730758fd458330fee49db0f37c378a57aebfc0969a1f7560afe"}
Sep 16 12:31:01.242786 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:01.242417    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:31:01.243967 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:01.243943    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p" event={"ID":"7c00d09d-7d29-405f-baae-3ec1a8a93490","Type":"ContainerStarted","Data":"345cf44611bce5a91aff9be2ee3a15d181051791e989a68aff38f2ff03b9a804"}
Sep 16 12:31:01.244139 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:01.244118    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:31:01.261026 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:01.260977    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf" podStartSLOduration=2.260962799 podStartE2EDuration="2.260962799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:31:01.257836435 +0000 UTC m=+1817.700871297" watchObservedRunningTime="2026-09-16 12:31:01.260962799 +0000 UTC m=+1817.703997665"
Sep 16 12:31:01.273263 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:01.273223    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p" podStartSLOduration=2.273208994 podStartE2EDuration="2.273208994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:31:01.272194676 +0000 UTC m=+1817.715229539" watchObservedRunningTime="2026-09-16 12:31:01.273208994 +0000 UTC m=+1817.716243903"
Sep 16 12:31:12.253072 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:12.253038    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:31:12.253630 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:12.253209    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:31:27.000597 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:27.000558    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"]
Sep 16 12:31:42.019982 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.019923    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86" podUID="8a63d980-82e9-4b6d-bb72-5df214af3ec4" containerName="main" containerID="cri-o://2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f" gracePeriod=45
Sep 16 12:31:42.141984 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.141955    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"]
Sep 16 12:31:42.142229 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.142200    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq" podUID="2615cc28-af14-4dd1-aed9-28be11ff8f73" containerName="payload-processing" containerID="cri-o://0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed" gracePeriod=30
Sep 16 12:31:42.149871 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.148895    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"]
Sep 16 12:31:42.149871 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.149108    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd" podUID="4d0d8463-aed2-4b43-bffb-a1c49a1b6da8" containerName="payload-pre-processing" containerID="cri-o://08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400" gracePeriod=30
Sep 16 12:31:42.309010 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.308804    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:31:42.398587 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.398556    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-model-cache\") pod \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") "
Sep 16 12:31:42.398762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.398601    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tls-certs\") pod \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") "
Sep 16 12:31:42.398762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.398624    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-home\") pod \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") "
Sep 16 12:31:42.398762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.398723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24c7k\" (UniqueName: \"kubernetes.io/projected/8a63d980-82e9-4b6d-bb72-5df214af3ec4-kube-api-access-24c7k\") pod \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") "
Sep 16 12:31:42.398951 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.398782    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-dshm\") pod \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") "
Sep 16 12:31:42.398951 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.398878    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tmp-dir\") pod \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\" (UID: \"8a63d980-82e9-4b6d-bb72-5df214af3ec4\") "
Sep 16 12:31:42.398951 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.398896    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a63d980-82e9-4b6d-bb72-5df214af3ec4" (UID: "8a63d980-82e9-4b6d-bb72-5df214af3ec4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:42.399354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.399229    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-model-cache\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.399354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.399250    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-home" (OuterVolumeSpecName: "home") pod "8a63d980-82e9-4b6d-bb72-5df214af3ec4" (UID: "8a63d980-82e9-4b6d-bb72-5df214af3ec4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:42.399529 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.399494    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a63d980-82e9-4b6d-bb72-5df214af3ec4" (UID: "8a63d980-82e9-4b6d-bb72-5df214af3ec4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:42.402405 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.402371    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-dshm" (OuterVolumeSpecName: "dshm") pod "8a63d980-82e9-4b6d-bb72-5df214af3ec4" (UID: "8a63d980-82e9-4b6d-bb72-5df214af3ec4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:42.403748 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.403689    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a63d980-82e9-4b6d-bb72-5df214af3ec4-kube-api-access-24c7k" (OuterVolumeSpecName: "kube-api-access-24c7k") pod "8a63d980-82e9-4b6d-bb72-5df214af3ec4" (UID: "8a63d980-82e9-4b6d-bb72-5df214af3ec4"). InnerVolumeSpecName "kube-api-access-24c7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:31:42.403870 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.403811    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a63d980-82e9-4b6d-bb72-5df214af3ec4" (UID: "8a63d980-82e9-4b6d-bb72-5df214af3ec4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:31:42.436146 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.436124    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:31:42.438952 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.438932    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:31:42.477916 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.477884    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a63d980-82e9-4b6d-bb72-5df214af3ec4" containerID="2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f" exitCode=0
Sep 16 12:31:42.478071 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.477935    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"
Sep 16 12:31:42.478071 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.477963    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86" event={"ID":"8a63d980-82e9-4b6d-bb72-5df214af3ec4","Type":"ContainerDied","Data":"2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f"}
Sep 16 12:31:42.478071 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.478008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86" event={"ID":"8a63d980-82e9-4b6d-bb72-5df214af3ec4","Type":"ContainerDied","Data":"b5bab7be7a614b51a8b227cba28fcb7656f2500cc1fdeb6469d8b2efc65e8486"}
Sep 16 12:31:42.478071 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.478032    2559 scope.go:117] "RemoveContainer" containerID="2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f"
Sep 16 12:31:42.479638 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.479608    2559 generic.go:356] "Generic (PLEG): container finished" podID="4d0d8463-aed2-4b43-bffb-a1c49a1b6da8" containerID="08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400" exitCode=0
Sep 16 12:31:42.479784 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.479649    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"
Sep 16 12:31:42.479784 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.479665    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd" event={"ID":"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8","Type":"ContainerDied","Data":"08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400"}
Sep 16 12:31:42.479784 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.479737    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd" event={"ID":"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8","Type":"ContainerDied","Data":"cb47144e084d6d0adad7ef4d70af4abb79d5438ead51c9bd6c68398cee58a021"}
Sep 16 12:31:42.481675 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.481651    2559 generic.go:356] "Generic (PLEG): container finished" podID="2615cc28-af14-4dd1-aed9-28be11ff8f73" containerID="0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed" exitCode=0
Sep 16 12:31:42.481832 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.481812    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq" event={"ID":"2615cc28-af14-4dd1-aed9-28be11ff8f73","Type":"ContainerDied","Data":"0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed"}
Sep 16 12:31:42.482028 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.481859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq" event={"ID":"2615cc28-af14-4dd1-aed9-28be11ff8f73","Type":"ContainerDied","Data":"720c00a4ffd590ac4342574782be2a50ef2b8d9f69878d8ca0c92eacf4c23359"}
Sep 16 12:31:42.482028 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.481928    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"
Sep 16 12:31:42.489873 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.489851    2559 scope.go:117] "RemoveContainer" containerID="2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f"
Sep 16 12:31:42.490193 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:31:42.490158    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f\": container with ID starting with 2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f not found: ID does not exist" containerID="2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f"
Sep 16 12:31:42.490271 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.490201    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f"} err="failed to get container status \"2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f\": rpc error: code = NotFound desc = could not find container \"2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f\": container with ID starting with 2ee5c58685004a1d2ffa7802ecf566a5c31c308795b341a03a33473829ec461f not found: ID does not exist"
Sep 16 12:31:42.490271 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.490216    2559 scope.go:117] "RemoveContainer" containerID="08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400"
Sep 16 12:31:42.500096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.499639    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-plugins-config-volume\") pod \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\" (UID: \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\") "
Sep 16 12:31:42.500096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.499680    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngq47\" (UniqueName: \"kubernetes.io/projected/2615cc28-af14-4dd1-aed9-28be11ff8f73-kube-api-access-ngq47\") pod \"2615cc28-af14-4dd1-aed9-28be11ff8f73\" (UID: \"2615cc28-af14-4dd1-aed9-28be11ff8f73\") "
Sep 16 12:31:42.500096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.499739    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2615cc28-af14-4dd1-aed9-28be11ff8f73-plugins-config-volume\") pod \"2615cc28-af14-4dd1-aed9-28be11ff8f73\" (UID: \"2615cc28-af14-4dd1-aed9-28be11ff8f73\") "
Sep 16 12:31:42.500096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.499804    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzmhc\" (UniqueName: \"kubernetes.io/projected/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-kube-api-access-rzmhc\") pod \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\" (UID: \"4d0d8463-aed2-4b43-bffb-a1c49a1b6da8\") "
Sep 16 12:31:42.500433 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.500190    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tmp-dir\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.500433 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.500212    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a63d980-82e9-4b6d-bb72-5df214af3ec4-tls-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.500433 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.500227    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-home\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.500433 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.500241    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24c7k\" (UniqueName: \"kubernetes.io/projected/8a63d980-82e9-4b6d-bb72-5df214af3ec4-kube-api-access-24c7k\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.500433 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.500253    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a63d980-82e9-4b6d-bb72-5df214af3ec4-dshm\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.500801 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.500501    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d0d8463-aed2-4b43-bffb-a1c49a1b6da8" (UID: "4d0d8463-aed2-4b43-bffb-a1c49a1b6da8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:31:42.500801 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.500544    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2615cc28-af14-4dd1-aed9-28be11ff8f73-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2615cc28-af14-4dd1-aed9-28be11ff8f73" (UID: "2615cc28-af14-4dd1-aed9-28be11ff8f73"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:31:42.502610 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.502584    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2615cc28-af14-4dd1-aed9-28be11ff8f73-kube-api-access-ngq47" (OuterVolumeSpecName: "kube-api-access-ngq47") pod "2615cc28-af14-4dd1-aed9-28be11ff8f73" (UID: "2615cc28-af14-4dd1-aed9-28be11ff8f73"). InnerVolumeSpecName "kube-api-access-ngq47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:31:42.502720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.502673    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"]
Sep 16 12:31:42.502877 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.502858    2559 scope.go:117] "RemoveContainer" containerID="08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400"
Sep 16 12:31:42.502954 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.502931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-kube-api-access-rzmhc" (OuterVolumeSpecName: "kube-api-access-rzmhc") pod "4d0d8463-aed2-4b43-bffb-a1c49a1b6da8" (UID: "4d0d8463-aed2-4b43-bffb-a1c49a1b6da8"). InnerVolumeSpecName "kube-api-access-rzmhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:31:42.503191 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:31:42.503171    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400\": container with ID starting with 08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400 not found: ID does not exist" containerID="08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400"
Sep 16 12:31:42.503252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.503198    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400"} err="failed to get container status \"08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400\": rpc error: code = NotFound desc = could not find container \"08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400\": container with ID starting with 08b54a1e3b0dc2e62b22779f6965c70ee78f80ed11a9b12c190b0b470c082400 not found: ID does not exist"
Sep 16 12:31:42.503252 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.503217    2559 scope.go:117] "RemoveContainer" containerID="0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed"
Sep 16 12:31:42.505357 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.505337    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-7a4d5c/distinct-2-w4-7a4d5c-kserve-7cb8c89b5b-9gw86"]
Sep 16 12:31:42.511835 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.511820    2559 scope.go:117] "RemoveContainer" containerID="0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed"
Sep 16 12:31:42.512088 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:31:42.512067    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed\": container with ID starting with 0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed not found: ID does not exist" containerID="0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed"
Sep 16 12:31:42.512159 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.512097    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed"} err="failed to get container status \"0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed\": rpc error: code = NotFound desc = could not find container \"0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed\": container with ID starting with 0c2f30ff978e44c73222ef806ac05c8717a993bc9aede7af0d636c49509d77ed not found: ID does not exist"
Sep 16 12:31:42.601467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.601332    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.601467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.601370    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngq47\" (UniqueName: \"kubernetes.io/projected/2615cc28-af14-4dd1-aed9-28be11ff8f73-kube-api-access-ngq47\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.601467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.601383    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2615cc28-af14-4dd1-aed9-28be11ff8f73-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.601467 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.601394    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzmhc\" (UniqueName: \"kubernetes.io/projected/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8-kube-api-access-rzmhc\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:42.806842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.806814    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"]
Sep 16 12:31:42.825121 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.825094    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-835ec8-6748b6d886-7vmtd"]
Sep 16 12:31:42.837992 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.837967    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"]
Sep 16 12:31:42.849922 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:42.849893    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-835ec8-9c864b447-ml6qq"]
Sep 16 12:31:44.030733 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:44.030680    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2615cc28-af14-4dd1-aed9-28be11ff8f73" path="/var/lib/kubelet/pods/2615cc28-af14-4dd1-aed9-28be11ff8f73/volumes"
Sep 16 12:31:44.031115 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:44.031051    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d0d8463-aed2-4b43-bffb-a1c49a1b6da8" path="/var/lib/kubelet/pods/4d0d8463-aed2-4b43-bffb-a1c49a1b6da8/volumes"
Sep 16 12:31:44.031405 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:44.031391    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a63d980-82e9-4b6d-bb72-5df214af3ec4" path="/var/lib/kubelet/pods/8a63d980-82e9-4b6d-bb72-5df214af3ec4/volumes"
Sep 16 12:31:47.406363 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:47.406330    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"]
Sep 16 12:31:47.406842 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:47.406539    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy" containerID="cri-o://16cdfd3971f6a7ec5c295fc3bacbd89725ea0f75328b69c56ba0a68dad73eb81" gracePeriod=30
Sep 16 12:31:52.543686 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.543642    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerID="16cdfd3971f6a7ec5c295fc3bacbd89725ea0f75328b69c56ba0a68dad73eb81" exitCode=0
Sep 16 12:31:52.544002 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.543718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" event={"ID":"bc0055b8-de0a-4e9e-a7e6-87bad0f17387","Type":"ContainerDied","Data":"16cdfd3971f6a7ec5c295fc3bacbd89725ea0f75328b69c56ba0a68dad73eb81"}
Sep 16 12:31:52.544002 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.543782    2559 scope.go:117] "RemoveContainer" containerID="1c0884080bc27233472b8b32f94758171a37a92a177c82a5b2bd938d0b78cc1c"
Sep 16 12:31:52.662811 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.662784    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:31:52.793230 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793153    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-certs\") pod \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") "
Sep 16 12:31:52.793230 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793197    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wknw\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-kube-api-access-8wknw\") pod \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") "
Sep 16 12:31:52.793452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793239    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istiod-ca-cert\") pod \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") "
Sep 16 12:31:52.793452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793258    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-envoy\") pod \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") "
Sep 16 12:31:52.793452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793280    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-data\") pod \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") "
Sep 16 12:31:52.793452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793311    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-token\") pod \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") "
Sep 16 12:31:52.793452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793344    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-podinfo\") pod \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") "
Sep 16 12:31:52.793452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793396    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-credential-socket\") pod \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") "
Sep 16 12:31:52.793452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793411    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc0055b8-de0a-4e9e-a7e6-87bad0f17387" (UID: "bc0055b8-de0a-4e9e-a7e6-87bad0f17387"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:52.793452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793453    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-socket\") pod \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\" (UID: \"bc0055b8-de0a-4e9e-a7e6-87bad0f17387\") "
Sep 16 12:31:52.794298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793647    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc0055b8-de0a-4e9e-a7e6-87bad0f17387" (UID: "bc0055b8-de0a-4e9e-a7e6-87bad0f17387"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:52.794298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793827    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc0055b8-de0a-4e9e-a7e6-87bad0f17387" (UID: "bc0055b8-de0a-4e9e-a7e6-87bad0f17387"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:31:52.794298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793833    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc0055b8-de0a-4e9e-a7e6-87bad0f17387" (UID: "bc0055b8-de0a-4e9e-a7e6-87bad0f17387"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:52.794298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793858    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-certs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:52.794298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793880    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-data\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:52.794298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.793862    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc0055b8-de0a-4e9e-a7e6-87bad0f17387" (UID: "bc0055b8-de0a-4e9e-a7e6-87bad0f17387"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:52.795564 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.795509    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc0055b8-de0a-4e9e-a7e6-87bad0f17387" (UID: "bc0055b8-de0a-4e9e-a7e6-87bad0f17387"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:31:52.795664 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.795560    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc0055b8-de0a-4e9e-a7e6-87bad0f17387" (UID: "bc0055b8-de0a-4e9e-a7e6-87bad0f17387"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:31:52.795664 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.795600    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc0055b8-de0a-4e9e-a7e6-87bad0f17387" (UID: "bc0055b8-de0a-4e9e-a7e6-87bad0f17387"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:31:52.795664 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.795634    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-kube-api-access-8wknw" (OuterVolumeSpecName: "kube-api-access-8wknw") pod "bc0055b8-de0a-4e9e-a7e6-87bad0f17387" (UID: "bc0055b8-de0a-4e9e-a7e6-87bad0f17387"). InnerVolumeSpecName "kube-api-access-8wknw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:31:52.894919 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.894893    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-workload-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:52.894919 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.894915    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wknw\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-kube-api-access-8wknw\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:52.895066 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.894925    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istiod-ca-cert\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:52.895066 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.894933    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-envoy\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:52.895066 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.894941    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-token\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:52.895066 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.894948    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-istio-podinfo\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:52.895066 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:52.894956    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0055b8-de0a-4e9e-a7e6-87bad0f17387-credential-socket\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:31:53.551406 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:53.551364    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"
Sep 16 12:31:53.551903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:53.551360    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w" event={"ID":"bc0055b8-de0a-4e9e-a7e6-87bad0f17387","Type":"ContainerDied","Data":"82b6117cfce19ef1f06889e25614b2973dee28860d8ed0e8624967df25175218"}
Sep 16 12:31:53.551903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:53.551506    2559 scope.go:117] "RemoveContainer" containerID="16cdfd3971f6a7ec5c295fc3bacbd89725ea0f75328b69c56ba0a68dad73eb81"
Sep 16 12:31:53.575269 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:53.575244    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"]
Sep 16 12:31:53.578645 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:53.578624    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-7a4d5c-openshift-default-f975bb484-zt62w"]
Sep 16 12:31:54.031193 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:31:54.031164    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" path="/var/lib/kubelet/pods/bc0055b8-de0a-4e9e-a7e6-87bad0f17387/volumes"
Sep 16 12:32:05.430861 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.430826    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"]
Sep 16 12:32:05.431319 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.431087    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p" podUID="7c00d09d-7d29-405f-baae-3ec1a8a93490" containerName="payload-processing" containerID="cri-o://345cf44611bce5a91aff9be2ee3a15d181051791e989a68aff38f2ff03b9a804" gracePeriod=30
Sep 16 12:32:05.438997 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.438942    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"]
Sep 16 12:32:05.439393 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.439183    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf" podUID="784b6879-eb93-4ea6-be73-203a846e6f20" containerName="payload-pre-processing" containerID="cri-o://a1a2ae5a68e4b730758fd458330fee49db0f37c378a57aebfc0969a1f7560afe" gracePeriod=30
Sep 16 12:32:05.623025 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.622995    2559 generic.go:356] "Generic (PLEG): container finished" podID="784b6879-eb93-4ea6-be73-203a846e6f20" containerID="a1a2ae5a68e4b730758fd458330fee49db0f37c378a57aebfc0969a1f7560afe" exitCode=0
Sep 16 12:32:05.623179 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.623069    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf" event={"ID":"784b6879-eb93-4ea6-be73-203a846e6f20","Type":"ContainerDied","Data":"a1a2ae5a68e4b730758fd458330fee49db0f37c378a57aebfc0969a1f7560afe"}
Sep 16 12:32:05.624766 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.624725    2559 generic.go:356] "Generic (PLEG): container finished" podID="7c00d09d-7d29-405f-baae-3ec1a8a93490" containerID="345cf44611bce5a91aff9be2ee3a15d181051791e989a68aff38f2ff03b9a804" exitCode=0
Sep 16 12:32:05.624766 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.624768    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p" event={"ID":"7c00d09d-7d29-405f-baae-3ec1a8a93490","Type":"ContainerDied","Data":"345cf44611bce5a91aff9be2ee3a15d181051791e989a68aff38f2ff03b9a804"}
Sep 16 12:32:05.722890 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.722866    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:32:05.725904 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.725886    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:32:05.902669 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.902636    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzxd7\" (UniqueName: \"kubernetes.io/projected/784b6879-eb93-4ea6-be73-203a846e6f20-kube-api-access-mzxd7\") pod \"784b6879-eb93-4ea6-be73-203a846e6f20\" (UID: \"784b6879-eb93-4ea6-be73-203a846e6f20\") "
Sep 16 12:32:05.902846 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.902761    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c00d09d-7d29-405f-baae-3ec1a8a93490-plugins-config-volume\") pod \"7c00d09d-7d29-405f-baae-3ec1a8a93490\" (UID: \"7c00d09d-7d29-405f-baae-3ec1a8a93490\") "
Sep 16 12:32:05.902892 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.902868    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdtph\" (UniqueName: \"kubernetes.io/projected/7c00d09d-7d29-405f-baae-3ec1a8a93490-kube-api-access-mdtph\") pod \"7c00d09d-7d29-405f-baae-3ec1a8a93490\" (UID: \"7c00d09d-7d29-405f-baae-3ec1a8a93490\") "
Sep 16 12:32:05.902926 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.902917    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/784b6879-eb93-4ea6-be73-203a846e6f20-plugins-config-volume\") pod \"784b6879-eb93-4ea6-be73-203a846e6f20\" (UID: \"784b6879-eb93-4ea6-be73-203a846e6f20\") "
Sep 16 12:32:05.903275 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.903249    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c00d09d-7d29-405f-baae-3ec1a8a93490-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c00d09d-7d29-405f-baae-3ec1a8a93490" (UID: "7c00d09d-7d29-405f-baae-3ec1a8a93490"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:05.903275 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.903263    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/784b6879-eb93-4ea6-be73-203a846e6f20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "784b6879-eb93-4ea6-be73-203a846e6f20" (UID: "784b6879-eb93-4ea6-be73-203a846e6f20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:05.904638 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.904616    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/784b6879-eb93-4ea6-be73-203a846e6f20-kube-api-access-mzxd7" (OuterVolumeSpecName: "kube-api-access-mzxd7") pod "784b6879-eb93-4ea6-be73-203a846e6f20" (UID: "784b6879-eb93-4ea6-be73-203a846e6f20"). InnerVolumeSpecName "kube-api-access-mzxd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:05.904755 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:05.904728    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c00d09d-7d29-405f-baae-3ec1a8a93490-kube-api-access-mdtph" (OuterVolumeSpecName: "kube-api-access-mdtph") pod "7c00d09d-7d29-405f-baae-3ec1a8a93490" (UID: "7c00d09d-7d29-405f-baae-3ec1a8a93490"). InnerVolumeSpecName "kube-api-access-mdtph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:06.003903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.003845    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c00d09d-7d29-405f-baae-3ec1a8a93490-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:06.003903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.003868    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdtph\" (UniqueName: \"kubernetes.io/projected/7c00d09d-7d29-405f-baae-3ec1a8a93490-kube-api-access-mdtph\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:06.003903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.003877    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/784b6879-eb93-4ea6-be73-203a846e6f20-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:06.003903 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.003885    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzxd7\" (UniqueName: \"kubernetes.io/projected/784b6879-eb93-4ea6-be73-203a846e6f20-kube-api-access-mzxd7\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:06.631494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.631388    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"
Sep 16 12:32:06.631494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.631399    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p" event={"ID":"7c00d09d-7d29-405f-baae-3ec1a8a93490","Type":"ContainerDied","Data":"c9223fc0f08bc56fccf537ed27e4e8f9fb17a7b30d2179aafdb6639340a136ac"}
Sep 16 12:32:06.631494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.631474    2559 scope.go:117] "RemoveContainer" containerID="345cf44611bce5a91aff9be2ee3a15d181051791e989a68aff38f2ff03b9a804"
Sep 16 12:32:06.633380 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.633313    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"
Sep 16 12:32:06.633380 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.633330    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf" event={"ID":"784b6879-eb93-4ea6-be73-203a846e6f20","Type":"ContainerDied","Data":"8a2c26bb1e2c39a3fd0fceab4b0ea462c7e734e3927f1ca78ee7b0b264df3458"}
Sep 16 12:32:06.641028 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.641010    2559 scope.go:117] "RemoveContainer" containerID="a1a2ae5a68e4b730758fd458330fee49db0f37c378a57aebfc0969a1f7560afe"
Sep 16 12:32:06.651518 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.651496    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"]
Sep 16 12:32:06.657936 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.657915    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5c41db-bcd78b75d-xnzmf"]
Sep 16 12:32:06.669368 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.669345    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"]
Sep 16 12:32:06.672740 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:06.672722    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5c41db-7b77df66c9-qgb4p"]
Sep 16 12:32:08.030327 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:08.030294    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="784b6879-eb93-4ea6-be73-203a846e6f20" path="/var/lib/kubelet/pods/784b6879-eb93-4ea6-be73-203a846e6f20/volumes"
Sep 16 12:32:08.030671 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:08.030637    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c00d09d-7d29-405f-baae-3ec1a8a93490" path="/var/lib/kubelet/pods/7c00d09d-7d29-405f-baae-3ec1a8a93490/volumes"
Sep 16 12:32:12.397850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.397818    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"]
Sep 16 12:32:12.398239 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398226    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a63d980-82e9-4b6d-bb72-5df214af3ec4" containerName="main"
Sep 16 12:32:12.398239 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398240    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a63d980-82e9-4b6d-bb72-5df214af3ec4" containerName="main"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398257    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0d8463-aed2-4b43-bffb-a1c49a1b6da8" containerName="payload-pre-processing"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398263    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0d8463-aed2-4b43-bffb-a1c49a1b6da8" containerName="payload-pre-processing"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398270    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784b6879-eb93-4ea6-be73-203a846e6f20" containerName="payload-pre-processing"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398276    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="784b6879-eb93-4ea6-be73-203a846e6f20" containerName="payload-pre-processing"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398285    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398291    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398300    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2615cc28-af14-4dd1-aed9-28be11ff8f73" containerName="payload-processing"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398305    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2615cc28-af14-4dd1-aed9-28be11ff8f73" containerName="payload-processing"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398320    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398326    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy"
Sep 16 12:32:12.398330 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398332    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c00d09d-7d29-405f-baae-3ec1a8a93490" containerName="payload-processing"
Sep 16 12:32:12.398667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398337    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c00d09d-7d29-405f-baae-3ec1a8a93490" containerName="payload-processing"
Sep 16 12:32:12.398667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398403    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy"
Sep 16 12:32:12.398667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398410    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a63d980-82e9-4b6d-bb72-5df214af3ec4" containerName="main"
Sep 16 12:32:12.398667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398416    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="784b6879-eb93-4ea6-be73-203a846e6f20" containerName="payload-pre-processing"
Sep 16 12:32:12.398667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398425    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2615cc28-af14-4dd1-aed9-28be11ff8f73" containerName="payload-processing"
Sep 16 12:32:12.398667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398430    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0d8463-aed2-4b43-bffb-a1c49a1b6da8" containerName="payload-pre-processing"
Sep 16 12:32:12.398667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398436    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c00d09d-7d29-405f-baae-3ec1a8a93490" containerName="payload-processing"
Sep 16 12:32:12.398667 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.398442    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0055b8-de0a-4e9e-a7e6-87bad0f17387" containerName="istio-proxy"
Sep 16 12:32:12.402915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.402900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"
Sep 16 12:32:12.405590 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.405566    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 12:32:12.405747 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.405566    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:32:12.409909 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.409885    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"]
Sep 16 12:32:12.559237 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.559205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b173c21-7420-46d9-84a9-ab49996bff6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs\" (UID: \"5b173c21-7420-46d9-84a9-ab49996bff6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"
Sep 16 12:32:12.660725 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.660626    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b173c21-7420-46d9-84a9-ab49996bff6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs\" (UID: \"5b173c21-7420-46d9-84a9-ab49996bff6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"
Sep 16 12:32:12.661258 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.661238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b173c21-7420-46d9-84a9-ab49996bff6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs\" (UID: \"5b173c21-7420-46d9-84a9-ab49996bff6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"
Sep 16 12:32:12.713946 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.713917    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"
Sep 16 12:32:12.985657 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:12.985631    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"]
Sep 16 12:32:12.987360 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:32:12.987323    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b173c21_7420_46d9_84a9_ab49996bff6f.slice/crio-91911213b0a19e720d8dcbd7e4f826d7ba624efd387f1c901323aae68c6a9d2f WatchSource:0}: Error finding container 91911213b0a19e720d8dcbd7e4f826d7ba624efd387f1c901323aae68c6a9d2f: Status 404 returned error can't find the container with id 91911213b0a19e720d8dcbd7e4f826d7ba624efd387f1c901323aae68c6a9d2f
Sep 16 12:32:13.679649 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:13.679624    2559 generic.go:356] "Generic (PLEG): container finished" podID="5b173c21-7420-46d9-84a9-ab49996bff6f" containerID="39fe704be4b341afd8571b72f7a959da42126d31f6c8a07eb2cd5d0fbc3f9872" exitCode=0
Sep 16 12:32:13.679962 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:13.679736    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs" event={"ID":"5b173c21-7420-46d9-84a9-ab49996bff6f","Type":"ContainerDied","Data":"39fe704be4b341afd8571b72f7a959da42126d31f6c8a07eb2cd5d0fbc3f9872"}
Sep 16 12:32:13.679962 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:13.679787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs" event={"ID":"5b173c21-7420-46d9-84a9-ab49996bff6f","Type":"ContainerStarted","Data":"91911213b0a19e720d8dcbd7e4f826d7ba624efd387f1c901323aae68c6a9d2f"}
Sep 16 12:32:14.820150 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:14.820127    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"
Sep 16 12:32:14.981349 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:14.981276    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b173c21-7420-46d9-84a9-ab49996bff6f-maas-api-service-ca\") pod \"5b173c21-7420-46d9-84a9-ab49996bff6f\" (UID: \"5b173c21-7420-46d9-84a9-ab49996bff6f\") "
Sep 16 12:32:14.981597 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:14.981576    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b173c21-7420-46d9-84a9-ab49996bff6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5b173c21-7420-46d9-84a9-ab49996bff6f" (UID: "5b173c21-7420-46d9-84a9-ab49996bff6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:15.082739 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:15.082676    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b173c21-7420-46d9-84a9-ab49996bff6f-maas-api-service-ca\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:15.694851 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:15.694823    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"
Sep 16 12:32:15.695008 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:15.694822    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs" event={"ID":"5b173c21-7420-46d9-84a9-ab49996bff6f","Type":"ContainerDied","Data":"91911213b0a19e720d8dcbd7e4f826d7ba624efd387f1c901323aae68c6a9d2f"}
Sep 16 12:32:15.695008 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:15.694949    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91911213b0a19e720d8dcbd7e4f826d7ba624efd387f1c901323aae68c6a9d2f"
Sep 16 12:32:23.112720 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.112662    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm"]
Sep 16 12:32:23.114616 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.114590    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-65d8af-29826030-ngqbm"]
Sep 16 12:32:23.136233 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.136205    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"]
Sep 16 12:32:23.136489 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.136446    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp" podUID="37e05eb6-2e04-4e61-8c05-845a735b0310" containerName="payload-processing" containerID="cri-o://56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919" gracePeriod=30
Sep 16 12:32:23.143349 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.143323    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"]
Sep 16 12:32:23.144005 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.143690    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl" podUID="bc6605a5-ee9e-4b7b-b893-c18070974850" containerName="payload-pre-processing" containerID="cri-o://f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8" gracePeriod=30
Sep 16 12:32:23.305841 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.305807    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"]
Sep 16 12:32:23.308064 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.308035    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-65d8af-sbsfs"]
Sep 16 12:32:23.426735 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.426714    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:32:23.429747 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.429725    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:32:23.453830 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.453801    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e05eb6-2e04-4e61-8c05-845a735b0310-plugins-config-volume\") pod \"37e05eb6-2e04-4e61-8c05-845a735b0310\" (UID: \"37e05eb6-2e04-4e61-8c05-845a735b0310\") "
Sep 16 12:32:23.454053 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.453845    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6605a5-ee9e-4b7b-b893-c18070974850-plugins-config-volume\") pod \"bc6605a5-ee9e-4b7b-b893-c18070974850\" (UID: \"bc6605a5-ee9e-4b7b-b893-c18070974850\") "
Sep 16 12:32:23.454053 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.453873    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhjl8\" (UniqueName: \"kubernetes.io/projected/bc6605a5-ee9e-4b7b-b893-c18070974850-kube-api-access-jhjl8\") pod \"bc6605a5-ee9e-4b7b-b893-c18070974850\" (UID: \"bc6605a5-ee9e-4b7b-b893-c18070974850\") "
Sep 16 12:32:23.454053 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.454004    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h268\" (UniqueName: \"kubernetes.io/projected/37e05eb6-2e04-4e61-8c05-845a735b0310-kube-api-access-5h268\") pod \"37e05eb6-2e04-4e61-8c05-845a735b0310\" (UID: \"37e05eb6-2e04-4e61-8c05-845a735b0310\") "
Sep 16 12:32:23.456136 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.456083    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37e05eb6-2e04-4e61-8c05-845a735b0310-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37e05eb6-2e04-4e61-8c05-845a735b0310" (UID: "37e05eb6-2e04-4e61-8c05-845a735b0310"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:23.456136 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.456084    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc6605a5-ee9e-4b7b-b893-c18070974850-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc6605a5-ee9e-4b7b-b893-c18070974850" (UID: "bc6605a5-ee9e-4b7b-b893-c18070974850"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:23.457300 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.457264    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e05eb6-2e04-4e61-8c05-845a735b0310-kube-api-access-5h268" (OuterVolumeSpecName: "kube-api-access-5h268") pod "37e05eb6-2e04-4e61-8c05-845a735b0310" (UID: "37e05eb6-2e04-4e61-8c05-845a735b0310"). InnerVolumeSpecName "kube-api-access-5h268". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:23.458090 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.458057    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6605a5-ee9e-4b7b-b893-c18070974850-kube-api-access-jhjl8" (OuterVolumeSpecName: "kube-api-access-jhjl8") pod "bc6605a5-ee9e-4b7b-b893-c18070974850" (UID: "bc6605a5-ee9e-4b7b-b893-c18070974850"). InnerVolumeSpecName "kube-api-access-jhjl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:23.555765 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.555734    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h268\" (UniqueName: \"kubernetes.io/projected/37e05eb6-2e04-4e61-8c05-845a735b0310-kube-api-access-5h268\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:23.555765 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.555760    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37e05eb6-2e04-4e61-8c05-845a735b0310-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:23.555765 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.555771    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc6605a5-ee9e-4b7b-b893-c18070974850-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:23.555988 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.555780    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhjl8\" (UniqueName: \"kubernetes.io/projected/bc6605a5-ee9e-4b7b-b893-c18070974850-kube-api-access-jhjl8\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:23.745132 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.745049    2559 generic.go:356] "Generic (PLEG): container finished" podID="37e05eb6-2e04-4e61-8c05-845a735b0310" containerID="56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919" exitCode=0
Sep 16 12:32:23.745132 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.745096    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"
Sep 16 12:32:23.745327 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.745135    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp" event={"ID":"37e05eb6-2e04-4e61-8c05-845a735b0310","Type":"ContainerDied","Data":"56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919"}
Sep 16 12:32:23.745327 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.745199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp" event={"ID":"37e05eb6-2e04-4e61-8c05-845a735b0310","Type":"ContainerDied","Data":"b3d40e8714035ef78b2153965487b780877d2b4dddce7f5839c8967d110891ab"}
Sep 16 12:32:23.745327 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.745226    2559 scope.go:117] "RemoveContainer" containerID="56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919"
Sep 16 12:32:23.747079 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.747050    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc6605a5-ee9e-4b7b-b893-c18070974850" containerID="f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8" exitCode=0
Sep 16 12:32:23.747197 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.747105    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl" event={"ID":"bc6605a5-ee9e-4b7b-b893-c18070974850","Type":"ContainerDied","Data":"f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8"}
Sep 16 12:32:23.747197 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.747147    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl" event={"ID":"bc6605a5-ee9e-4b7b-b893-c18070974850","Type":"ContainerDied","Data":"4dcab94ccd142c68dbc11cd3e945629dbf979151ce88f6d92d12953debeed009"}
Sep 16 12:32:23.747321 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.747212    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"
Sep 16 12:32:23.757561 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.757538    2559 scope.go:117] "RemoveContainer" containerID="56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919"
Sep 16 12:32:23.757894 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:32:23.757869    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919\": container with ID starting with 56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919 not found: ID does not exist" containerID="56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919"
Sep 16 12:32:23.757964 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.757904    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919"} err="failed to get container status \"56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919\": rpc error: code = NotFound desc = could not find container \"56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919\": container with ID starting with 56ff6fd1191dd9517d9ccfeb98932460ac00e019c53ffee36fcce21883775919 not found: ID does not exist"
Sep 16 12:32:23.757964 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.757928    2559 scope.go:117] "RemoveContainer" containerID="f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8"
Sep 16 12:32:23.766338 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.766286    2559 scope.go:117] "RemoveContainer" containerID="f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8"
Sep 16 12:32:23.767015 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:32:23.766992    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8\": container with ID starting with f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8 not found: ID does not exist" containerID="f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8"
Sep 16 12:32:23.767106 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.767021    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8"} err="failed to get container status \"f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8\": rpc error: code = NotFound desc = could not find container \"f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8\": container with ID starting with f7d71cef5fea24a27bb2d22adf5c7922921cb9209f391f7d63062398e7abb9b8 not found: ID does not exist"
Sep 16 12:32:23.768950 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.768932    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"]
Sep 16 12:32:23.774382 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.774361    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-65d8af-7b4585756f-mz7qp"]
Sep 16 12:32:23.785919 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.785899    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"]
Sep 16 12:32:23.787553 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:23.787535    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-65d8af-7d4c796df8-cb6nl"]
Sep 16 12:32:24.031064 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:24.030992    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06e2b0cc-c106-44db-9221-2f25f71e65c0" path="/var/lib/kubelet/pods/06e2b0cc-c106-44db-9221-2f25f71e65c0/volumes"
Sep 16 12:32:24.031309 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:24.031295    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e05eb6-2e04-4e61-8c05-845a735b0310" path="/var/lib/kubelet/pods/37e05eb6-2e04-4e61-8c05-845a735b0310/volumes"
Sep 16 12:32:24.031582 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:24.031570    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b173c21-7420-46d9-84a9-ab49996bff6f" path="/var/lib/kubelet/pods/5b173c21-7420-46d9-84a9-ab49996bff6f/volumes"
Sep 16 12:32:24.031932 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:24.031918    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6605a5-ee9e-4b7b-b893-c18070974850" path="/var/lib/kubelet/pods/bc6605a5-ee9e-4b7b-b893-c18070974850/volumes"
Sep 16 12:32:30.297005 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.296971    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"]
Sep 16 12:32:30.297380 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.297368    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc6605a5-ee9e-4b7b-b893-c18070974850" containerName="payload-pre-processing"
Sep 16 12:32:30.297426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.297382    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc6605a5-ee9e-4b7b-b893-c18070974850" containerName="payload-pre-processing"
Sep 16 12:32:30.297426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.297389    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b173c21-7420-46d9-84a9-ab49996bff6f" containerName="revoke-keys"
Sep 16 12:32:30.297426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.297395    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b173c21-7420-46d9-84a9-ab49996bff6f" containerName="revoke-keys"
Sep 16 12:32:30.297426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.297410    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e05eb6-2e04-4e61-8c05-845a735b0310" containerName="payload-processing"
Sep 16 12:32:30.297426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.297416    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e05eb6-2e04-4e61-8c05-845a735b0310" containerName="payload-processing"
Sep 16 12:32:30.297590 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.297476    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc6605a5-ee9e-4b7b-b893-c18070974850" containerName="payload-pre-processing"
Sep 16 12:32:30.297590 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.297484    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b173c21-7420-46d9-84a9-ab49996bff6f" containerName="revoke-keys"
Sep 16 12:32:30.297590 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.297494    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e05eb6-2e04-4e61-8c05-845a735b0310" containerName="payload-processing"
Sep 16 12:32:30.302073 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.302053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"
Sep 16 12:32:30.304712 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.304672    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 12:32:30.304850 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.304749    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:32:30.308391 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.308365    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"]
Sep 16 12:32:30.410089 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.410063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp\" (UID: \"1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"
Sep 16 12:32:30.511218 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.511189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp\" (UID: \"1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"
Sep 16 12:32:30.511788 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.511771    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp\" (UID: \"1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"
Sep 16 12:32:30.613642 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.613562    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"
Sep 16 12:32:30.886793 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:30.886764    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"]
Sep 16 12:32:30.888295 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:32:30.888269    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0d36ad_ceee_4ded_9c2a_b4dbbc7673e9.slice/crio-a9084a80576c7c00e00d7cf250a642fde74d663778917945e9e9da60e1e1aa1f WatchSource:0}: Error finding container a9084a80576c7c00e00d7cf250a642fde74d663778917945e9e9da60e1e1aa1f: Status 404 returned error can't find the container with id a9084a80576c7c00e00d7cf250a642fde74d663778917945e9e9da60e1e1aa1f
Sep 16 12:32:31.795452 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:31.795426    2559 generic.go:356] "Generic (PLEG): container finished" podID="1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9" containerID="9f63d3aea1d2103acfa4b41a49f8422e37775c779a54451e0724084f70eca1e4" exitCode=0
Sep 16 12:32:31.795790 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:31.795472    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp" event={"ID":"1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9","Type":"ContainerDied","Data":"9f63d3aea1d2103acfa4b41a49f8422e37775c779a54451e0724084f70eca1e4"}
Sep 16 12:32:31.795790 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:31.795527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp" event={"ID":"1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9","Type":"ContainerStarted","Data":"a9084a80576c7c00e00d7cf250a642fde74d663778917945e9e9da60e1e1aa1f"}
Sep 16 12:32:32.937203 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:32.937171    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"
Sep 16 12:32:33.032444 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:33.032411    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9-maas-api-service-ca\") pod \"1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9\" (UID: \"1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9\") "
Sep 16 12:32:33.032727 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:33.032708    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9" (UID: "1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:33.133326 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:33.133258    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9-maas-api-service-ca\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:33.807673 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:33.807640    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"
Sep 16 12:32:33.807865 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:33.807671    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp" event={"ID":"1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9","Type":"ContainerDied","Data":"a9084a80576c7c00e00d7cf250a642fde74d663778917945e9e9da60e1e1aa1f"}
Sep 16 12:32:33.807865 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:33.807759    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9084a80576c7c00e00d7cf250a642fde74d663778917945e9e9da60e1e1aa1f"
Sep 16 12:32:40.787292 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:40.787244    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c"]
Sep 16 12:32:40.789365 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:40.789338    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f9133e-29826030-b7r8c"]
Sep 16 12:32:40.814455 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:40.814431    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"]
Sep 16 12:32:40.814644 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:40.814622    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6" podUID="bc19a45e-5766-462c-878f-e06aea73dfda" containerName="payload-pre-processing" containerID="cri-o://3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81" gracePeriod=30
Sep 16 12:32:40.993320 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:40.993290    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"]
Sep 16 12:32:40.999331 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:40.999290    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f9133e-zhvsp"]
Sep 16 12:32:41.066999 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.066974    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:32:41.199078 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.199040    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr47n\" (UniqueName: \"kubernetes.io/projected/bc19a45e-5766-462c-878f-e06aea73dfda-kube-api-access-wr47n\") pod \"bc19a45e-5766-462c-878f-e06aea73dfda\" (UID: \"bc19a45e-5766-462c-878f-e06aea73dfda\") "
Sep 16 12:32:41.199268 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.199173    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc19a45e-5766-462c-878f-e06aea73dfda-plugins-config-volume\") pod \"bc19a45e-5766-462c-878f-e06aea73dfda\" (UID: \"bc19a45e-5766-462c-878f-e06aea73dfda\") "
Sep 16 12:32:41.199544 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.199512    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc19a45e-5766-462c-878f-e06aea73dfda-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc19a45e-5766-462c-878f-e06aea73dfda" (UID: "bc19a45e-5766-462c-878f-e06aea73dfda"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:32:41.201114 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.201092    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc19a45e-5766-462c-878f-e06aea73dfda-kube-api-access-wr47n" (OuterVolumeSpecName: "kube-api-access-wr47n") pod "bc19a45e-5766-462c-878f-e06aea73dfda" (UID: "bc19a45e-5766-462c-878f-e06aea73dfda"). InnerVolumeSpecName "kube-api-access-wr47n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:32:41.300566 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.300512    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc19a45e-5766-462c-878f-e06aea73dfda-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:41.300566 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.300534    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr47n\" (UniqueName: \"kubernetes.io/projected/bc19a45e-5766-462c-878f-e06aea73dfda-kube-api-access-wr47n\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:32:41.850117 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.850083    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc19a45e-5766-462c-878f-e06aea73dfda" containerID="3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81" exitCode=0
Sep 16 12:32:41.850494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.850146    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"
Sep 16 12:32:41.850494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.850183    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6" event={"ID":"bc19a45e-5766-462c-878f-e06aea73dfda","Type":"ContainerDied","Data":"3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81"}
Sep 16 12:32:41.850494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.850250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6" event={"ID":"bc19a45e-5766-462c-878f-e06aea73dfda","Type":"ContainerDied","Data":"b1323a7a0db05c69910e88faafc7f164492b95384da339bc6999dfeefb97971e"}
Sep 16 12:32:41.850494 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.850281    2559 scope.go:117] "RemoveContainer" containerID="3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81"
Sep 16 12:32:41.859317 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.859299    2559 scope.go:117] "RemoveContainer" containerID="3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81"
Sep 16 12:32:41.859580 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:32:41.859561    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81\": container with ID starting with 3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81 not found: ID does not exist" containerID="3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81"
Sep 16 12:32:41.859643 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.859587    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81"} err="failed to get container status \"3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81\": rpc error: code = NotFound desc = could not find container \"3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81\": container with ID starting with 3698bf5368375df379940ca68358d9164a1e95055b84081a2d103cbd89f70d81 not found: ID does not exist"
Sep 16 12:32:41.874885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.874863    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"]
Sep 16 12:32:41.881989 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:41.881966    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f9133e-85d944bf74-7hqw6"]
Sep 16 12:32:42.030899 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:42.030875    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9" path="/var/lib/kubelet/pods/1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9/volumes"
Sep 16 12:32:42.031144 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:42.031132    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bd830db-8fd4-40b0-b220-88108d4e7ee0" path="/var/lib/kubelet/pods/5bd830db-8fd4-40b0-b220-88108d4e7ee0/volumes"
Sep 16 12:32:42.031418 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:32:42.031407    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc19a45e-5766-462c-878f-e06aea73dfda" path="/var/lib/kubelet/pods/bc19a45e-5766-462c-878f-e06aea73dfda/volumes"
Sep 16 12:35:11.807998 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.807913    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"]
Sep 16 12:35:11.808570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.808342    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc19a45e-5766-462c-878f-e06aea73dfda" containerName="payload-pre-processing"
Sep 16 12:35:11.808570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.808364    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc19a45e-5766-462c-878f-e06aea73dfda" containerName="payload-pre-processing"
Sep 16 12:35:11.808570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.808387    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9" containerName="revoke-keys"
Sep 16 12:35:11.808570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.808393    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9" containerName="revoke-keys"
Sep 16 12:35:11.808570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.808452    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc19a45e-5766-462c-878f-e06aea73dfda" containerName="payload-pre-processing"
Sep 16 12:35:11.808570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.808461    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e0d36ad-ceee-4ded-9c2a-b4dbbc7673e9" containerName="revoke-keys"
Sep 16 12:35:11.811572 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.811551    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"]
Sep 16 12:35:11.811729 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.811683    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:11.814874 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.814855    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:11.815984 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.815967    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-3ba9e7\""
Sep 16 12:35:11.818574 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.818556    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-3ba9e7-dockercfg-f9m76\""
Sep 16 12:35:11.825360 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.825340    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"]
Sep 16 12:35:11.830428 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.830402    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"]
Sep 16 12:35:11.877690 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.877663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm\" (UID: \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:11.877818 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.877767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv4nn\" (UniqueName: \"kubernetes.io/projected/b5910d14-3dfa-40d6-a39c-66824dfebbe2-kube-api-access-kv4nn\") pod \"payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb\" (UID: \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:11.877864 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.877816    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqtms\" (UniqueName: \"kubernetes.io/projected/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-kube-api-access-hqtms\") pod \"payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm\" (UID: \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:11.877897 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.877859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5910d14-3dfa-40d6-a39c-66824dfebbe2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb\" (UID: \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:11.978767 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.978729    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm\" (UID: \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:11.978925 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.978842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv4nn\" (UniqueName: \"kubernetes.io/projected/b5910d14-3dfa-40d6-a39c-66824dfebbe2-kube-api-access-kv4nn\") pod \"payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb\" (UID: \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:11.978925 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.978909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqtms\" (UniqueName: \"kubernetes.io/projected/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-kube-api-access-hqtms\") pod \"payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm\" (UID: \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:11.979018 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.978942    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5910d14-3dfa-40d6-a39c-66824dfebbe2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb\" (UID: \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:11.979630 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.979606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm\" (UID: \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:11.979716 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.979681    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5910d14-3dfa-40d6-a39c-66824dfebbe2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb\" (UID: \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:11.987608 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.987573    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv4nn\" (UniqueName: \"kubernetes.io/projected/b5910d14-3dfa-40d6-a39c-66824dfebbe2-kube-api-access-kv4nn\") pod \"payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb\" (UID: \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:11.987740 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:11.987575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqtms\" (UniqueName: \"kubernetes.io/projected/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-kube-api-access-hqtms\") pod \"payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm\" (UID: \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:12.123553 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.123489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:12.130743 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.130727    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:12.398908 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.398883    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"]
Sep 16 12:35:12.400378 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:35:12.400347    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f10d44b_86dd_4abf_b1f9_3991c42bb5e2.slice/crio-62ec3c61fbab8615d680542d422af6d89081115279751d4301627a5f8422f109 WatchSource:0}: Error finding container 62ec3c61fbab8615d680542d422af6d89081115279751d4301627a5f8422f109: Status 404 returned error can't find the container with id 62ec3c61fbab8615d680542d422af6d89081115279751d4301627a5f8422f109
Sep 16 12:35:12.408110 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.408021    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"]
Sep 16 12:35:12.412637 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:35:12.412615    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5910d14_3dfa_40d6_a39c_66824dfebbe2.slice/crio-426199841c84610ff38c078344a6a57ac090c7388faa243af99a9b7c436dda16 WatchSource:0}: Error finding container 426199841c84610ff38c078344a6a57ac090c7388faa243af99a9b7c436dda16: Status 404 returned error can't find the container with id 426199841c84610ff38c078344a6a57ac090c7388faa243af99a9b7c436dda16
Sep 16 12:35:12.618274 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.618240    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm" event={"ID":"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2","Type":"ContainerStarted","Data":"b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699"}
Sep 16 12:35:12.618463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.618298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm" event={"ID":"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2","Type":"ContainerStarted","Data":"62ec3c61fbab8615d680542d422af6d89081115279751d4301627a5f8422f109"}
Sep 16 12:35:12.618463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.618353    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:12.620067 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.620041    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb" event={"ID":"b5910d14-3dfa-40d6-a39c-66824dfebbe2","Type":"ContainerStarted","Data":"cbff842241f38e2a2794ed988057765584daff12d8f7e6a0549fa5716621841a"}
Sep 16 12:35:12.620196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.620080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb" event={"ID":"b5910d14-3dfa-40d6-a39c-66824dfebbe2","Type":"ContainerStarted","Data":"426199841c84610ff38c078344a6a57ac090c7388faa243af99a9b7c436dda16"}
Sep 16 12:35:12.620196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.620137    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:12.637782 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.637736    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm" podStartSLOduration=1.637723021 podStartE2EDuration="1.637723021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:35:12.635520425 +0000 UTC m=+2069.078555287" watchObservedRunningTime="2026-09-16 12:35:12.637723021 +0000 UTC m=+2069.080757883"
Sep 16 12:35:12.653000 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:12.652918    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb" podStartSLOduration=1.652901279 podStartE2EDuration="1.652901279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:35:12.65215492 +0000 UTC m=+2069.095189781" watchObservedRunningTime="2026-09-16 12:35:12.652901279 +0000 UTC m=+2069.095936142"
Sep 16 12:35:23.627163 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:23.627132    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:35:23.627565 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:23.627200    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:35:41.269558 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.269526    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"]
Sep 16 12:35:41.273103 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.273086    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:41.277332 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.277312    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-43ef83\""
Sep 16 12:35:41.277453 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.277398    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-43ef83-dockercfg-55ghr\""
Sep 16 12:35:41.289634 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.289613    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"]
Sep 16 12:35:41.303729 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.303705    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"]
Sep 16 12:35:41.307797 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.307770    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:35:41.317050 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.317031    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"]
Sep 16 12:35:41.419098 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.419062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/374eb338-7b23-4dab-a905-9afc4adf6283-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m\" (UID: \"374eb338-7b23-4dab-a905-9afc4adf6283\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:41.419279 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.419115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwsql\" (UniqueName: \"kubernetes.io/projected/9e6490f1-1591-428d-93f3-78811337c58f-kube-api-access-jwsql\") pod \"payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9\" (UID: \"9e6490f1-1591-428d-93f3-78811337c58f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:35:41.419279 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.419188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t66ld\" (UniqueName: \"kubernetes.io/projected/374eb338-7b23-4dab-a905-9afc4adf6283-kube-api-access-t66ld\") pod \"payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m\" (UID: \"374eb338-7b23-4dab-a905-9afc4adf6283\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:41.419279 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.419231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e6490f1-1591-428d-93f3-78811337c58f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9\" (UID: \"9e6490f1-1591-428d-93f3-78811337c58f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:35:41.520741 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.520658    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e6490f1-1591-428d-93f3-78811337c58f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9\" (UID: \"9e6490f1-1591-428d-93f3-78811337c58f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:35:41.520855 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.520768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/374eb338-7b23-4dab-a905-9afc4adf6283-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m\" (UID: \"374eb338-7b23-4dab-a905-9afc4adf6283\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:41.520855 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.520818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwsql\" (UniqueName: \"kubernetes.io/projected/9e6490f1-1591-428d-93f3-78811337c58f-kube-api-access-jwsql\") pod \"payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9\" (UID: \"9e6490f1-1591-428d-93f3-78811337c58f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:35:41.520931 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.520860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t66ld\" (UniqueName: \"kubernetes.io/projected/374eb338-7b23-4dab-a905-9afc4adf6283-kube-api-access-t66ld\") pod \"payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m\" (UID: \"374eb338-7b23-4dab-a905-9afc4adf6283\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:41.521398 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.521380    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e6490f1-1591-428d-93f3-78811337c58f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9\" (UID: \"9e6490f1-1591-428d-93f3-78811337c58f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:35:41.521440 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.521422    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/374eb338-7b23-4dab-a905-9afc4adf6283-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m\" (UID: \"374eb338-7b23-4dab-a905-9afc4adf6283\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:41.529041 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.529010    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwsql\" (UniqueName: \"kubernetes.io/projected/9e6490f1-1591-428d-93f3-78811337c58f-kube-api-access-jwsql\") pod \"payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9\" (UID: \"9e6490f1-1591-428d-93f3-78811337c58f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:35:41.529169 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.529074    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t66ld\" (UniqueName: \"kubernetes.io/projected/374eb338-7b23-4dab-a905-9afc4adf6283-kube-api-access-t66ld\") pod \"payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m\" (UID: \"374eb338-7b23-4dab-a905-9afc4adf6283\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:41.583951 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.583924    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:41.619321 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.619296    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:35:41.858617 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.858588    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"]
Sep 16 12:35:41.859962 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:35:41.859936    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374eb338_7b23_4dab_a905_9afc4adf6283.slice/crio-a4c293683fd03644b3f60ec8bf2c0b33ef85e14e8bdfcfa81728781f8a7a0a07 WatchSource:0}: Error finding container a4c293683fd03644b3f60ec8bf2c0b33ef85e14e8bdfcfa81728781f8a7a0a07: Status 404 returned error can't find the container with id a4c293683fd03644b3f60ec8bf2c0b33ef85e14e8bdfcfa81728781f8a7a0a07
Sep 16 12:35:41.904393 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:41.904347    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"]
Sep 16 12:35:41.905485 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:35:41.905463    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6490f1_1591_428d_93f3_78811337c58f.slice/crio-8eb02cf6aff7912e7676a36835d7f4ae6c3183602ebfbbc2b4568291b8672b04 WatchSource:0}: Error finding container 8eb02cf6aff7912e7676a36835d7f4ae6c3183602ebfbbc2b4568291b8672b04: Status 404 returned error can't find the container with id 8eb02cf6aff7912e7676a36835d7f4ae6c3183602ebfbbc2b4568291b8672b04
Sep 16 12:35:42.782596 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:42.782564    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m" event={"ID":"374eb338-7b23-4dab-a905-9afc4adf6283","Type":"ContainerStarted","Data":"8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e"}
Sep 16 12:35:42.783050 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:42.782613    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m" event={"ID":"374eb338-7b23-4dab-a905-9afc4adf6283","Type":"ContainerStarted","Data":"a4c293683fd03644b3f60ec8bf2c0b33ef85e14e8bdfcfa81728781f8a7a0a07"}
Sep 16 12:35:42.783050 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:42.782741    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:42.784422 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:42.784393    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9" event={"ID":"9e6490f1-1591-428d-93f3-78811337c58f","Type":"ContainerStarted","Data":"a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26"}
Sep 16 12:35:42.784559 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:42.784431    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9" event={"ID":"9e6490f1-1591-428d-93f3-78811337c58f","Type":"ContainerStarted","Data":"8eb02cf6aff7912e7676a36835d7f4ae6c3183602ebfbbc2b4568291b8672b04"}
Sep 16 12:35:42.784559 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:42.784485    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:35:42.799588 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:42.799545    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m" podStartSLOduration=1.799532268 podStartE2EDuration="1.799532268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:35:42.797883574 +0000 UTC m=+2099.240918435" watchObservedRunningTime="2026-09-16 12:35:42.799532268 +0000 UTC m=+2099.242567129"
Sep 16 12:35:42.817146 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:42.817101    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9" podStartSLOduration=1.817084967 podStartE2EDuration="1.817084967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:35:42.813979811 +0000 UTC m=+2099.257014684" watchObservedRunningTime="2026-09-16 12:35:42.817084967 +0000 UTC m=+2099.260119830"
Sep 16 12:35:53.797711 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:53.797665    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:35:53.798265 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:35:53.797865    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:36:08.885883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:36:08.885855    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9_9e6490f1-1591-428d-93f3-78811337c58f/payload-processing/0.log"
Sep 16 12:36:44.279811 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:36:44.279784    2559 scope.go:117] "RemoveContainer" containerID="3575f16801c756eba9841c67d2aed2bbfd94d1390cdf40242a6dc237485116d9"
Sep 16 12:36:44.287983 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:36:44.287963    2559 scope.go:117] "RemoveContainer" containerID="26837bd069d4283bbeff38e55dd0102ee765a8f926c342547a6882b6e70a65b1"
Sep 16 12:36:55.086522 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:36:55.086468    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb_b5910d14-3dfa-40d6-a39c-66824dfebbe2/payload-processing/0.log"
Sep 16 12:36:55.373257 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:36:55.373182    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9_9e6490f1-1591-428d-93f3-78811337c58f/payload-processing/0.log"
Sep 16 12:37:02.280277 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.280237    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"]
Sep 16 12:37:02.284224 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.284200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:02.286784 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.286760    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-6b0cae-dockercfg-md6fn\""
Sep 16 12:37:02.286883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.286803    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-6b0cae\""
Sep 16 12:37:02.294334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.294309    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"]
Sep 16 12:37:02.304261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.304238    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"]
Sep 16 12:37:02.308105 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.308084    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:02.321419 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.321399    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"]
Sep 16 12:37:02.444853 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.444813    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh25l\" (UniqueName: \"kubernetes.io/projected/b80d695f-1ebd-4926-a301-628b52d861c0-kube-api-access-kh25l\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx\" (UID: \"b80d695f-1ebd-4926-a301-628b52d861c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:02.445014 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.444918    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8q5c\" (UniqueName: \"kubernetes.io/projected/9accd5e1-016f-4b12-ad0e-93cb6698904d-kube-api-access-g8q5c\") pod \"payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw\" (UID: \"9accd5e1-016f-4b12-ad0e-93cb6698904d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:02.445014 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.444946    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9accd5e1-016f-4b12-ad0e-93cb6698904d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw\" (UID: \"9accd5e1-016f-4b12-ad0e-93cb6698904d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:02.445090 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.445028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b80d695f-1ebd-4926-a301-628b52d861c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx\" (UID: \"b80d695f-1ebd-4926-a301-628b52d861c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:02.546177 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.546104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b80d695f-1ebd-4926-a301-628b52d861c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx\" (UID: \"b80d695f-1ebd-4926-a301-628b52d861c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:02.546177 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.546166    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh25l\" (UniqueName: \"kubernetes.io/projected/b80d695f-1ebd-4926-a301-628b52d861c0-kube-api-access-kh25l\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx\" (UID: \"b80d695f-1ebd-4926-a301-628b52d861c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:02.546343 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.546214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8q5c\" (UniqueName: \"kubernetes.io/projected/9accd5e1-016f-4b12-ad0e-93cb6698904d-kube-api-access-g8q5c\") pod \"payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw\" (UID: \"9accd5e1-016f-4b12-ad0e-93cb6698904d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:02.546343 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.546233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9accd5e1-016f-4b12-ad0e-93cb6698904d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw\" (UID: \"9accd5e1-016f-4b12-ad0e-93cb6698904d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:02.547109 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.547075    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b80d695f-1ebd-4926-a301-628b52d861c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx\" (UID: \"b80d695f-1ebd-4926-a301-628b52d861c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:02.547244 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.547077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9accd5e1-016f-4b12-ad0e-93cb6698904d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw\" (UID: \"9accd5e1-016f-4b12-ad0e-93cb6698904d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:02.554813 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.554787    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh25l\" (UniqueName: \"kubernetes.io/projected/b80d695f-1ebd-4926-a301-628b52d861c0-kube-api-access-kh25l\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx\" (UID: \"b80d695f-1ebd-4926-a301-628b52d861c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:02.554972 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.554950    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8q5c\" (UniqueName: \"kubernetes.io/projected/9accd5e1-016f-4b12-ad0e-93cb6698904d-kube-api-access-g8q5c\") pod \"payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw\" (UID: \"9accd5e1-016f-4b12-ad0e-93cb6698904d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:02.595885 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.595858    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:02.618561 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.618369    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:02.868564 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.868495    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"]
Sep 16 12:37:02.871658 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:37:02.871634    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80d695f_1ebd_4926_a301_628b52d861c0.slice/crio-8a449034d85ea6a986a56dd8e6e63f61ffd612a2fd0449f18c77ba19902a051f WatchSource:0}: Error finding container 8a449034d85ea6a986a56dd8e6e63f61ffd612a2fd0449f18c77ba19902a051f: Status 404 returned error can't find the container with id 8a449034d85ea6a986a56dd8e6e63f61ffd612a2fd0449f18c77ba19902a051f
Sep 16 12:37:02.901821 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:02.901800    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"]
Sep 16 12:37:02.906792 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:37:02.906766    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9accd5e1_016f_4b12_ad0e_93cb6698904d.slice/crio-869d6ddd497f4da5f2c5d4c8fa97c031955dbbba2fa4b88308e490fc146c619e WatchSource:0}: Error finding container 869d6ddd497f4da5f2c5d4c8fa97c031955dbbba2fa4b88308e490fc146c619e: Status 404 returned error can't find the container with id 869d6ddd497f4da5f2c5d4c8fa97c031955dbbba2fa4b88308e490fc146c619e
Sep 16 12:37:03.217053 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:03.217014    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw" event={"ID":"9accd5e1-016f-4b12-ad0e-93cb6698904d","Type":"ContainerStarted","Data":"01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe"}
Sep 16 12:37:03.217237 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:03.217073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw" event={"ID":"9accd5e1-016f-4b12-ad0e-93cb6698904d","Type":"ContainerStarted","Data":"869d6ddd497f4da5f2c5d4c8fa97c031955dbbba2fa4b88308e490fc146c619e"}
Sep 16 12:37:03.217237 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:03.217227    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:03.218868 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:03.218841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx" event={"ID":"b80d695f-1ebd-4926-a301-628b52d861c0","Type":"ContainerStarted","Data":"4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af"}
Sep 16 12:37:03.218986 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:03.218886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx" event={"ID":"b80d695f-1ebd-4926-a301-628b52d861c0","Type":"ContainerStarted","Data":"8a449034d85ea6a986a56dd8e6e63f61ffd612a2fd0449f18c77ba19902a051f"}
Sep 16 12:37:03.218986 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:03.218915    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:03.237012 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:03.236973    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw" podStartSLOduration=1.236957083 podStartE2EDuration="1.236957083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:37:03.235910982 +0000 UTC m=+2179.678945844" watchObservedRunningTime="2026-09-16 12:37:03.236957083 +0000 UTC m=+2179.679991945"
Sep 16 12:37:03.255708 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:03.255652    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx" podStartSLOduration=1.25563639 podStartE2EDuration="1.25563639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:37:03.252960765 +0000 UTC m=+2179.695995627" watchObservedRunningTime="2026-09-16 12:37:03.25563639 +0000 UTC m=+2179.698671256"
Sep 16 12:37:14.226218 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:14.226182    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:14.226669 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:14.226381    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:40.564764 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.564721    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"]
Sep 16 12:37:40.565254 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.564918    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw" podUID="9accd5e1-016f-4b12-ad0e-93cb6698904d" containerName="payload-processing" containerID="cri-o://01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe" gracePeriod=30
Sep 16 12:37:40.571990 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.571807    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"]
Sep 16 12:37:40.572082 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.572022    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx" podUID="b80d695f-1ebd-4926-a301-628b52d861c0" containerName="payload-pre-processing" containerID="cri-o://4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af" gracePeriod=30
Sep 16 12:37:40.851562 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.851538    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:40.854770 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.854750    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:40.951790 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.951759    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh25l\" (UniqueName: \"kubernetes.io/projected/b80d695f-1ebd-4926-a301-628b52d861c0-kube-api-access-kh25l\") pod \"b80d695f-1ebd-4926-a301-628b52d861c0\" (UID: \"b80d695f-1ebd-4926-a301-628b52d861c0\") "
Sep 16 12:37:40.951988 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.951855    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9accd5e1-016f-4b12-ad0e-93cb6698904d-plugins-config-volume\") pod \"9accd5e1-016f-4b12-ad0e-93cb6698904d\" (UID: \"9accd5e1-016f-4b12-ad0e-93cb6698904d\") "
Sep 16 12:37:40.952077 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.952000    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8q5c\" (UniqueName: \"kubernetes.io/projected/9accd5e1-016f-4b12-ad0e-93cb6698904d-kube-api-access-g8q5c\") pod \"9accd5e1-016f-4b12-ad0e-93cb6698904d\" (UID: \"9accd5e1-016f-4b12-ad0e-93cb6698904d\") "
Sep 16 12:37:40.952077 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.952063    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b80d695f-1ebd-4926-a301-628b52d861c0-plugins-config-volume\") pod \"b80d695f-1ebd-4926-a301-628b52d861c0\" (UID: \"b80d695f-1ebd-4926-a301-628b52d861c0\") "
Sep 16 12:37:40.952241 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.952208    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9accd5e1-016f-4b12-ad0e-93cb6698904d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9accd5e1-016f-4b12-ad0e-93cb6698904d" (UID: "9accd5e1-016f-4b12-ad0e-93cb6698904d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:37:40.952453 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.952418    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b80d695f-1ebd-4926-a301-628b52d861c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b80d695f-1ebd-4926-a301-628b52d861c0" (UID: "b80d695f-1ebd-4926-a301-628b52d861c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:37:40.952579 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.952485    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9accd5e1-016f-4b12-ad0e-93cb6698904d-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:37:40.954008 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.953976    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80d695f-1ebd-4926-a301-628b52d861c0-kube-api-access-kh25l" (OuterVolumeSpecName: "kube-api-access-kh25l") pod "b80d695f-1ebd-4926-a301-628b52d861c0" (UID: "b80d695f-1ebd-4926-a301-628b52d861c0"). InnerVolumeSpecName "kube-api-access-kh25l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:37:40.954098 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:40.954062    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9accd5e1-016f-4b12-ad0e-93cb6698904d-kube-api-access-g8q5c" (OuterVolumeSpecName: "kube-api-access-g8q5c") pod "9accd5e1-016f-4b12-ad0e-93cb6698904d" (UID: "9accd5e1-016f-4b12-ad0e-93cb6698904d"). InnerVolumeSpecName "kube-api-access-g8q5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:37:41.053342 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.053314    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8q5c\" (UniqueName: \"kubernetes.io/projected/9accd5e1-016f-4b12-ad0e-93cb6698904d-kube-api-access-g8q5c\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:37:41.053342 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.053335    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b80d695f-1ebd-4926-a301-628b52d861c0-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:37:41.053470 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.053349    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh25l\" (UniqueName: \"kubernetes.io/projected/b80d695f-1ebd-4926-a301-628b52d861c0-kube-api-access-kh25l\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:37:41.427880 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.427845    2559 generic.go:356] "Generic (PLEG): container finished" podID="9accd5e1-016f-4b12-ad0e-93cb6698904d" containerID="01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe" exitCode=0
Sep 16 12:37:41.428072 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.427900    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"
Sep 16 12:37:41.428072 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.427931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw" event={"ID":"9accd5e1-016f-4b12-ad0e-93cb6698904d","Type":"ContainerDied","Data":"01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe"}
Sep 16 12:37:41.428072 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.428023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw" event={"ID":"9accd5e1-016f-4b12-ad0e-93cb6698904d","Type":"ContainerDied","Data":"869d6ddd497f4da5f2c5d4c8fa97c031955dbbba2fa4b88308e490fc146c619e"}
Sep 16 12:37:41.428072 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.428056    2559 scope.go:117] "RemoveContainer" containerID="01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe"
Sep 16 12:37:41.429391 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.429368    2559 generic.go:356] "Generic (PLEG): container finished" podID="b80d695f-1ebd-4926-a301-628b52d861c0" containerID="4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af" exitCode=0
Sep 16 12:37:41.429483 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.429428    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"
Sep 16 12:37:41.429483 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.429450    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx" event={"ID":"b80d695f-1ebd-4926-a301-628b52d861c0","Type":"ContainerDied","Data":"4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af"}
Sep 16 12:37:41.429574 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.429493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx" event={"ID":"b80d695f-1ebd-4926-a301-628b52d861c0","Type":"ContainerDied","Data":"8a449034d85ea6a986a56dd8e6e63f61ffd612a2fd0449f18c77ba19902a051f"}
Sep 16 12:37:41.438003 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.437987    2559 scope.go:117] "RemoveContainer" containerID="01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe"
Sep 16 12:37:41.438278 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:37:41.438261    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe\": container with ID starting with 01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe not found: ID does not exist" containerID="01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe"
Sep 16 12:37:41.438329 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.438287    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe"} err="failed to get container status \"01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe\": rpc error: code = NotFound desc = could not find container \"01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe\": container with ID starting with 01623194a817adc14fb18cfe7a4018ebba01a2312bb24b67c8efde76ea0c1ebe not found: ID does not exist"
Sep 16 12:37:41.438329 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.438303    2559 scope.go:117] "RemoveContainer" containerID="4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af"
Sep 16 12:37:41.445981 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.445965    2559 scope.go:117] "RemoveContainer" containerID="4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af"
Sep 16 12:37:41.446244 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:37:41.446224    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af\": container with ID starting with 4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af not found: ID does not exist" containerID="4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af"
Sep 16 12:37:41.446298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.446250    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af"} err="failed to get container status \"4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af\": rpc error: code = NotFound desc = could not find container \"4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af\": container with ID starting with 4ed087b60cb77986c7371f942b0930f7c766bbb1ff86950383346d20f10ba3af not found: ID does not exist"
Sep 16 12:37:41.452525 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.452499    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"]
Sep 16 12:37:41.457059 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.457040    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b0cae-8665c5565c-p6mxw"]
Sep 16 12:37:41.467305 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.467285    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"]
Sep 16 12:37:41.471237 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:41.471213    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b0cae-64d78cd4f4-jddrx"]
Sep 16 12:37:42.030265 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:42.030234    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9accd5e1-016f-4b12-ad0e-93cb6698904d" path="/var/lib/kubelet/pods/9accd5e1-016f-4b12-ad0e-93cb6698904d/volumes"
Sep 16 12:37:42.030618 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:37:42.030570    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b80d695f-1ebd-4926-a301-628b52d861c0" path="/var/lib/kubelet/pods/b80d695f-1ebd-4926-a301-628b52d861c0/volumes"
Sep 16 12:38:06.442651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.441206    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"]
Sep 16 12:38:06.442651 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.441729    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb" podUID="b5910d14-3dfa-40d6-a39c-66824dfebbe2" containerName="payload-processing" containerID="cri-o://cbff842241f38e2a2794ed988057765584daff12d8f7e6a0549fa5716621841a" gracePeriod=30
Sep 16 12:38:06.446622 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.446598    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"]
Sep 16 12:38:06.446930 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.446891    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm" podUID="9f10d44b-86dd-4abf-b1f9-3991c42bb5e2" containerName="payload-pre-processing" containerID="cri-o://b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699" gracePeriod=30
Sep 16 12:38:06.561505 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.561479    2559 generic.go:356] "Generic (PLEG): container finished" podID="b5910d14-3dfa-40d6-a39c-66824dfebbe2" containerID="cbff842241f38e2a2794ed988057765584daff12d8f7e6a0549fa5716621841a" exitCode=0
Sep 16 12:38:06.561708 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.561554    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb" event={"ID":"b5910d14-3dfa-40d6-a39c-66824dfebbe2","Type":"ContainerDied","Data":"cbff842241f38e2a2794ed988057765584daff12d8f7e6a0549fa5716621841a"}
Sep 16 12:38:06.739241 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.739215    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:38:06.742173 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.742153    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:38:06.863364 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.863332    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv4nn\" (UniqueName: \"kubernetes.io/projected/b5910d14-3dfa-40d6-a39c-66824dfebbe2-kube-api-access-kv4nn\") pod \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\" (UID: \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\") "
Sep 16 12:38:06.863513 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.863386    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-plugins-config-volume\") pod \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\" (UID: \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\") "
Sep 16 12:38:06.863581 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.863564    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqtms\" (UniqueName: \"kubernetes.io/projected/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-kube-api-access-hqtms\") pod \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\" (UID: \"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2\") "
Sep 16 12:38:06.863624 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.863607    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5910d14-3dfa-40d6-a39c-66824dfebbe2-plugins-config-volume\") pod \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\" (UID: \"b5910d14-3dfa-40d6-a39c-66824dfebbe2\") "
Sep 16 12:38:06.863788 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.863762    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f10d44b-86dd-4abf-b1f9-3991c42bb5e2" (UID: "9f10d44b-86dd-4abf-b1f9-3991c42bb5e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:38:06.864025 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.864003    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5910d14-3dfa-40d6-a39c-66824dfebbe2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5910d14-3dfa-40d6-a39c-66824dfebbe2" (UID: "b5910d14-3dfa-40d6-a39c-66824dfebbe2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:38:06.864093 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.864031    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:38:06.865520 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.865498    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-kube-api-access-hqtms" (OuterVolumeSpecName: "kube-api-access-hqtms") pod "9f10d44b-86dd-4abf-b1f9-3991c42bb5e2" (UID: "9f10d44b-86dd-4abf-b1f9-3991c42bb5e2"). InnerVolumeSpecName "kube-api-access-hqtms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:38:06.865572 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.865518    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5910d14-3dfa-40d6-a39c-66824dfebbe2-kube-api-access-kv4nn" (OuterVolumeSpecName: "kube-api-access-kv4nn") pod "b5910d14-3dfa-40d6-a39c-66824dfebbe2" (UID: "b5910d14-3dfa-40d6-a39c-66824dfebbe2"). InnerVolumeSpecName "kube-api-access-kv4nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:38:06.965488 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.965431    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv4nn\" (UniqueName: \"kubernetes.io/projected/b5910d14-3dfa-40d6-a39c-66824dfebbe2-kube-api-access-kv4nn\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:38:06.965488 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.965456    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqtms\" (UniqueName: \"kubernetes.io/projected/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2-kube-api-access-hqtms\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:38:06.965488 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:06.965466    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5910d14-3dfa-40d6-a39c-66824dfebbe2-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:38:07.568322 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.568288    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f10d44b-86dd-4abf-b1f9-3991c42bb5e2" containerID="b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699" exitCode=0
Sep 16 12:38:07.568762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.568332    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"
Sep 16 12:38:07.568762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.568382    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm" event={"ID":"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2","Type":"ContainerDied","Data":"b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699"}
Sep 16 12:38:07.568762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.568432    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm" event={"ID":"9f10d44b-86dd-4abf-b1f9-3991c42bb5e2","Type":"ContainerDied","Data":"62ec3c61fbab8615d680542d422af6d89081115279751d4301627a5f8422f109"}
Sep 16 12:38:07.568762 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.568462    2559 scope.go:117] "RemoveContainer" containerID="b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699"
Sep 16 12:38:07.569914 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.569895    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"
Sep 16 12:38:07.570001 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.569927    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb" event={"ID":"b5910d14-3dfa-40d6-a39c-66824dfebbe2","Type":"ContainerDied","Data":"426199841c84610ff38c078344a6a57ac090c7388faa243af99a9b7c436dda16"}
Sep 16 12:38:07.578028 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.578003    2559 scope.go:117] "RemoveContainer" containerID="b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699"
Sep 16 12:38:07.578328 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:38:07.578303    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699\": container with ID starting with b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699 not found: ID does not exist" containerID="b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699"
Sep 16 12:38:07.578426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.578333    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699"} err="failed to get container status \"b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699\": rpc error: code = NotFound desc = could not find container \"b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699\": container with ID starting with b9a1449bd6bd38d69d54bc0f73c9de137550491c35325d646bc7c7b9d640c699 not found: ID does not exist"
Sep 16 12:38:07.578426 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.578350    2559 scope.go:117] "RemoveContainer" containerID="cbff842241f38e2a2794ed988057765584daff12d8f7e6a0549fa5716621841a"
Sep 16 12:38:07.591971 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.591952    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"]
Sep 16 12:38:07.597325 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.597306    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3ba9e7-fc8cddcd-lvbpm"]
Sep 16 12:38:07.607456 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.607433    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"]
Sep 16 12:38:07.611548 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:07.611527    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3ba9e7-55b97856f5-dt8cb"]
Sep 16 12:38:08.030836 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:08.030798    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f10d44b-86dd-4abf-b1f9-3991c42bb5e2" path="/var/lib/kubelet/pods/9f10d44b-86dd-4abf-b1f9-3991c42bb5e2/volumes"
Sep 16 12:38:08.031257 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:08.031234    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5910d14-3dfa-40d6-a39c-66824dfebbe2" path="/var/lib/kubelet/pods/b5910d14-3dfa-40d6-a39c-66824dfebbe2/volumes"
Sep 16 12:38:44.324868 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:44.324835    2559 scope.go:117] "RemoveContainer" containerID="9f63d3aea1d2103acfa4b41a49f8422e37775c779a54451e0724084f70eca1e4"
Sep 16 12:38:44.332758 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:38:44.332737    2559 scope.go:117] "RemoveContainer" containerID="39fe704be4b341afd8571b72f7a959da42126d31f6c8a07eb2cd5d0fbc3f9872"
Sep 16 12:39:05.851041 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:05.851003    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"]
Sep 16 12:39:05.851523 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:05.851243    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9" podUID="9e6490f1-1591-428d-93f3-78811337c58f" containerName="payload-processing" containerID="cri-o://a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26" gracePeriod=30
Sep 16 12:39:05.856115 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:05.856085    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"]
Sep 16 12:39:05.856326 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:05.856301    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m" podUID="374eb338-7b23-4dab-a905-9afc4adf6283" containerName="payload-pre-processing" containerID="cri-o://8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e" gracePeriod=30
Sep 16 12:39:06.137798 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.137778    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:39:06.140419 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.140398    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:39:06.232872 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.232827    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e6490f1-1591-428d-93f3-78811337c58f-plugins-config-volume\") pod \"9e6490f1-1591-428d-93f3-78811337c58f\" (UID: \"9e6490f1-1591-428d-93f3-78811337c58f\") "
Sep 16 12:39:06.233037 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.232917    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t66ld\" (UniqueName: \"kubernetes.io/projected/374eb338-7b23-4dab-a905-9afc4adf6283-kube-api-access-t66ld\") pod \"374eb338-7b23-4dab-a905-9afc4adf6283\" (UID: \"374eb338-7b23-4dab-a905-9afc4adf6283\") "
Sep 16 12:39:06.233037 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.232993    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/374eb338-7b23-4dab-a905-9afc4adf6283-plugins-config-volume\") pod \"374eb338-7b23-4dab-a905-9afc4adf6283\" (UID: \"374eb338-7b23-4dab-a905-9afc4adf6283\") "
Sep 16 12:39:06.233160 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.233042    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwsql\" (UniqueName: \"kubernetes.io/projected/9e6490f1-1591-428d-93f3-78811337c58f-kube-api-access-jwsql\") pod \"9e6490f1-1591-428d-93f3-78811337c58f\" (UID: \"9e6490f1-1591-428d-93f3-78811337c58f\") "
Sep 16 12:39:06.233354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.233325    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e6490f1-1591-428d-93f3-78811337c58f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9e6490f1-1591-428d-93f3-78811337c58f" (UID: "9e6490f1-1591-428d-93f3-78811337c58f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:06.233421 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.233376    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/374eb338-7b23-4dab-a905-9afc4adf6283-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "374eb338-7b23-4dab-a905-9afc4adf6283" (UID: "374eb338-7b23-4dab-a905-9afc4adf6283"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:06.235119 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.235094    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/374eb338-7b23-4dab-a905-9afc4adf6283-kube-api-access-t66ld" (OuterVolumeSpecName: "kube-api-access-t66ld") pod "374eb338-7b23-4dab-a905-9afc4adf6283" (UID: "374eb338-7b23-4dab-a905-9afc4adf6283"). InnerVolumeSpecName "kube-api-access-t66ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:06.235197 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.235138    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e6490f1-1591-428d-93f3-78811337c58f-kube-api-access-jwsql" (OuterVolumeSpecName: "kube-api-access-jwsql") pod "9e6490f1-1591-428d-93f3-78811337c58f" (UID: "9e6490f1-1591-428d-93f3-78811337c58f"). InnerVolumeSpecName "kube-api-access-jwsql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:06.333938 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.333901    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwsql\" (UniqueName: \"kubernetes.io/projected/9e6490f1-1591-428d-93f3-78811337c58f-kube-api-access-jwsql\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:06.333938 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.333934    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e6490f1-1591-428d-93f3-78811337c58f-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:06.333938 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.333943    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t66ld\" (UniqueName: \"kubernetes.io/projected/374eb338-7b23-4dab-a905-9afc4adf6283-kube-api-access-t66ld\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:06.333938 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.333952    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/374eb338-7b23-4dab-a905-9afc4adf6283-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:06.877444 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.877408    2559 generic.go:356] "Generic (PLEG): container finished" podID="374eb338-7b23-4dab-a905-9afc4adf6283" containerID="8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e" exitCode=0
Sep 16 12:39:06.877896 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.877452    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"
Sep 16 12:39:06.877896 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.877495    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m" event={"ID":"374eb338-7b23-4dab-a905-9afc4adf6283","Type":"ContainerDied","Data":"8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e"}
Sep 16 12:39:06.877896 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.877552    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m" event={"ID":"374eb338-7b23-4dab-a905-9afc4adf6283","Type":"ContainerDied","Data":"a4c293683fd03644b3f60ec8bf2c0b33ef85e14e8bdfcfa81728781f8a7a0a07"}
Sep 16 12:39:06.877896 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.877579    2559 scope.go:117] "RemoveContainer" containerID="8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e"
Sep 16 12:39:06.879044 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.879024    2559 generic.go:356] "Generic (PLEG): container finished" podID="9e6490f1-1591-428d-93f3-78811337c58f" containerID="a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26" exitCode=0
Sep 16 12:39:06.879099 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.879053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9" event={"ID":"9e6490f1-1591-428d-93f3-78811337c58f","Type":"ContainerDied","Data":"a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26"}
Sep 16 12:39:06.879099 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.879068    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"
Sep 16 12:39:06.879175 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.879102    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9" event={"ID":"9e6490f1-1591-428d-93f3-78811337c58f","Type":"ContainerDied","Data":"8eb02cf6aff7912e7676a36835d7f4ae6c3183602ebfbbc2b4568291b8672b04"}
Sep 16 12:39:06.887811 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.887564    2559 scope.go:117] "RemoveContainer" containerID="8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e"
Sep 16 12:39:06.887918 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:39:06.887897    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e\": container with ID starting with 8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e not found: ID does not exist" containerID="8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e"
Sep 16 12:39:06.887967 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.887927    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e"} err="failed to get container status \"8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e\": rpc error: code = NotFound desc = could not find container \"8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e\": container with ID starting with 8751f44d040fa90497c43f11510153592ec5f68585fd321134373625c4a4f48e not found: ID does not exist"
Sep 16 12:39:06.887967 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.887942    2559 scope.go:117] "RemoveContainer" containerID="a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26"
Sep 16 12:39:06.895786 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.895768    2559 scope.go:117] "RemoveContainer" containerID="a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26"
Sep 16 12:39:06.896052 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:39:06.896034    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26\": container with ID starting with a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26 not found: ID does not exist" containerID="a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26"
Sep 16 12:39:06.896115 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.896057    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26"} err="failed to get container status \"a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26\": rpc error: code = NotFound desc = could not find container \"a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26\": container with ID starting with a54cd39b2962210bd4a6106f6ef32fbf84cfde55c68539225ec9a07c801e3a26 not found: ID does not exist"
Sep 16 12:39:06.905096 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.905075    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"]
Sep 16 12:39:06.908709 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.908676    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-43ef83-644d8bff54-zz46m"]
Sep 16 12:39:06.919088 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.919066    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"]
Sep 16 12:39:06.922860 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:06.922839    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-43ef83-7df64c9b5-m94n9"]
Sep 16 12:39:08.034328 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:08.034292    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="374eb338-7b23-4dab-a905-9afc4adf6283" path="/var/lib/kubelet/pods/374eb338-7b23-4dab-a905-9afc4adf6283/volumes"
Sep 16 12:39:08.034705 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:08.034653    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e6490f1-1591-428d-93f3-78811337c58f" path="/var/lib/kubelet/pods/9e6490f1-1591-428d-93f3-78811337c58f/volumes"
Sep 16 12:39:23.543688 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.543654    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"]
Sep 16 12:39:23.544200 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.543936    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z" podUID="392537c3-e3bc-4b48-b097-9251d34ee2aa" containerName="payload-processing" containerID="cri-o://c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3" gracePeriod=30
Sep 16 12:39:23.550573 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.550548    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"]
Sep 16 12:39:23.551111 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.551081    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7" podUID="e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f" containerName="payload-pre-processing" containerID="cri-o://ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108" gracePeriod=30
Sep 16 12:39:23.827392 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.827369    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:39:23.830245 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.830225    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:39:23.871747 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.871714    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ph85\" (UniqueName: \"kubernetes.io/projected/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-kube-api-access-7ph85\") pod \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\" (UID: \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\") "
Sep 16 12:39:23.871986 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.871814    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtpgs\" (UniqueName: \"kubernetes.io/projected/392537c3-e3bc-4b48-b097-9251d34ee2aa-kube-api-access-wtpgs\") pod \"392537c3-e3bc-4b48-b097-9251d34ee2aa\" (UID: \"392537c3-e3bc-4b48-b097-9251d34ee2aa\") "
Sep 16 12:39:23.871986 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.871868    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-plugins-config-volume\") pod \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\" (UID: \"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f\") "
Sep 16 12:39:23.871986 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.871920    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/392537c3-e3bc-4b48-b097-9251d34ee2aa-plugins-config-volume\") pod \"392537c3-e3bc-4b48-b097-9251d34ee2aa\" (UID: \"392537c3-e3bc-4b48-b097-9251d34ee2aa\") "
Sep 16 12:39:23.872621 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.872571    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/392537c3-e3bc-4b48-b097-9251d34ee2aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "392537c3-e3bc-4b48-b097-9251d34ee2aa" (UID: "392537c3-e3bc-4b48-b097-9251d34ee2aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:23.872763 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.872649    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f" (UID: "e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:23.875090 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.874975    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-kube-api-access-7ph85" (OuterVolumeSpecName: "kube-api-access-7ph85") pod "e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f" (UID: "e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f"). InnerVolumeSpecName "kube-api-access-7ph85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:23.875090 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.875047    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/392537c3-e3bc-4b48-b097-9251d34ee2aa-kube-api-access-wtpgs" (OuterVolumeSpecName: "kube-api-access-wtpgs") pod "392537c3-e3bc-4b48-b097-9251d34ee2aa" (UID: "392537c3-e3bc-4b48-b097-9251d34ee2aa"). InnerVolumeSpecName "kube-api-access-wtpgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:23.968501 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.968470    2559 generic.go:356] "Generic (PLEG): container finished" podID="392537c3-e3bc-4b48-b097-9251d34ee2aa" containerID="c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3" exitCode=0
Sep 16 12:39:23.968636 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.968515    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"
Sep 16 12:39:23.968636 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.968558    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z" event={"ID":"392537c3-e3bc-4b48-b097-9251d34ee2aa","Type":"ContainerDied","Data":"c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3"}
Sep 16 12:39:23.968636 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.968613    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z" event={"ID":"392537c3-e3bc-4b48-b097-9251d34ee2aa","Type":"ContainerDied","Data":"4e2986c2ef9ccb082e66ccefe08a4ac9847ae65e84bc5b958e6e1a2b4abec303"}
Sep 16 12:39:23.968636 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.968636    2559 scope.go:117] "RemoveContainer" containerID="c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3"
Sep 16 12:39:23.969900 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.969876    2559 generic.go:356] "Generic (PLEG): container finished" podID="e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f" containerID="ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108" exitCode=0
Sep 16 12:39:23.970017 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.969913    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"
Sep 16 12:39:23.970017 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.969931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7" event={"ID":"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f","Type":"ContainerDied","Data":"ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108"}
Sep 16 12:39:23.970017 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.969973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7" event={"ID":"e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f","Type":"ContainerDied","Data":"773adf050146b2f94cd9b321674964af98028df656e6d237c394464492a575f8"}
Sep 16 12:39:23.972817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.972797    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ph85\" (UniqueName: \"kubernetes.io/projected/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-kube-api-access-7ph85\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:23.972915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.972820    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtpgs\" (UniqueName: \"kubernetes.io/projected/392537c3-e3bc-4b48-b097-9251d34ee2aa-kube-api-access-wtpgs\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:23.972915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.972833    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:23.972915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.972846    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/392537c3-e3bc-4b48-b097-9251d34ee2aa-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:23.978928 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.978913    2559 scope.go:117] "RemoveContainer" containerID="c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3"
Sep 16 12:39:23.979226 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:39:23.979207    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3\": container with ID starting with c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3 not found: ID does not exist" containerID="c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3"
Sep 16 12:39:23.979284 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.979235    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3"} err="failed to get container status \"c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3\": rpc error: code = NotFound desc = could not find container \"c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3\": container with ID starting with c6ab3546bd7c8e2a9ae9c1f0a755ff03099b988b8bf7b8a9ea8bb586af8a5aa3 not found: ID does not exist"
Sep 16 12:39:23.979284 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.979252    2559 scope.go:117] "RemoveContainer" containerID="ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108"
Sep 16 12:39:23.987041 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.987024    2559 scope.go:117] "RemoveContainer" containerID="ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108"
Sep 16 12:39:23.987272 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:39:23.987255    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108\": container with ID starting with ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108 not found: ID does not exist" containerID="ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108"
Sep 16 12:39:23.987322 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.987277    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108"} err="failed to get container status \"ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108\": rpc error: code = NotFound desc = could not find container \"ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108\": container with ID starting with ec9527a11a2ad033191d913397fdd6b4fb7d196b49a1a9f82bce31160e540108 not found: ID does not exist"
Sep 16 12:39:23.992875 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.992852    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"]
Sep 16 12:39:23.999373 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:23.999353    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-72eee5-dcd99494f-jvn7z"]
Sep 16 12:39:24.009679 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:24.009659    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"]
Sep 16 12:39:24.013470 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:24.013450    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-72eee5-5c7c49f4bb-z9lj7"]
Sep 16 12:39:24.029480 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:24.029461    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="392537c3-e3bc-4b48-b097-9251d34ee2aa" path="/var/lib/kubelet/pods/392537c3-e3bc-4b48-b097-9251d34ee2aa/volumes"
Sep 16 12:39:24.029840 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:24.029827    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f" path="/var/lib/kubelet/pods/e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f/volumes"
Sep 16 12:39:30.687338 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687301    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"]
Sep 16 12:39:30.687724 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687710    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9accd5e1-016f-4b12-ad0e-93cb6698904d" containerName="payload-processing"
Sep 16 12:39:30.687724 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687723    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9accd5e1-016f-4b12-ad0e-93cb6698904d" containerName="payload-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687736    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392537c3-e3bc-4b48-b097-9251d34ee2aa" containerName="payload-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687742    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="392537c3-e3bc-4b48-b097-9251d34ee2aa" containerName="payload-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687750    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5910d14-3dfa-40d6-a39c-66824dfebbe2" containerName="payload-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687756    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5910d14-3dfa-40d6-a39c-66824dfebbe2" containerName="payload-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687770    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e6490f1-1591-428d-93f3-78811337c58f" containerName="payload-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687776    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e6490f1-1591-428d-93f3-78811337c58f" containerName="payload-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687784    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80d695f-1ebd-4926-a301-628b52d861c0" containerName="payload-pre-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687789    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80d695f-1ebd-4926-a301-628b52d861c0" containerName="payload-pre-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687800    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374eb338-7b23-4dab-a905-9afc4adf6283" containerName="payload-pre-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687806    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="374eb338-7b23-4dab-a905-9afc4adf6283" containerName="payload-pre-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687815    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f10d44b-86dd-4abf-b1f9-3991c42bb5e2" containerName="payload-pre-processing"
Sep 16 12:39:30.687817 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687821    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f10d44b-86dd-4abf-b1f9-3991c42bb5e2" containerName="payload-pre-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687829    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f" containerName="payload-pre-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687835    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f" containerName="payload-pre-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687890    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5910d14-3dfa-40d6-a39c-66824dfebbe2" containerName="payload-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687898    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="374eb338-7b23-4dab-a905-9afc4adf6283" containerName="payload-pre-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687906    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="392537c3-e3bc-4b48-b097-9251d34ee2aa" containerName="payload-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687913    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9accd5e1-016f-4b12-ad0e-93cb6698904d" containerName="payload-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687919    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e6490f1-1591-428d-93f3-78811337c58f" containerName="payload-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687925    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80d695f-1ebd-4926-a301-628b52d861c0" containerName="payload-pre-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687930    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1dd122d-4cb3-4e56-bea5-1b6275d4ec2f" containerName="payload-pre-processing"
Sep 16 12:39:30.688176 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.687936    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f10d44b-86dd-4abf-b1f9-3991c42bb5e2" containerName="payload-pre-processing"
Sep 16 12:39:30.692526 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.692506    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"
Sep 16 12:39:30.695829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.695807    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 12:39:30.695829 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.695818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:39:30.700343 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.699845    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"]
Sep 16 12:39:30.723629 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.723607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2855311-8b0e-46a8-89a2-74b985b8d8d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp\" (UID: \"d2855311-8b0e-46a8-89a2-74b985b8d8d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"
Sep 16 12:39:30.824043 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.824022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2855311-8b0e-46a8-89a2-74b985b8d8d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp\" (UID: \"d2855311-8b0e-46a8-89a2-74b985b8d8d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"
Sep 16 12:39:30.824589 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:30.824569    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2855311-8b0e-46a8-89a2-74b985b8d8d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp\" (UID: \"d2855311-8b0e-46a8-89a2-74b985b8d8d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"
Sep 16 12:39:31.004715 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:31.004627    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"
Sep 16 12:39:31.276676 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:31.276473    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"]
Sep 16 12:39:31.279242 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:39:31.279218    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2855311_8b0e_46a8_89a2_74b985b8d8d6.slice/crio-523ab2b2360ca6f61d8db1b8997eecfd5f187a2bb18798f3a3760cea866f16c3 WatchSource:0}: Error finding container 523ab2b2360ca6f61d8db1b8997eecfd5f187a2bb18798f3a3760cea866f16c3: Status 404 returned error can't find the container with id 523ab2b2360ca6f61d8db1b8997eecfd5f187a2bb18798f3a3760cea866f16c3
Sep 16 12:39:32.012571 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:32.012544    2559 generic.go:356] "Generic (PLEG): container finished" podID="d2855311-8b0e-46a8-89a2-74b985b8d8d6" containerID="e11cc3667d5d2e2213716e2378e0f70bb48cdd3949ed3c1f912cfa8b13f4dea7" exitCode=0
Sep 16 12:39:32.012888 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:32.012629    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp" event={"ID":"d2855311-8b0e-46a8-89a2-74b985b8d8d6","Type":"ContainerDied","Data":"e11cc3667d5d2e2213716e2378e0f70bb48cdd3949ed3c1f912cfa8b13f4dea7"}
Sep 16 12:39:32.012888 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:32.012731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp" event={"ID":"d2855311-8b0e-46a8-89a2-74b985b8d8d6","Type":"ContainerStarted","Data":"523ab2b2360ca6f61d8db1b8997eecfd5f187a2bb18798f3a3760cea866f16c3"}
Sep 16 12:39:33.152158 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:33.152125    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"
Sep 16 12:39:33.244034 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:33.244009    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2855311-8b0e-46a8-89a2-74b985b8d8d6-maas-api-service-ca\") pod \"d2855311-8b0e-46a8-89a2-74b985b8d8d6\" (UID: \"d2855311-8b0e-46a8-89a2-74b985b8d8d6\") "
Sep 16 12:39:33.244351 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:33.244329    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2855311-8b0e-46a8-89a2-74b985b8d8d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d2855311-8b0e-46a8-89a2-74b985b8d8d6" (UID: "d2855311-8b0e-46a8-89a2-74b985b8d8d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:33.345460 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:33.345407    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2855311-8b0e-46a8-89a2-74b985b8d8d6-maas-api-service-ca\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:34.026123 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:34.026095    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"
Sep 16 12:39:34.030052 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:34.030023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp" event={"ID":"d2855311-8b0e-46a8-89a2-74b985b8d8d6","Type":"ContainerDied","Data":"523ab2b2360ca6f61d8db1b8997eecfd5f187a2bb18798f3a3760cea866f16c3"}
Sep 16 12:39:34.030191 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:34.030064    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="523ab2b2360ca6f61d8db1b8997eecfd5f187a2bb18798f3a3760cea866f16c3"
Sep 16 12:39:41.203305 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.203211    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd"]
Sep 16 12:39:41.210410 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.210375    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-3be0c5-29826030-q6mqd"]
Sep 16 12:39:41.239974 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.239938    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"]
Sep 16 12:39:41.240217 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.240188    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k" podUID="209d2bdc-d6a9-486e-8d12-18c6feb5f2dd" containerName="payload-processing" containerID="cri-o://9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18" gracePeriod=30
Sep 16 12:39:41.254308 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.254281    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"]
Sep 16 12:39:41.254784 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.254727    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6" podUID="f9d1ede0-89f6-4b6a-9e83-c0a08c090130" containerName="payload-pre-processing" containerID="cri-o://29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e" gracePeriod=30
Sep 16 12:39:41.414476 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.414441    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"]
Sep 16 12:39:41.416931 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.416894    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3be0c5-wxzlp"]
Sep 16 12:39:41.499012 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.498988    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:39:41.522983 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.522900    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:39:41.613171 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.613140    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-plugins-config-volume\") pod \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\" (UID: \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\") "
Sep 16 12:39:41.613354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.613191    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9cvm\" (UniqueName: \"kubernetes.io/projected/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-kube-api-access-v9cvm\") pod \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\" (UID: \"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd\") "
Sep 16 12:39:41.613354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.613222    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-plugins-config-volume\") pod \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\" (UID: \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\") "
Sep 16 12:39:41.613354 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.613267    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74z5c\" (UniqueName: \"kubernetes.io/projected/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-kube-api-access-74z5c\") pod \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\" (UID: \"f9d1ede0-89f6-4b6a-9e83-c0a08c090130\") "
Sep 16 12:39:41.613596 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.613570    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "209d2bdc-d6a9-486e-8d12-18c6feb5f2dd" (UID: "209d2bdc-d6a9-486e-8d12-18c6feb5f2dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:41.613655 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.613580    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9d1ede0-89f6-4b6a-9e83-c0a08c090130" (UID: "f9d1ede0-89f6-4b6a-9e83-c0a08c090130"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:39:41.615220 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.615199    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-kube-api-access-v9cvm" (OuterVolumeSpecName: "kube-api-access-v9cvm") pod "209d2bdc-d6a9-486e-8d12-18c6feb5f2dd" (UID: "209d2bdc-d6a9-486e-8d12-18c6feb5f2dd"). InnerVolumeSpecName "kube-api-access-v9cvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:41.615276 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.615242    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-kube-api-access-74z5c" (OuterVolumeSpecName: "kube-api-access-74z5c") pod "f9d1ede0-89f6-4b6a-9e83-c0a08c090130" (UID: "f9d1ede0-89f6-4b6a-9e83-c0a08c090130"). InnerVolumeSpecName "kube-api-access-74z5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:39:41.713997 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.713934    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:41.713997 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.713956    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9cvm\" (UniqueName: \"kubernetes.io/projected/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd-kube-api-access-v9cvm\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:41.713997 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.713966    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-plugins-config-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:41.713997 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:41.713974    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74z5c\" (UniqueName: \"kubernetes.io/projected/f9d1ede0-89f6-4b6a-9e83-c0a08c090130-kube-api-access-74z5c\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:39:42.036477 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.031466    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05f4c923-ef07-48e2-8b98-b27674d9c3a9" path="/var/lib/kubelet/pods/05f4c923-ef07-48e2-8b98-b27674d9c3a9/volumes"
Sep 16 12:39:42.036477 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.031979    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2855311-8b0e-46a8-89a2-74b985b8d8d6" path="/var/lib/kubelet/pods/d2855311-8b0e-46a8-89a2-74b985b8d8d6/volumes"
Sep 16 12:39:42.060717 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.060670    2559 generic.go:356] "Generic (PLEG): container finished" podID="209d2bdc-d6a9-486e-8d12-18c6feb5f2dd" containerID="9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18" exitCode=0
Sep 16 12:39:42.060847 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.060757    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"
Sep 16 12:39:42.060913 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.060752    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k" event={"ID":"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd","Type":"ContainerDied","Data":"9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18"}
Sep 16 12:39:42.060982 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.060907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k" event={"ID":"209d2bdc-d6a9-486e-8d12-18c6feb5f2dd","Type":"ContainerDied","Data":"7fec578ae8a83d6cd5d0556ec985e0c48a3b258e52c4c4b04aa0be30cfcbea83"}
Sep 16 12:39:42.060982 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.060941    2559 scope.go:117] "RemoveContainer" containerID="9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18"
Sep 16 12:39:42.062150 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.062132    2559 generic.go:356] "Generic (PLEG): container finished" podID="f9d1ede0-89f6-4b6a-9e83-c0a08c090130" containerID="29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e" exitCode=0
Sep 16 12:39:42.062215 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.062196    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"
Sep 16 12:39:42.062215 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.062206    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6" event={"ID":"f9d1ede0-89f6-4b6a-9e83-c0a08c090130","Type":"ContainerDied","Data":"29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e"}
Sep 16 12:39:42.062298 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.062237    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6" event={"ID":"f9d1ede0-89f6-4b6a-9e83-c0a08c090130","Type":"ContainerDied","Data":"c3852c487e70f574976b170c42496ad61b96dcd8248221862b6cf4f14e93d91b"}
Sep 16 12:39:42.072030 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.071982    2559 scope.go:117] "RemoveContainer" containerID="9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18"
Sep 16 12:39:42.072460 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:39:42.072427    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18\": container with ID starting with 9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18 not found: ID does not exist" containerID="9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18"
Sep 16 12:39:42.072538 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.072470    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18"} err="failed to get container status \"9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18\": rpc error: code = NotFound desc = could not find container \"9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18\": container with ID starting with 9fa859a280126aacd24e8be6bfb1386d1c18bdd157378d9c99350c514f0fcf18 not found: ID does not exist"
Sep 16 12:39:42.072538 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.072494    2559 scope.go:117] "RemoveContainer" containerID="29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e"
Sep 16 12:39:42.080125 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.080108    2559 scope.go:117] "RemoveContainer" containerID="29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e"
Sep 16 12:39:42.080348 ip-10-0-134-254 kubenswrapper[2559]: E0916 12:39:42.080330    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e\": container with ID starting with 29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e not found: ID does not exist" containerID="29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e"
Sep 16 12:39:42.080409 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.080361    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e"} err="failed to get container status \"29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e\": rpc error: code = NotFound desc = could not find container \"29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e\": container with ID starting with 29c39d46f82b58ffd1ac58941bc308629898bf86b086ad3801d2b00eb4eae08e not found: ID does not exist"
Sep 16 12:39:42.121930 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.121907    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"]
Sep 16 12:39:42.137334 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.137316    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3be0c5-67b8d58454-tn4m6"]
Sep 16 12:39:42.158130 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.158107    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"]
Sep 16 12:39:42.161757 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:42.161731    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3be0c5-5bf9bf969-jr22k"]
Sep 16 12:39:44.031114 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:44.031074    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="209d2bdc-d6a9-486e-8d12-18c6feb5f2dd" path="/var/lib/kubelet/pods/209d2bdc-d6a9-486e-8d12-18c6feb5f2dd/volumes"
Sep 16 12:39:44.031639 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:44.031617    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9d1ede0-89f6-4b6a-9e83-c0a08c090130" path="/var/lib/kubelet/pods/f9d1ede0-89f6-4b6a-9e83-c0a08c090130/volumes"
Sep 16 12:39:44.361258 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:39:44.361192    2559 scope.go:117] "RemoveContainer" containerID="8e949be5e695708f046da62062bc1241ba9e716be871ad5bd6e326fe7a8d7f26"
Sep 16 12:42:39.766264 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:39.766187    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"]
Sep 16 12:42:39.766770 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:39.766375    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7" podUID="d1a47b05-bed1-4db9-a36c-9c1dcbc145e8" containerName="manager" containerID="cri-o://9ccf812aae52259c4d29086d156b4f54339034bb6c0fd269c3c2083a64d37b4f" gracePeriod=10
Sep 16 12:42:39.896133 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:39.896093    2559 generic.go:356] "Generic (PLEG): container finished" podID="d1a47b05-bed1-4db9-a36c-9c1dcbc145e8" containerID="9ccf812aae52259c4d29086d156b4f54339034bb6c0fd269c3c2083a64d37b4f" exitCode=0
Sep 16 12:42:39.896237 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:39.896160    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7" event={"ID":"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8","Type":"ContainerDied","Data":"9ccf812aae52259c4d29086d156b4f54339034bb6c0fd269c3c2083a64d37b4f"}
Sep 16 12:42:40.016075 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.016050    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:42:40.159346 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.159309    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-extensions-socket-volume\") pod \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\" (UID: \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\") "
Sep 16 12:42:40.159526 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.159401    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfmvq\" (UniqueName: \"kubernetes.io/projected/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-kube-api-access-rfmvq\") pod \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\" (UID: \"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8\") "
Sep 16 12:42:40.159744 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.159720    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d1a47b05-bed1-4db9-a36c-9c1dcbc145e8" (UID: "d1a47b05-bed1-4db9-a36c-9c1dcbc145e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:42:40.161225 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.161203    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-kube-api-access-rfmvq" (OuterVolumeSpecName: "kube-api-access-rfmvq") pod "d1a47b05-bed1-4db9-a36c-9c1dcbc145e8" (UID: "d1a47b05-bed1-4db9-a36c-9c1dcbc145e8"). InnerVolumeSpecName "kube-api-access-rfmvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:42:40.260357 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.260325    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-extensions-socket-volume\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:42:40.260357 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.260353    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfmvq\" (UniqueName: \"kubernetes.io/projected/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8-kube-api-access-rfmvq\") on node \"ip-10-0-134-254.ec2.internal\" DevicePath \"\""
Sep 16 12:42:40.902504 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.902477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7" event={"ID":"d1a47b05-bed1-4db9-a36c-9c1dcbc145e8","Type":"ContainerDied","Data":"70d2bd23346745e7737e310954473cbdeab7d8e728664354deb4411a08f5fd9a"}
Sep 16 12:42:40.902504 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.902494    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"
Sep 16 12:42:40.902910 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.902529    2559 scope.go:117] "RemoveContainer" containerID="9ccf812aae52259c4d29086d156b4f54339034bb6c0fd269c3c2083a64d37b4f"
Sep 16 12:42:40.940600 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.940576    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"]
Sep 16 12:42:40.944675 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:40.944653    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-4xfn7"]
Sep 16 12:42:42.029328 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:42:42.029288    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1a47b05-bed1-4db9-a36c-9c1dcbc145e8" path="/var/lib/kubelet/pods/d1a47b05-bed1-4db9-a36c-9c1dcbc145e8/volumes"
Sep 16 12:43:40.466034 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466000    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"]
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466334    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d1ede0-89f6-4b6a-9e83-c0a08c090130" containerName="payload-pre-processing"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466346    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d1ede0-89f6-4b6a-9e83-c0a08c090130" containerName="payload-pre-processing"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466363    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="209d2bdc-d6a9-486e-8d12-18c6feb5f2dd" containerName="payload-processing"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466369    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="209d2bdc-d6a9-486e-8d12-18c6feb5f2dd" containerName="payload-processing"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466379    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2855311-8b0e-46a8-89a2-74b985b8d8d6" containerName="revoke-keys"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466384    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2855311-8b0e-46a8-89a2-74b985b8d8d6" containerName="revoke-keys"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466396    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1a47b05-bed1-4db9-a36c-9c1dcbc145e8" containerName="manager"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466402    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1a47b05-bed1-4db9-a36c-9c1dcbc145e8" containerName="manager"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466451    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9d1ede0-89f6-4b6a-9e83-c0a08c090130" containerName="payload-pre-processing"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466459    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1a47b05-bed1-4db9-a36c-9c1dcbc145e8" containerName="manager"
Sep 16 12:43:40.466463 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466466    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="209d2bdc-d6a9-486e-8d12-18c6feb5f2dd" containerName="payload-processing"
Sep 16 12:43:40.466900 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.466474    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2855311-8b0e-46a8-89a2-74b985b8d8d6" containerName="revoke-keys"
Sep 16 12:43:40.469408 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.469387    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:43:40.474322 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.474294    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mpnm2\""
Sep 16 12:43:40.474322 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.474316    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 12:43:40.474470 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.474326    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 12:43:40.485843 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.485821    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"]
Sep 16 12:43:40.612992 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.612971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7wkj\" (UniqueName: \"kubernetes.io/projected/9185085d-723d-4299-8d1d-02eaf073bfef-kube-api-access-t7wkj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb6cb\" (UID: \"9185085d-723d-4299-8d1d-02eaf073bfef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:43:40.613091 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.613006    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9185085d-723d-4299-8d1d-02eaf073bfef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb6cb\" (UID: \"9185085d-723d-4299-8d1d-02eaf073bfef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:43:40.713893 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.713868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wkj\" (UniqueName: \"kubernetes.io/projected/9185085d-723d-4299-8d1d-02eaf073bfef-kube-api-access-t7wkj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb6cb\" (UID: \"9185085d-723d-4299-8d1d-02eaf073bfef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:43:40.713977 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.713909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9185085d-723d-4299-8d1d-02eaf073bfef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb6cb\" (UID: \"9185085d-723d-4299-8d1d-02eaf073bfef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:43:40.714273 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.714257    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9185085d-723d-4299-8d1d-02eaf073bfef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb6cb\" (UID: \"9185085d-723d-4299-8d1d-02eaf073bfef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:43:40.723825 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.723773    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7wkj\" (UniqueName: \"kubernetes.io/projected/9185085d-723d-4299-8d1d-02eaf073bfef-kube-api-access-t7wkj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb6cb\" (UID: \"9185085d-723d-4299-8d1d-02eaf073bfef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:43:40.781741 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:40.781663    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:43:41.074924 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:41.074872    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"]
Sep 16 12:43:41.077409 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:43:41.077382    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9185085d_723d_4299_8d1d_02eaf073bfef.slice/crio-39b1910df301f06dd76ccc49e59212aadcc15f592d98391de89aff0858c56c79 WatchSource:0}: Error finding container 39b1910df301f06dd76ccc49e59212aadcc15f592d98391de89aff0858c56c79: Status 404 returned error can't find the container with id 39b1910df301f06dd76ccc49e59212aadcc15f592d98391de89aff0858c56c79
Sep 16 12:43:41.181560 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:41.181531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb" event={"ID":"9185085d-723d-4299-8d1d-02eaf073bfef","Type":"ContainerStarted","Data":"0037231abc1e5ee7afc1316698b10f58cdcde5ddd385e6457fbd5adf21327e2e"}
Sep 16 12:43:41.181691 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:41.181593    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb" event={"ID":"9185085d-723d-4299-8d1d-02eaf073bfef","Type":"ContainerStarted","Data":"39b1910df301f06dd76ccc49e59212aadcc15f592d98391de89aff0858c56c79"}
Sep 16 12:43:41.181691 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:41.181626    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:43:41.206799 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:41.206754    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb" podStartSLOduration=1.206738714 podStartE2EDuration="1.206738714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:43:41.20419377 +0000 UTC m=+2577.647228634" watchObservedRunningTime="2026-09-16 12:43:41.206738714 +0000 UTC m=+2577.649773577"
Sep 16 12:43:52.188708 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:43:52.188668    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb6cb"
Sep 16 12:45:00.140577 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:00.140545    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr"]
Sep 16 12:45:00.143744 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:00.143727    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr"
Sep 16 12:45:00.146421 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:00.146400    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hvtv7\""
Sep 16 12:45:00.149814 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:00.149790    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr"]
Sep 16 12:45:00.155498 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:00.155480    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr"
Sep 16 12:45:00.424788 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:00.424764    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr"]
Sep 16 12:45:00.427228 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:45:00.427201    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fdc731e_8e47_4a08_ad2f_d7454490f431.slice/crio-c1d6e12b9e80aa16585a5e346752dc4ff9886068812e734b74dcad69931d48f4 WatchSource:0}: Error finding container c1d6e12b9e80aa16585a5e346752dc4ff9886068812e734b74dcad69931d48f4: Status 404 returned error can't find the container with id c1d6e12b9e80aa16585a5e346752dc4ff9886068812e734b74dcad69931d48f4
Sep 16 12:45:00.559883 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:00.559856    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr" event={"ID":"3fdc731e-8e47-4a08-ad2f-d7454490f431","Type":"ContainerStarted","Data":"c1d6e12b9e80aa16585a5e346752dc4ff9886068812e734b74dcad69931d48f4"}
Sep 16 12:45:01.567517 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:01.567445    2559 generic.go:356] "Generic (PLEG): container finished" podID="3fdc731e-8e47-4a08-ad2f-d7454490f431" containerID="a0647d36adcb57e94671ab9ae5d6b299436a4a6fed40ab06572a3ac20ea0192f" exitCode=0
Sep 16 12:45:01.567517 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:01.567491    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr" event={"ID":"3fdc731e-8e47-4a08-ad2f-d7454490f431","Type":"ContainerDied","Data":"a0647d36adcb57e94671ab9ae5d6b299436a4a6fed40ab06572a3ac20ea0192f"}
Sep 16 12:45:02.706530 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:02.706504    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr"
Sep 16 12:45:03.585331 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:03.585305    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr"
Sep 16 12:45:03.585487 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:03.585332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826045-m9spr" event={"ID":"3fdc731e-8e47-4a08-ad2f-d7454490f431","Type":"ContainerDied","Data":"c1d6e12b9e80aa16585a5e346752dc4ff9886068812e734b74dcad69931d48f4"}
Sep 16 12:45:03.585487 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:03.585374    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1d6e12b9e80aa16585a5e346752dc4ff9886068812e734b74dcad69931d48f4"
Sep 16 12:45:44.453181 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:45:44.453100    2559 scope.go:117] "RemoveContainer" containerID="e11cc3667d5d2e2213716e2378e0f70bb48cdd3949ed3c1f912cfa8b13f4dea7"
Sep 16 12:46:02.157148 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:02.157114    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rn7nl_b58696b7-dacb-4593-af41-21fe936eefbf/manager/0.log"
Sep 16 12:46:02.274660 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:02.274628    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cmznm_ce1b1b76-2e26-4047-87e9-30086a1d8c92/manager/0.log"
Sep 16 12:46:02.507443 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:02.507361    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gkqsz_90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a/server/0.log"
Sep 16 12:46:02.632505 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:02.632482    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dx4cg_aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5/manager/0.log"
Sep 16 12:46:02.869249 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:02.869186    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7887d7f7b8-7cr4f_68556de2-054e-4109-8506-59efb95b2a39/copy-manifests/0.log"
Sep 16 12:46:02.875940 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:02.875917    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7887d7f7b8-7cr4f_68556de2-054e-4109-8506-59efb95b2a39/manager/0.log"
Sep 16 12:46:03.684623 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:03.684588    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29826045-m9spr_3fdc731e-8e47-4a08-ad2f-d7454490f431/cleanup/0.log"
Sep 16 12:46:05.057074 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:05.057044    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fb6cb_9185085d-723d-4299-8d1d-02eaf073bfef/manager/0.log"
Sep 16 12:46:05.649746 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:05.649720    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5_223d930a-0800-461b-a3ba-3a4c2a828bcb/istio-proxy/0.log"
Sep 16 12:46:05.772873 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:05.772847    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-27zlr_7c22793d-308a-4fb9-93bc-ab604facde70/discovery/0.log"
Sep 16 12:46:06.017475 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:06.017397    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f6c77cbf-cxxmq_e4f65658-6be0-43dd-a1e1-1cdc902ad16b/kube-auth-proxy/0.log"
Sep 16 12:46:06.131838 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:06.131801    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rdjfk_29fb0007-a1a1-4f0c-85c3-14ef2b52072d/istio-proxy/1.log"
Sep 16 12:46:06.247062 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:06.247038    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-r7jp6_4e2fae9b-f7d0-4874-8ac9-5b196a86bd27/payload-pre-processing/0.log"
Sep 16 12:46:06.858401 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:06.858372    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bstfq_ae837cec-ad18-4112-9290-f3fd69865db1/main/0.log"
Sep 16 12:46:06.971394 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:06.971373    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-q6vpd_7d43e5ec-5425-4879-b391-a80471c83080/main/0.log"
Sep 16 12:46:07.430920 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:07.430900    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hgnpj_974f1426-a35e-474f-bd79-c526b1b8a925/main/0.log"
Sep 16 12:46:15.753646 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:15.753613    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7792l_02034161-8299-407b-a512-5484c2272a6c/global-pull-secret-syncer/0.log"
Sep 16 12:46:15.910961 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:15.910933    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t4rw6_4dc63791-1615-450f-8182-165405956a01/konnectivity-agent/0.log"
Sep 16 12:46:15.976780 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:15.976756    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-254.ec2.internal_d08afcddc68f55b21ba091d1f6f66b29/haproxy/0.log"
Sep 16 12:46:20.563978 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:20.563949    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fb6cb_9185085d-723d-4299-8d1d-02eaf073bfef/manager/0.log"
Sep 16 12:46:22.367723 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.367680    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0101191-8da3-48e6-9fde-fbbe04e97afd/alertmanager/0.log"
Sep 16 12:46:22.389482 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.389459    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0101191-8da3-48e6-9fde-fbbe04e97afd/config-reloader/0.log"
Sep 16 12:46:22.414551 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.414528    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0101191-8da3-48e6-9fde-fbbe04e97afd/kube-rbac-proxy-web/0.log"
Sep 16 12:46:22.442205 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.442182    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0101191-8da3-48e6-9fde-fbbe04e97afd/kube-rbac-proxy/0.log"
Sep 16 12:46:22.464196 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.464169    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0101191-8da3-48e6-9fde-fbbe04e97afd/kube-rbac-proxy-metric/0.log"
Sep 16 12:46:22.484978 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.484960    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0101191-8da3-48e6-9fde-fbbe04e97afd/prom-label-proxy/0.log"
Sep 16 12:46:22.508630 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.508613    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0101191-8da3-48e6-9fde-fbbe04e97afd/init-config-reloader/0.log"
Sep 16 12:46:22.782461 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.782441    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4qsw_03cd13fc-07da-4a64-be43-c63b884ec44c/node-exporter/0.log"
Sep 16 12:46:22.804281 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.804265    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4qsw_03cd13fc-07da-4a64-be43-c63b884ec44c/kube-rbac-proxy/0.log"
Sep 16 12:46:22.822915 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:22.822899    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4qsw_03cd13fc-07da-4a64-be43-c63b884ec44c/init-textfile/0.log"
Sep 16 12:46:23.313570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:23.313546    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d9559f744-crh2g_ef83a61d-d9f0-4497-9171-b63b3e64ccbd/telemeter-client/0.log"
Sep 16 12:46:23.337088 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:23.337068    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d9559f744-crh2g_ef83a61d-d9f0-4497-9171-b63b3e64ccbd/reload/0.log"
Sep 16 12:46:23.362744 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:23.362721    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d9559f744-crh2g_ef83a61d-d9f0-4497-9171-b63b3e64ccbd/kube-rbac-proxy/0.log"
Sep 16 12:46:23.398036 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:23.398018    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b56d4fb4b-r6rr9_71ec0486-e779-4c89-b2cf-c803c133b0a7/thanos-query/0.log"
Sep 16 12:46:23.421261 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:23.421242    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b56d4fb4b-r6rr9_71ec0486-e779-4c89-b2cf-c803c133b0a7/kube-rbac-proxy-web/0.log"
Sep 16 12:46:23.446339 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:23.446320    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b56d4fb4b-r6rr9_71ec0486-e779-4c89-b2cf-c803c133b0a7/kube-rbac-proxy/0.log"
Sep 16 12:46:23.473111 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:23.473093    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b56d4fb4b-r6rr9_71ec0486-e779-4c89-b2cf-c803c133b0a7/prom-label-proxy/0.log"
Sep 16 12:46:23.496998 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:23.496966    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b56d4fb4b-r6rr9_71ec0486-e779-4c89-b2cf-c803c133b0a7/kube-rbac-proxy-rules/0.log"
Sep 16 12:46:23.523716 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:23.523686    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b56d4fb4b-r6rr9_71ec0486-e779-4c89-b2cf-c803c133b0a7/kube-rbac-proxy-metrics/0.log"
Sep 16 12:46:26.356161 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.356121    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"]
Sep 16 12:46:26.356531 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.356486    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fdc731e-8e47-4a08-ad2f-d7454490f431" containerName="cleanup"
Sep 16 12:46:26.356531 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.356499    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fdc731e-8e47-4a08-ad2f-d7454490f431" containerName="cleanup"
Sep 16 12:46:26.356605 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.356567    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fdc731e-8e47-4a08-ad2f-d7454490f431" containerName="cleanup"
Sep 16 12:46:26.359636 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.359615    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.362144 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.362119    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mv6dr\"/\"default-dockercfg-ww4vd\""
Sep 16 12:46:26.363194 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.363178    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mv6dr\"/\"kube-root-ca.crt\""
Sep 16 12:46:26.363267 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.363211    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mv6dr\"/\"openshift-service-ca.crt\""
Sep 16 12:46:26.370626 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.370597    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"]
Sep 16 12:46:26.424189 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.424163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-sys\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.424286 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.424194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmtlm\" (UniqueName: \"kubernetes.io/projected/92235058-547d-4b73-8c8e-37744ff5e845-kube-api-access-rmtlm\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.424286 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.424212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-proc\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.424286 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.424246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-podres\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.424444 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.424307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-lib-modules\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.525245 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.525225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-lib-modules\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.525324 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.525264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-sys\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.525324 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.525287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmtlm\" (UniqueName: \"kubernetes.io/projected/92235058-547d-4b73-8c8e-37744ff5e845-kube-api-access-rmtlm\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.525324 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.525311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-proc\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.525446 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.525338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-sys\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.525446 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.525347    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-podres\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.525446 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.525386    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-lib-modules\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.525446 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.525409    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-proc\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.525574 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.525464    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92235058-547d-4b73-8c8e-37744ff5e845-podres\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.533814 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.533796    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmtlm\" (UniqueName: \"kubernetes.io/projected/92235058-547d-4b73-8c8e-37744ff5e845-kube-api-access-rmtlm\") pod \"perf-node-gather-daemonset-jfc2c\" (UID: \"92235058-547d-4b73-8c8e-37744ff5e845\") " pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.668957 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.668938    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:26.936615 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.936589    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"]
Sep 16 12:46:26.939301 ip-10-0-134-254 kubenswrapper[2559]: W0916 12:46:26.939277    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92235058_547d_4b73_8c8e_37744ff5e845.slice/crio-34eba134ba438d0839508eff4edf5d48763942ee50388b1be6bdb652ddaa3d19 WatchSource:0}: Error finding container 34eba134ba438d0839508eff4edf5d48763942ee50388b1be6bdb652ddaa3d19: Status 404 returned error can't find the container with id 34eba134ba438d0839508eff4edf5d48763942ee50388b1be6bdb652ddaa3d19
Sep 16 12:46:26.983880 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:26.983850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c" event={"ID":"92235058-547d-4b73-8c8e-37744ff5e845","Type":"ContainerStarted","Data":"34eba134ba438d0839508eff4edf5d48763942ee50388b1be6bdb652ddaa3d19"}
Sep 16 12:46:27.990168 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:27.990137    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c" event={"ID":"92235058-547d-4b73-8c8e-37744ff5e845","Type":"ContainerStarted","Data":"5ef8dd48ca41c94cb552992f103a03fd8ee28f7147bf32aa51dea7facd58dc9f"}
Sep 16 12:46:27.990602 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:27.990201    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:28.014187 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:28.014144    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c" podStartSLOduration=2.014130292 podStartE2EDuration="2.014130292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:46:28.011834646 +0000 UTC m=+2744.454869682" watchObservedRunningTime="2026-09-16 12:46:28.014130292 +0000 UTC m=+2744.457165154"
Sep 16 12:46:28.224996 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:28.224977    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jfmgf_b531e0f4-f48e-48e8-b629-c32125d742c4/dns/0.log"
Sep 16 12:46:28.250047 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:28.250000    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jfmgf_b531e0f4-f48e-48e8-b629-c32125d742c4/kube-rbac-proxy/0.log"
Sep 16 12:46:28.381944 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:28.381926    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gbwzr_8baa1341-2665-43af-abee-7297cf014daa/dns-node-resolver/0.log"
Sep 16 12:46:28.986989 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:28.986970    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhskk_268eaad8-cdac-46d7-8412-4e2561bb9efe/node-ca/0.log"
Sep 16 12:46:29.952584 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:29.952562    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5_223d930a-0800-461b-a3ba-3a4c2a828bcb/istio-proxy/0.log"
Sep 16 12:46:30.321323 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:30.321256    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-27zlr_7c22793d-308a-4fb9-93bc-ab604facde70/discovery/0.log"
Sep 16 12:46:30.363761 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:30.363736    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f6c77cbf-cxxmq_e4f65658-6be0-43dd-a1e1-1cdc902ad16b/kube-auth-proxy/0.log"
Sep 16 12:46:30.392372 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:30.392348    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rdjfk_29fb0007-a1a1-4f0c-85c3-14ef2b52072d/istio-proxy/0.log"
Sep 16 12:46:30.394728 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:30.394710    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rdjfk_29fb0007-a1a1-4f0c-85c3-14ef2b52072d/istio-proxy/1.log"
Sep 16 12:46:30.424156 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:30.424136    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-r7jp6_4e2fae9b-f7d0-4874-8ac9-5b196a86bd27/payload-pre-processing/0.log"
Sep 16 12:46:31.432570 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:31.432541    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zntf4_402683c1-20d6-4a8e-b7a8-b74e847dbf76/serve-healthcheck-canary/0.log"
Sep 16 12:46:32.035347 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:32.035327    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhb9v_2190092b-e043-4242-a850-b5df4be51ce8/kube-rbac-proxy/0.log"
Sep 16 12:46:32.054621 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:32.054603    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhb9v_2190092b-e043-4242-a850-b5df4be51ce8/exporter/0.log"
Sep 16 12:46:32.074916 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:32.074883    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhb9v_2190092b-e043-4242-a850-b5df4be51ce8/extractor/0.log"
Sep 16 12:46:34.005164 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:34.005133    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mv6dr/perf-node-gather-daemonset-jfc2c"
Sep 16 12:46:34.242899 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:34.242874    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rn7nl_b58696b7-dacb-4593-af41-21fe936eefbf/manager/0.log"
Sep 16 12:46:34.449847 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:34.449822    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cmznm_ce1b1b76-2e26-4047-87e9-30086a1d8c92/manager/0.log"
Sep 16 12:46:34.518405 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:34.518381    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gkqsz_90ea22b4-a3b2-4d4c-90a2-b4ef3e4fd92a/server/0.log"
Sep 16 12:46:34.598307 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:34.598286    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dx4cg_aa8b3bc8-eb6d-4917-be3c-b9fe92bd65c5/manager/0.log"
Sep 16 12:46:34.673263 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:34.673244    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7887d7f7b8-7cr4f_68556de2-054e-4109-8506-59efb95b2a39/manager/0.log"
Sep 16 12:46:34.693441 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:34.693421    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7887d7f7b8-7cr4f_68556de2-054e-4109-8506-59efb95b2a39/copy-manifests/0.log"
Sep 16 12:46:36.317318 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:36.317294    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-shj6z_42be28c3-9be4-4ee9-a80d-5f63d5f61e6e/openshift-lws-operator/0.log"
Sep 16 12:46:36.970880 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:36.970854    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5_223d930a-0800-461b-a3ba-3a4c2a828bcb/istio-proxy/0.log"
Sep 16 12:46:37.327039 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:37.327004    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-27zlr_7c22793d-308a-4fb9-93bc-ab604facde70/discovery/0.log"
Sep 16 12:46:37.351421 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:37.351395    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f6c77cbf-cxxmq_e4f65658-6be0-43dd-a1e1-1cdc902ad16b/kube-auth-proxy/0.log"
Sep 16 12:46:37.377512 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:37.377484    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rdjfk_29fb0007-a1a1-4f0c-85c3-14ef2b52072d/istio-proxy/0.log"
Sep 16 12:46:37.380199 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:37.380179    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rdjfk_29fb0007-a1a1-4f0c-85c3-14ef2b52072d/istio-proxy/1.log"
Sep 16 12:46:37.403933 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:37.403910    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-r7jp6_4e2fae9b-f7d0-4874-8ac9-5b196a86bd27/payload-pre-processing/0.log"
Sep 16 12:46:39.132547 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:39.132519    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-kmtc5_223d930a-0800-461b-a3ba-3a4c2a828bcb/istio-proxy/0.log"
Sep 16 12:46:39.500949 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:39.500920    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-27zlr_7c22793d-308a-4fb9-93bc-ab604facde70/discovery/0.log"
Sep 16 12:46:39.536127 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:39.536104    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f6c77cbf-cxxmq_e4f65658-6be0-43dd-a1e1-1cdc902ad16b/kube-auth-proxy/0.log"
Sep 16 12:46:39.558875 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:39.558850    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rdjfk_29fb0007-a1a1-4f0c-85c3-14ef2b52072d/istio-proxy/0.log"
Sep 16 12:46:39.561054 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:39.561036    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rdjfk_29fb0007-a1a1-4f0c-85c3-14ef2b52072d/istio-proxy/1.log"
Sep 16 12:46:39.583277 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:39.583252    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-r7jp6_4e2fae9b-f7d0-4874-8ac9-5b196a86bd27/payload-pre-processing/0.log"
Sep 16 12:46:43.338153 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.338124    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqc9k_215b7997-e1a8-4b85-a03b-da890a22ead0/kube-multus-additional-cni-plugins/0.log"
Sep 16 12:46:43.359477 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.359453    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqc9k_215b7997-e1a8-4b85-a03b-da890a22ead0/egress-router-binary-copy/0.log"
Sep 16 12:46:43.379119 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.379099    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqc9k_215b7997-e1a8-4b85-a03b-da890a22ead0/cni-plugins/0.log"
Sep 16 12:46:43.399404 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.399386    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqc9k_215b7997-e1a8-4b85-a03b-da890a22ead0/bond-cni-plugin/0.log"
Sep 16 12:46:43.422165 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.422149    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqc9k_215b7997-e1a8-4b85-a03b-da890a22ead0/routeoverride-cni/0.log"
Sep 16 12:46:43.445169 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.445149    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqc9k_215b7997-e1a8-4b85-a03b-da890a22ead0/whereabouts-cni-bincopy/0.log"
Sep 16 12:46:43.470126 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.470110    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqc9k_215b7997-e1a8-4b85-a03b-da890a22ead0/whereabouts-cni/0.log"
Sep 16 12:46:43.510914 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.510897    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-l2dgp_22f2b29c-104a-4588-aad9-65bde4875647/kube-multus/0.log"
Sep 16 12:46:43.663887 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.663867    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-th86b_6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb/network-metrics-daemon/0.log"
Sep 16 12:46:43.681936 ip-10-0-134-254 kubenswrapper[2559]: I0916 12:46:43.681920    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-th86b_6b2f42ca-2177-4cd6-a32b-8fb0dda6adbb/kube-rbac-proxy/0.log"