Sep 16 13:31:03.811213 ip-10-0-131-28 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 13:31:03.811229 ip-10-0-131-28 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 13:31:03.811239 ip-10-0-131-28 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 13:31:03.811564 ip-10-0-131-28 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 13:31:15.246772 ip-10-0-131-28 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 13:31:15.246794 ip-10-0-131-28 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7d665dd4795842f5a632240241770f57 --
Sep 16 13:33:10.660690 ip-10-0-131-28 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 13:33:10.984662 ip-10-0-131-28 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 13:33:10.984662 ip-10-0-131-28 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 13:33:10.984662 ip-10-0-131-28 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 13:33:10.984662 ip-10-0-131-28 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 13:33:10.984662 ip-10-0-131-28 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 13:33:10.985320 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.984723    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 13:33:10.991848 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991823    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:33:10.991848 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991841    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:33:10.991848 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991845    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:33:10.991848 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991850    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:33:10.991848 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991854    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991859    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991862    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991865    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991868    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991871    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991874    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991876    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991879    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991882    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991885    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991887    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991890    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991892    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991895    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991898    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991900    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991902    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991905    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:33:10.992050 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991907    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991911    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991915    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991918    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991920    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991923    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991926    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991928    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991930    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991934    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991936    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991939    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991941    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991944    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991946    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991949    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991952    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991955    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991957    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991960    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:33:10.992526 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991962    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991965    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991967    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991970    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991973    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991976    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991978    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991981    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991983    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991985    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991988    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991990    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991993    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991995    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.991998    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992000    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992002    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992005    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992007    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992010    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:33:10.993023 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992012    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992015    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992017    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992021    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992025    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992028    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992032    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992035    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992038    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992040    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992043    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992045    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992048    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992050    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992053    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992056    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992059    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992061    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992064    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:33:10.993564 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992067    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992071    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992073    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992076    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992078    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992081    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992083    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992086    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992088    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992091    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992093    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992095    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992098    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992100    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992102    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992105    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.992107    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993914    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993922    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993926    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:33:10.994025 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993929    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993932    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993935    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993937    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993940    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993942    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993945    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993947    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993950    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993953    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993957    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993960    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993962    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993966    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993972    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993975    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993978    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993981    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993984    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:33:10.994523 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993987    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993990    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993993    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993995    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.993998    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994000    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994003    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994005    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994008    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994010    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994013    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994015    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994018    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994021    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994023    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994026    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994028    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994031    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994033    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:33:10.994987 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994036    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994038    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994041    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994044    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994046    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994048    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994051    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994053    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994056    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994065    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994068    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994070    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994073    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994075    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994077    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994080    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994083    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994085    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994087    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994090    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:33:10.995477 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994092    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994095    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994098    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994100    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994102    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994105    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994107    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994110    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994112    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994115    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994117    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994120    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994122    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994125    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994127    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994130    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994132    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994135    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994137    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994140    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:33:10.995966 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994144    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994146    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994149    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994152    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994154    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994156    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994159    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994163    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994166    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994169    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994171    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994174    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994176    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994179    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994181    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994184    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994186    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994189    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994580    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994585    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:33:10.996461 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994588    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994591    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994594    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994596    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994599    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994601    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994604    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994607    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994611    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994614    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994618    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994621    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994624    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994627    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994631    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994633    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994636    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994639    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994641    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994644    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:33:10.996950 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994647    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994650    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994653    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994655    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994658    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994660    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994663    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994665    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994668    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994670    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994672    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994675    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994678    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994681    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994683    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994686    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994689    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994691    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994694    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994696    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:33:10.997464 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994698    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994701    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994703    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994706    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994709    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994712    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994715    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994719    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994721    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994724    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994726    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994729    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994731    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994733    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994736    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994738    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994741    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994743    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994745    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994748    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:33:10.997956 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994750    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994752    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994755    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994757    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994762    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994767    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994770    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994773    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994776    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994779    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994781    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994784    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994787    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994789    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994792    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994794    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994797    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994799    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994801    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:33:10.998497 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994804    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994807    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994809    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994812    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994814    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994817    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994819    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994821    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994824    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994826    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994829    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994831    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994834    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994836    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994839    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994841    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994843    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.994847    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994920    2563 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994963    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 13:33:10.998967 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994970    2563 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994974    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994978    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994981    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994985    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994989    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994992    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994995    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.994999    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995002    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995005    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995009    2563 flags.go:64] FLAG: --cgroup-root=""
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995011    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995014    2563 flags.go:64] FLAG: --client-ca-file=""
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995018    2563 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995021    2563 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995025    2563 flags.go:64] FLAG: --cluster-domain=""
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995028    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995032    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995035    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995038    2563 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995042    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995045    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 13:33:10.999484 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995048    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995051    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995054    2563 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995057    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995060    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995063    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995067    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995071    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995074    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995077    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995080    2563 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995082    2563 flags.go:64] FLAG: --enable-server="true"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995085    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995089    2563 flags.go:64] FLAG: --event-burst="100"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995092    2563 flags.go:64] FLAG: --event-qps="50"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995095    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995098    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995101    2563 flags.go:64] FLAG: --eviction-hard=""
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995104    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995107    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995110    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995113    2563 flags.go:64] FLAG: --eviction-soft=""
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995115    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995118    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995121    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 13:33:11.000037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995124    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995127    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995130    2563 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995133    2563 flags.go:64] FLAG: --feature-gates=""
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995136    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995139    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995142    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995145    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995147    2563 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995150    2563 flags.go:64] FLAG: --help="false"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995153    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995156    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995159    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995163    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995166    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995169    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995172    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995175    2563 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995177    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995180    2563 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995182    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995185    2563 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995188    2563 flags.go:64] FLAG: --kube-reserved=""
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995191    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 13:33:11.000673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995194    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995196    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995199    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995202    2563 flags.go:64] FLAG: --lock-file=""
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995205    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995207    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995210    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995215    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995219    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995221    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995224    2563 flags.go:64] FLAG: --logging-format="text"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995227    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995230    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995233    2563 flags.go:64] FLAG: --manifest-url=""
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995236    2563 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995240    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995242    2563 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995246    2563 flags.go:64] FLAG: --max-pods="110"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995249    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995251    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995254    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995259    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995262    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995265    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995268    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 13:33:11.001266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995276    2563 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995279    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995282    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995285    2563 flags.go:64] FLAG: --pod-cidr=""
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995288    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995292    2563 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995295    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995298    2563 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995301    2563 flags.go:64] FLAG: --port="10250"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995303    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995307    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05babccf5b7db2416"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995310    2563 flags.go:64] FLAG: --qos-reserved=""
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995312    2563 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995315    2563 flags.go:64] FLAG: --register-node="true"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995318    2563 flags.go:64] FLAG: --register-with-taints=""
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995326    2563 flags.go:64] FLAG: --registry-burst="10"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995329    2563 flags.go:64] FLAG: --registry-qps="5"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995332    2563 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995335    2563 flags.go:64] FLAG: --reserved-memory=""
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995338    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995349    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995353    2563 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995356    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995359    2563 flags.go:64] FLAG: --runonce="false"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995362    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 13:33:11.001928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995365    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995368    2563 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995384    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995387    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995393    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995396    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995399    2563 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995402    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995405    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995408    2563 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995411    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995414    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995417    2563 flags.go:64] FLAG: --system-cgroups=""
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995419    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995425    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995428    2563 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995430    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995435    2563 flags.go:64] FLAG: --tls-min-version=""
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995438    2563 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995440    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995443    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995446    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995449    2563 flags.go:64] FLAG: --v="2"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995452    2563 flags.go:64] FLAG: --version="false"
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995459    2563 flags.go:64] FLAG: --vmodule=""
Sep 16 13:33:11.002845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995463    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995466    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995582    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995586    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995589    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995592    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995595    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995599    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995603    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995606    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995609    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995613    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995616    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995620    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995623    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995626    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995629    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995631    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995634    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:33:11.003940 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995637    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995639    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995642    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995645    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995647    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995650    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995652    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995655    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995657    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995660    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995663    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995665    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995668    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995671    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995673    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995676    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995678    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995681    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995684    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995686    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:33:11.004763 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995689    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995691    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995693    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995696    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995700    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995703    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995706    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995709    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995712    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995716    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995719    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995722    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995725    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995728    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995731    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995733    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995736    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995739    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995742    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:33:11.005655 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995745    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995747    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995750    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995752    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995755    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995757    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995760    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995763    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995766    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995768    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995770    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995773    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995775    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995778    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995780    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995782    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995785    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995788    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995791    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995795    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:33:11.006235 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995797    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995799    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995802    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995805    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995808    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995810    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995813    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995815    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995818    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995820    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995823    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995825    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995828    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995830    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995833    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995835    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995838    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995840    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995843    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:33:11.006985 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995846    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995849    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995852    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:10.995854    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:10.995859    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.004393    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.004415    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.004437    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.004447    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004528    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004536    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004541    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004546    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004550    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004555    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:33:11.007817 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004559    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004563    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004567    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004572    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004576    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004580    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004584    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004588    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004592    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004596    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004601    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004605    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004610    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004614    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004618    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004622    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004626    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004633    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004639    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004644    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:33:11.008292 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004648    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004653    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004660    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004667    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004672    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004676    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004681    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004685    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004690    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004695    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004699    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004703    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004707    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004711    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004715    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004719    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004723    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004727    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004732    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:33:11.008824 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004736    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004740    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004745    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004749    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004753    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004757    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004761    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004765    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004770    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004773    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004777    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004781    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004785    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004789    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004793    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004798    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004803    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004809    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004814    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004818    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:33:11.009513 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004822    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004829    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004834    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004839    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004843    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004848    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004852    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004856    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004860    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004864    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004868    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004872    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004876    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004880    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004884    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004888    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004892    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004896    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004900    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:33:11.010150 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004904    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004908    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004912    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004917    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004921    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004925    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004929    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004933    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004937    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004942    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004946    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004951    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004955    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004958    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.004963    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:33:11.010644 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.004971    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005146    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005154    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005158    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005163    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005167    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005172    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005178    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005184    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005189    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005194    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005199    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005204    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005208    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005212    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005216    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005221    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005225    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005229    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005233    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:33:11.011070 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005237    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005241    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005245    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005249    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005253    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005257    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005261    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005266    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005270    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005275    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005279    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005283    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005287    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005291    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005297    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005300    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005307    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005313    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005318    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:33:11.011580 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005323    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005328    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005333    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005337    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005341    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005345    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005349    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005353    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005358    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005362    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005366    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005370    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005393    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005397    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005400    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005405    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005409    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005413    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005418    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005422    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:33:11.012062 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005426    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005430    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005434    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005439    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005444    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005448    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005452    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005456    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005460    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005465    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005469    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005473    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005477    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005481    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005485    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005489    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005493    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005496    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005500    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:33:11.012561 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005504    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005509    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005513    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005517    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005521    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005525    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005529    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005532    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005536    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005540    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005544    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005549    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005553    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005557    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005561    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005565    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005569    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005574    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005578    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:33:11.013310 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005585    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:33:11.014086 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005590    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:33:11.014086 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:11.005595    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:33:11.014086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.005603    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 13:33:11.014086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.005755    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 13:33:11.014086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.008868    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 13:33:11.014086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.010042    2563 server.go:1019] "Starting client certificate rotation"
Sep 16 13:33:11.014086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.010150    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 13:33:11.014086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.010180    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 13:33:11.014086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.013215    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 13:33:11.017513 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.017493    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 13:33:11.028942 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.028924    2563 log.go:25] "Validated CRI v1 runtime API"
Sep 16 13:33:11.033852 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.033830    2563 log.go:25] "Validated CRI v1 image API"
Sep 16 13:33:11.034718 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.034703    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 13:33:11.037937 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.037919    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d5581038-977b-483f-be85-41b50773c878:/dev/nvme0n1p4 d988d64c-92a3-4238-8462-c904489e461c:/dev/nvme0n1p3]
Sep 16 13:33:11.037991 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.037937    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 13:33:11.039972 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.039957    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 13:33:11.044220 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.044112    2563 manager.go:216] Machine: {Timestamp:2026-09-16 13:33:11.04271465 +0000 UTC m=+0.289592466 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101504 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec276fadad7eeaff95d4e3181343f4cb SystemUUID:ec276fad-ad7e-eaff-95d4-e3181343f4cb BootID:7d665dd4-7958-42f5-a632-240241770f57 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d3:58:7d:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d3:58:7d:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:39:e5:3c:e8:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 13:33:11.044220 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.044219    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 13:33:11.044326 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.044318    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 13:33:11.047687 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.047663    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 13:33:11.047813 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.047690    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 13:33:11.048510 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.048501    2563 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 13:33:11.048549 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.048513    2563 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 13:33:11.048549 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.048521    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 13:33:11.048549 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.048535    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 13:33:11.049820 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.049809    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 13:33:11.054419 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.054407    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 13:33:11.054538 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.054523    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 13:33:11.054574 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.054565    2563 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 13:33:11.054611 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.054594    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 13:33:11.054655 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.054611    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 13:33:11.054655 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.054624    2563 kubelet.go:398] "Adding apiserver pod source"
Sep 16 13:33:11.054655 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.054635    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 13:33:11.055027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.055016    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 13:33:11.055064 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.055037    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 13:33:11.057307 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.057291    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 13:33:11.060336 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.060322    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 13:33:11.060404 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.060353    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 13:33:11.060547 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.060532    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ncwv5"
Sep 16 13:33:11.062544 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062528    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062552    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062560    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062565    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062573    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062578    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062590    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062595    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062601    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062606    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062614    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 13:33:11.062617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.062619    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 13:33:11.063531 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.063519    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 13:33:11.063531 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.063530    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 13:33:11.063833 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.063809    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 13:33:11.063893 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.063835    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 13:33:11.065769 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.065743    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 13:33:11.065898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.065875    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ncwv5"
Sep 16 13:33:11.067391 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.067362    2563 server.go:1268] "Started kubelet"
Sep 16 13:33:11.067751 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.067636    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 13:33:11.068158 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.068110    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 13:33:11.068259 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.068174    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 13:33:11.068441 ip-10-0-131-28 systemd[1]: Started Kubernetes Kubelet.
Sep 16 13:33:11.069867 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.069849    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 13:33:11.072302 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.072284    2563 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 13:33:11.072771 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.072746    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 13:33:11.076080 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.076065    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 13:33:11.076080 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.076071    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 13:33:11.076204 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.076138    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.076831 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.076815    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 13:33:11.076831 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.076822    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 13:33:11.076831 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.076829    2563 factory.go:55] Registering systemd factory
Sep 16 13:33:11.077027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.076842    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 13:33:11.077027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.076867    2563 factory.go:223] Registration of the systemd container factory successfully
Sep 16 13:33:11.077027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.076919    2563 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 13:33:11.077027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.076929    2563 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 13:33:11.077255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.077242    2563 factory.go:153] Registering CRI-O factory
Sep 16 13:33:11.077298 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.077258    2563 factory.go:223] Registration of the crio container factory successfully
Sep 16 13:33:11.077334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.077306    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 13:33:11.077334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.077331    2563 factory.go:103] Registering Raw factory
Sep 16 13:33:11.077440 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.077348    2563 manager.go:1196] Started watching for new ooms in manager
Sep 16 13:33:11.078425 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.078407    2563 manager.go:349] Starting recovery of all containers
Sep 16 13:33:11.078514 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.078444    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:33:11.082887 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.082870    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-28.ec2.internal\" not found" node="ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.088916 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.088902    2563 manager.go:354] Recovery completed
Sep 16 13:33:11.093269 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.093254    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:33:11.095277 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.095261    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:33:11.095365 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.095293    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:33:11.095365 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.095308    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:33:11.095881 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.095868    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 13:33:11.095937 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.095881    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 13:33:11.095937 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.095896    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 13:33:11.095996 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.095873    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:33:11.096631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.096604    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:33:11.096631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.096626    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:33:11.096735 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.096637    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:33:11.098042 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.098028    2563 policy_none.go:49] "None policy: Start"
Sep 16 13:33:11.098042 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.098043    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 13:33:11.098141 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.098054    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 13:33:11.099997 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.099984    2563 policy_none.go:47] "Start"
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.143985    2563 manager.go:337] "Starting Device Plugin manager"
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.144017    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.144026    2563 server.go:87] "Starting device plugin registration server"
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.144252    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.144264    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.144352    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.144455    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.144466    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.144964    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 13:33:11.161172 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.145017    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.209018 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.208996    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 13:33:11.210242 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.210229    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 13:33:11.210326 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.210280    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 13:33:11.210326 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.210306    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 13:33:11.210441 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.210407    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 13:33:11.212550 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.212531    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:33:11.244583 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.244540    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:33:11.245364 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.245349    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:33:11.245432 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.245393    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:33:11.245432 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.245405    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:33:11.245432 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.245426    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.251668 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.251656    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.251721 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.251675    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-28.ec2.internal\": node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.265611 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.265594    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.311501 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.311482    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal"]
Sep 16 13:33:11.311554 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.311540    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:33:11.312854 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.312840    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:33:11.312930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.312867    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:33:11.312930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.312876    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:33:11.315198 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.315187    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:33:11.315319 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.315293    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.315429 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.315324    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:33:11.316058 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.316045    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:33:11.316108 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.316066    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:33:11.316108 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.316075    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:33:11.316423 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.316410    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:33:11.316460 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.316430    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:33:11.316460 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.316439    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:33:11.320764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.320750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.320833 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.320773    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:33:11.321595 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.321503    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:33:11.321595 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.321525    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:33:11.321595 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.321540    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:33:11.329951 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.329926    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-28.ec2.internal\" not found" node="ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.335148 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.335135    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-28.ec2.internal\" not found" node="ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.366061 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.366041    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.379046 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.379012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad521111b30fe68c819cee2f58c92845-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"ad521111b30fe68c819cee2f58c92845\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.379132 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.379053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad521111b30fe68c819cee2f58c92845-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"ad521111b30fe68c819cee2f58c92845\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.379132 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.379080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cbfe9bfbe47f47cb125932644c1fcafa-config\") pod \"kube-apiserver-proxy-ip-10-0-131-28.ec2.internal\" (UID: \"cbfe9bfbe47f47cb125932644c1fcafa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.466942 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.466913    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.479183 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.479160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad521111b30fe68c819cee2f58c92845-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"ad521111b30fe68c819cee2f58c92845\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.479245 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.479188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad521111b30fe68c819cee2f58c92845-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"ad521111b30fe68c819cee2f58c92845\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.479245 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.479207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cbfe9bfbe47f47cb125932644c1fcafa-config\") pod \"kube-apiserver-proxy-ip-10-0-131-28.ec2.internal\" (UID: \"cbfe9bfbe47f47cb125932644c1fcafa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.479326 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.479253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad521111b30fe68c819cee2f58c92845-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"ad521111b30fe68c819cee2f58c92845\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.479326 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.479255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad521111b30fe68c819cee2f58c92845-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"ad521111b30fe68c819cee2f58c92845\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.479326 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.479299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cbfe9bfbe47f47cb125932644c1fcafa-config\") pod \"kube-apiserver-proxy-ip-10-0-131-28.ec2.internal\" (UID: \"cbfe9bfbe47f47cb125932644c1fcafa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.567503 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.567438    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.632939 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.632919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.638521 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:11.637905    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:11.667811 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.667789    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.768283 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.768261    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.868857 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.868793    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:11.969259 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:11.969239    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:12.009700 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.009674    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 13:33:12.010189 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.009814    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 13:33:12.010189 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.009830    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 13:33:12.070070 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:12.070045    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found"
Sep 16 13:33:12.072330 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.072310    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 13:28:11 +0000 UTC" deadline="2028-05-30 08:32:30.050586682 +0000 UTC"
Sep 16 13:33:12.072403 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.072329    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14922h59m17.978260274s"
Sep 16 13:33:12.148237 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.148211    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:33:12.176747 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.176727    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:12.186391 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.186363    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 13:33:12.187749 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.187736    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal"
Sep 16 13:33:12.193260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.193248    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 13:33:12.201905 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.201888    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:33:12.234211 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:12.234179    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad521111b30fe68c819cee2f58c92845.slice/crio-a699d31bebe13d822c3ff0a6e1b42185d64ee4265e80f95561800055db32a490 WatchSource:0}: Error finding container a699d31bebe13d822c3ff0a6e1b42185d64ee4265e80f95561800055db32a490: Status 404 returned error can't find the container with id a699d31bebe13d822c3ff0a6e1b42185d64ee4265e80f95561800055db32a490
Sep 16 13:33:12.244449 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.244434    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:33:12.252091 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:12.252070    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfe9bfbe47f47cb125932644c1fcafa.slice/crio-83c0f1dd19724c2602f7d0ea8352b93ac94b461b1ed064f5733f4a337cbec63f WatchSource:0}: Error finding container 83c0f1dd19724c2602f7d0ea8352b93ac94b461b1ed064f5733f4a337cbec63f: Status 404 returned error can't find the container with id 83c0f1dd19724c2602f7d0ea8352b93ac94b461b1ed064f5733f4a337cbec63f
Sep 16 13:33:12.928709 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:12.928634    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:33:13.055472 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.055436    2563 apiserver.go:52] "Watching apiserver"
Sep 16 13:33:13.061713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.061685    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 13:33:13.062151 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.062127    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-dvxnq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal","openshift-multus/multus-5dh2l","openshift-network-diagnostics/network-check-target-27n7f","kube-system/global-pull-secret-syncer-gwjjm","openshift-cluster-node-tuning-operator/tuned-swts5","openshift-multus/multus-additional-cni-plugins-rn9p6","openshift-multus/network-metrics-daemon-kmgcm","openshift-network-operator/iptables-alerter-h6w8f","openshift-ovn-kubernetes/ovnkube-node-44ltr","kube-system/konnectivity-agent-wm54d","kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp","openshift-dns/node-resolver-q88zn"]
Sep 16 13:33:13.066422 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.065764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.070343 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.069211    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.071591 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.071568    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 13:33:13.071705 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.071668    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 13:33:13.071836 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.071817    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 13:33:13.071919 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.071897    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k9j9w\""
Sep 16 13:33:13.072187 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.072131    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 13:33:13.072187 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.072176    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 13:33:13.072334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.072316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.073134 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.073116    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8hzzp\""
Sep 16 13:33:13.073309 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.073293    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 13:33:13.074464 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.074369    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 13:33:13.074464 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.074405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:13.074606 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.074473    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:13.074659 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.074643    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 13:33:13.077277 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.076781    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.077277 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.076848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:13.077478 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.077361    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 13:33:13.077832 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.077808    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 13:33:13.078300 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.078136    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t8ll9\""
Sep 16 13:33:13.079273 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.079251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.081807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.081786    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.082520 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.082502    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 13:33:13.082807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.082791    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 13:33:13.082896 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.082874    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7v6qh\""
Sep 16 13:33:13.083907 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.083870    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 13:33:13.084601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.084239    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hhwv6\""
Sep 16 13:33:13.084601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.084497    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 13:33:13.084773 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.084754    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 13:33:13.085137 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09a12ca6-e32d-43b7-bfa4-ebd942adc292-cnibin\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.085231 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09a12ca6-e32d-43b7-bfa4-ebd942adc292-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.085231 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-var-lib-cni-bin\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.085231 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgjp7\" (UniqueName: \"kubernetes.io/projected/870fa97a-2908-48db-b746-07ccc9a82c20-kube-api-access-sgjp7\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.085396 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09a12ca6-e32d-43b7-bfa4-ebd942adc292-system-cni-dir\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.085396 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-etc-kubernetes\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.085396 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-modprobe-d\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.085396 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-kubernetes\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.085396 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/870fa97a-2908-48db-b746-07ccc9a82c20-etc-tuned\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.085396 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/870fa97a-2908-48db-b746-07ccc9a82c20-tmp\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.085396 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09a12ca6-e32d-43b7-bfa4-ebd942adc292-cni-binary-copy\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4656g\" (UniqueName: \"kubernetes.io/projected/09a12ca6-e32d-43b7-bfa4-ebd942adc292-kube-api-access-4656g\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-socket-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-var-lib-kubelet\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-kubelet-config\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-sysctl-d\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-var-lib-kubelet\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-host\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-system-cni-dir\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-cnibin\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-conf-dir\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09a12ca6-e32d-43b7-bfa4-ebd942adc292-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-device-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ww8v\" (UniqueName: \"kubernetes.io/projected/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-kube-api-access-8ww8v\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.085803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-cni-dir\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-hostroot\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-daemon-config\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-sysconfig\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-run\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-sys\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.085979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0bbf7553-72a6-4af8-a03b-139fb12cae7e-cni-binary-copy\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-socket-dir-parent\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-sysctl-conf\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-systemd\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-lib-modules\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-run-k8s-cni-cncf-io\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-run-netns\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-run-multus-certs\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.086533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzvw7\" (UniqueName: \"kubernetes.io/projected/0bbf7553-72a6-4af8-a03b-139fb12cae7e-kube-api-access-gzvw7\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.087545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:13.087545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-dbus\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.087545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09a12ca6-e32d-43b7-bfa4-ebd942adc292-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.087545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-registration-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.087545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-sys-fs\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.087545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-var-lib-cni-multus\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.087545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.086549    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.087545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.087538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.088390 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.088370    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 13:33:13.088918 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.088878    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 13:33:13.089023 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.089003    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 13:33:13.089492 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.089429    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgtx9\""
Sep 16 13:33:13.089593 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.089565    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s69xn\""
Sep 16 13:33:13.089692 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.089672    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 13:33:13.089799 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.089733    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 13:33:13.091194 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.091176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.093045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.093024    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dptsm\""
Sep 16 13:33:13.093309 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.093289    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 13:33:13.094370 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.094348    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 13:33:13.094655 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.094637    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 13:33:13.094655 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.094648    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 13:33:13.094834 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.094357    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 13:33:13.094932 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.094896    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 13:33:13.095026 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.095008    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 13:33:13.095126 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.095109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:13.096431 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.096409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:13.096542 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.096514    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:13.097701 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.097677    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 13:33:13.098022 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.098003    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-59qss\""
Sep 16 13:33:13.098260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.098248    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 13:33:13.123550 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.123526    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7bwqh"
Sep 16 13:33:13.133963 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.133943    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7bwqh"
Sep 16 13:33:13.177687 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.177664    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 13:33:13.186917 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.186855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09a12ca6-e32d-43b7-bfa4-ebd942adc292-cnibin\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.186917 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.186901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-var-lib-openvswitch\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.187065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.186929    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09a12ca6-e32d-43b7-bfa4-ebd942adc292-cnibin\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.187065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.186931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-etc-kubernetes\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.187065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.186986    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-etc-kubernetes\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.187065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc8zq\" (UniqueName: \"kubernetes.io/projected/6a955d66-0e9e-4f78-b842-e74b42cde550-kube-api-access-kc8zq\") pod \"node-ca-dvxnq\" (UID: \"6a955d66-0e9e-4f78-b842-e74b42cde550\") " pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.187065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-kubelet\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.187065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cd0253b-752b-4080-b5f2-4e8cd014ebb2-iptables-alerter-script\") pod \"iptables-alerter-h6w8f\" (UID: \"1cd0253b-752b-4080-b5f2-4e8cd014ebb2\") " pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.187304 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzgck\" (UniqueName: \"kubernetes.io/projected/1cd0253b-752b-4080-b5f2-4e8cd014ebb2-kube-api-access-bzgck\") pod \"iptables-alerter-h6w8f\" (UID: \"1cd0253b-752b-4080-b5f2-4e8cd014ebb2\") " pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.187304 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-modprobe-d\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.187304 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-kubernetes\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.187304 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09a12ca6-e32d-43b7-bfa4-ebd942adc292-cni-binary-copy\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.187304 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-socket-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.187304 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-modprobe-d\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.187635 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/29e45f57-dc70-4421-84d6-65738d7f19fc-konnectivity-ca\") pod \"konnectivity-agent-wm54d\" (UID: \"29e45f57-dc70-4421-84d6-65738d7f19fc\") " pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:13.187635 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-kubernetes\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.187635 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-kubelet-config\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.187635 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-host\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.187635 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-system-cni-dir\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.187635 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-socket-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.187635 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-host\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-system-cni-dir\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-kubelet-config\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-cnibin\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a955d66-0e9e-4f78-b842-e74b42cde550-serviceca\") pod \"node-ca-dvxnq\" (UID: \"6a955d66-0e9e-4f78-b842-e74b42cde550\") " pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-cnibin\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09a12ca6-e32d-43b7-bfa4-ebd942adc292-cni-binary-copy\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cd0253b-752b-4080-b5f2-4e8cd014ebb2-host-slash\") pod \"iptables-alerter-h6w8f\" (UID: \"1cd0253b-752b-4080-b5f2-4e8cd014ebb2\") " pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09a12ca6-e32d-43b7-bfa4-ebd942adc292-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ww8v\" (UniqueName: \"kubernetes.io/projected/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-kube-api-access-8ww8v\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-daemon-config\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-ovn-node-metrics-cert\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xlmv\" (UniqueName: \"kubernetes.io/projected/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-kube-api-access-6xlmv\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.187988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-run-k8s-cni-cncf-io\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-run-multus-certs\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzvw7\" (UniqueName: \"kubernetes.io/projected/0bbf7553-72a6-4af8-a03b-139fb12cae7e-kube-api-access-gzvw7\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09a12ca6-e32d-43b7-bfa4-ebd942adc292-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-sys\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-sys\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-socket-dir-parent\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-run-k8s-cni-cncf-io\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-run-ovn-kubernetes\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-socket-dir-parent\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-systemd\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188210    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-run-multus-certs\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-systemd\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a955d66-0e9e-4f78-b842-e74b42cde550-host\") pod \"node-ca-dvxnq\" (UID: \"6a955d66-0e9e-4f78-b842-e74b42cde550\") " pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-cni-netd\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/29e45f57-dc70-4421-84d6-65738d7f19fc-agent-certs\") pod \"konnectivity-agent-wm54d\" (UID: \"29e45f57-dc70-4421-84d6-65738d7f19fc\") " pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09a12ca6-e32d-43b7-bfa4-ebd942adc292-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-registration-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-sys-fs\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.188930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-var-lib-cni-multus\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-slash\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-run-systemd\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-var-lib-cni-multus\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-node-log\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188617    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-sys-fs\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09a12ca6-e32d-43b7-bfa4-ebd942adc292-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-var-lib-cni-bin\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-registration-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188757    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52tm9\" (UniqueName: \"kubernetes.io/projected/2ce2d887-1482-4f90-bfc0-742e2b7a6dc9-kube-api-access-52tm9\") pod \"node-resolver-q88zn\" (UID: \"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9\") " pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-var-lib-cni-bin\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-cni-bin\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-ovnkube-script-lib\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgjp7\" (UniqueName: \"kubernetes.io/projected/870fa97a-2908-48db-b746-07ccc9a82c20-kube-api-access-sgjp7\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09a12ca6-e32d-43b7-bfa4-ebd942adc292-system-cni-dir\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-run-ovn\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-ovnkube-config\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.189776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/870fa97a-2908-48db-b746-07ccc9a82c20-etc-tuned\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.188987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09a12ca6-e32d-43b7-bfa4-ebd942adc292-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09a12ca6-e32d-43b7-bfa4-ebd942adc292-system-cni-dir\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/870fa97a-2908-48db-b746-07ccc9a82c20-tmp\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-daemon-config\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4656g\" (UniqueName: \"kubernetes.io/projected/09a12ca6-e32d-43b7-bfa4-ebd942adc292-kube-api-access-4656g\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-var-lib-kubelet\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d4mv\" (UniqueName: \"kubernetes.io/projected/da1a2822-eac6-413f-a0a4-e0609001d6f6-kube-api-access-4d4mv\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ce2d887-1482-4f90-bfc0-742e2b7a6dc9-tmp-dir\") pod \"node-resolver-q88zn\" (UID: \"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9\") " pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-sysctl-d\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09a12ca6-e32d-43b7-bfa4-ebd942adc292-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-var-lib-kubelet\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-var-lib-kubelet\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-var-lib-kubelet\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-conf-dir\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-etc-openvswitch\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.190675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-conf-dir\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-env-overrides\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189379    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-sysctl-d\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-device-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-cni-dir\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-device-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189372    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-multus-cni-dir\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-hostroot\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-hostroot\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-run-netns\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-run-openvswitch\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-log-socket\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-run-netns\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ce2d887-1482-4f90-bfc0-742e2b7a6dc9-hosts-file\") pod \"node-resolver-q88zn\" (UID: \"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9\") " pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189681    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0bbf7553-72a6-4af8-a03b-139fb12cae7e-host-run-netns\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-sysconfig\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.191258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-run\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-sysconfig\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.189813    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.189883    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret podName:5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:13.689863298 +0000 UTC m=+2.936741124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret") pod "global-pull-secret-syncer-gwjjm" (UID: "5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-run\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.189927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0bbf7553-72a6-4af8-a03b-139fb12cae7e-cni-binary-copy\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-sysctl-conf\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-lib-modules\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-systemd-units\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-dbus\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-lib-modules\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-dbus\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/870fa97a-2908-48db-b746-07ccc9a82c20-etc-sysctl-conf\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.191983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.190855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0bbf7553-72a6-4af8-a03b-139fb12cae7e-cni-binary-copy\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.193059 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.193040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/870fa97a-2908-48db-b746-07ccc9a82c20-tmp\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.193159 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.193100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/870fa97a-2908-48db-b746-07ccc9a82c20-etc-tuned\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.197027 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.197005    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:33:13.197131 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.197031    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:33:13.197131 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.197046    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxnqr for pod openshift-network-diagnostics/network-check-target-27n7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:13.197131 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.197118    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr podName:98edf2eb-520a-47ea-8b2c-6e3976f6b5e2 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:13.697099791 +0000 UTC m=+2.943977596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wxnqr" (UniqueName: "kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr") pod "network-check-target-27n7f" (UID: "98edf2eb-520a-47ea-8b2c-6e3976f6b5e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:13.200224 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.200202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzvw7\" (UniqueName: \"kubernetes.io/projected/0bbf7553-72a6-4af8-a03b-139fb12cae7e-kube-api-access-gzvw7\") pod \"multus-5dh2l\" (UID: \"0bbf7553-72a6-4af8-a03b-139fb12cae7e\") " pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.200318 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.200246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4656g\" (UniqueName: \"kubernetes.io/projected/09a12ca6-e32d-43b7-bfa4-ebd942adc292-kube-api-access-4656g\") pod \"multus-additional-cni-plugins-rn9p6\" (UID: \"09a12ca6-e32d-43b7-bfa4-ebd942adc292\") " pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.200318 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.200289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ww8v\" (UniqueName: \"kubernetes.io/projected/289b1adc-71a6-415c-8a67-fe6cdaaef0fc-kube-api-access-8ww8v\") pod \"aws-ebs-csi-driver-node-xc8fp\" (UID: \"289b1adc-71a6-415c-8a67-fe6cdaaef0fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.200526 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.200509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgjp7\" (UniqueName: \"kubernetes.io/projected/870fa97a-2908-48db-b746-07ccc9a82c20-kube-api-access-sgjp7\") pod \"tuned-swts5\" (UID: \"870fa97a-2908-48db-b746-07ccc9a82c20\") " pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.215651 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.215604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" event={"ID":"cbfe9bfbe47f47cb125932644c1fcafa","Type":"ContainerStarted","Data":"83c0f1dd19724c2602f7d0ea8352b93ac94b461b1ed064f5733f4a337cbec63f"}
Sep 16 13:33:13.217115 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.217083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" event={"ID":"ad521111b30fe68c819cee2f58c92845","Type":"ContainerStarted","Data":"a699d31bebe13d822c3ff0a6e1b42185d64ee4265e80f95561800055db32a490"}
Sep 16 13:33:13.290451 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-slash\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290640 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-run-systemd\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290640 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-node-log\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290640 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52tm9\" (UniqueName: \"kubernetes.io/projected/2ce2d887-1482-4f90-bfc0-742e2b7a6dc9-kube-api-access-52tm9\") pod \"node-resolver-q88zn\" (UID: \"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9\") " pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.290640 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-cni-bin\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290640 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-ovnkube-script-lib\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290640 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-run-ovn\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290640 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-ovnkube-config\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4mv\" (UniqueName: \"kubernetes.io/projected/da1a2822-eac6-413f-a0a4-e0609001d6f6-kube-api-access-4d4mv\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ce2d887-1482-4f90-bfc0-742e2b7a6dc9-tmp-dir\") pod \"node-resolver-q88zn\" (UID: \"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9\") " pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-etc-openvswitch\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-env-overrides\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-run-netns\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-run-openvswitch\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290822    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-log-socket\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ce2d887-1482-4f90-bfc0-742e2b7a6dc9-hosts-file\") pod \"node-resolver-q88zn\" (UID: \"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9\") " pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.290910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-systemd-units\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-var-lib-openvswitch\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc8zq\" (UniqueName: \"kubernetes.io/projected/6a955d66-0e9e-4f78-b842-e74b42cde550-kube-api-access-kc8zq\") pod \"node-ca-dvxnq\" (UID: \"6a955d66-0e9e-4f78-b842-e74b42cde550\") " pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-kubelet\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.290994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cd0253b-752b-4080-b5f2-4e8cd014ebb2-iptables-alerter-script\") pod \"iptables-alerter-h6w8f\" (UID: \"1cd0253b-752b-4080-b5f2-4e8cd014ebb2\") " pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzgck\" (UniqueName: \"kubernetes.io/projected/1cd0253b-752b-4080-b5f2-4e8cd014ebb2-kube-api-access-bzgck\") pod \"iptables-alerter-h6w8f\" (UID: \"1cd0253b-752b-4080-b5f2-4e8cd014ebb2\") " pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/29e45f57-dc70-4421-84d6-65738d7f19fc-konnectivity-ca\") pod \"konnectivity-agent-wm54d\" (UID: \"29e45f57-dc70-4421-84d6-65738d7f19fc\") " pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.291055    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a955d66-0e9e-4f78-b842-e74b42cde550-serviceca\") pod \"node-ca-dvxnq\" (UID: \"6a955d66-0e9e-4f78-b842-e74b42cde550\") " pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.291131    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs podName:da1a2822-eac6-413f-a0a4-e0609001d6f6 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:13.791110369 +0000 UTC m=+3.037988189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs") pod "network-metrics-daemon-kmgcm" (UID: "da1a2822-eac6-413f-a0a4-e0609001d6f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cd0253b-752b-4080-b5f2-4e8cd014ebb2-host-slash\") pod \"iptables-alerter-h6w8f\" (UID: \"1cd0253b-752b-4080-b5f2-4e8cd014ebb2\") " pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-ovn-node-metrics-cert\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cd0253b-752b-4080-b5f2-4e8cd014ebb2-host-slash\") pod \"iptables-alerter-h6w8f\" (UID: \"1cd0253b-752b-4080-b5f2-4e8cd014ebb2\") " pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.291296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-run-systemd\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.291876 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-node-log\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.291876 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.291577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-cni-bin\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.292063 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.292035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-slash\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.292182 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.292161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-ovnkube-script-lib\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.292297 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.292280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-run-ovn\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.292366 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.292354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-systemd-units\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.292597 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.292575    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-ovnkube-config\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.292784 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.292765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ce2d887-1482-4f90-bfc0-742e2b7a6dc9-tmp-dir\") pod \"node-resolver-q88zn\" (UID: \"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9\") " pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.292871 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.292833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-etc-openvswitch\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.292942 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.292884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-var-lib-openvswitch\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.293534 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.293508    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cd0253b-752b-4080-b5f2-4e8cd014ebb2-iptables-alerter-script\") pod \"iptables-alerter-h6w8f\" (UID: \"1cd0253b-752b-4080-b5f2-4e8cd014ebb2\") " pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.293633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.293608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-kubelet\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.293716 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.293693    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-env-overrides\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.293889 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.293846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xlmv\" (UniqueName: \"kubernetes.io/projected/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-kube-api-access-6xlmv\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.293993 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.293921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-run-ovn-kubernetes\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.294063 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.293999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-run-ovn-kubernetes\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a955d66-0e9e-4f78-b842-e74b42cde550-serviceca\") pod \"node-ca-dvxnq\" (UID: \"6a955d66-0e9e-4f78-b842-e74b42cde550\") " pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/29e45f57-dc70-4421-84d6-65738d7f19fc-konnectivity-ca\") pod \"konnectivity-agent-wm54d\" (UID: \"29e45f57-dc70-4421-84d6-65738d7f19fc\") " pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-run-openvswitch\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-run-netns\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ce2d887-1482-4f90-bfc0-742e2b7a6dc9-hosts-file\") pod \"node-resolver-q88zn\" (UID: \"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9\") " pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-log-socket\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a955d66-0e9e-4f78-b842-e74b42cde550-host\") pod \"node-ca-dvxnq\" (UID: \"6a955d66-0e9e-4f78-b842-e74b42cde550\") " pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a955d66-0e9e-4f78-b842-e74b42cde550-host\") pod \"node-ca-dvxnq\" (UID: \"6a955d66-0e9e-4f78-b842-e74b42cde550\") " pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-cni-netd\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/29e45f57-dc70-4421-84d6-65738d7f19fc-agent-certs\") pod \"konnectivity-agent-wm54d\" (UID: \"29e45f57-dc70-4421-84d6-65738d7f19fc\") " pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.296804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-ovn-node-metrics-cert\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.294674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-host-cni-netd\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.299557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.297839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/29e45f57-dc70-4421-84d6-65738d7f19fc-agent-certs\") pod \"konnectivity-agent-wm54d\" (UID: \"29e45f57-dc70-4421-84d6-65738d7f19fc\") " pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:13.303175 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.303106    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52tm9\" (UniqueName: \"kubernetes.io/projected/2ce2d887-1482-4f90-bfc0-742e2b7a6dc9-kube-api-access-52tm9\") pod \"node-resolver-q88zn\" (UID: \"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9\") " pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.303642 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.303616    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d4mv\" (UniqueName: \"kubernetes.io/projected/da1a2822-eac6-413f-a0a4-e0609001d6f6-kube-api-access-4d4mv\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:13.304586 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.304563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc8zq\" (UniqueName: \"kubernetes.io/projected/6a955d66-0e9e-4f78-b842-e74b42cde550-kube-api-access-kc8zq\") pod \"node-ca-dvxnq\" (UID: \"6a955d66-0e9e-4f78-b842-e74b42cde550\") " pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.305222 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.305191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xlmv\" (UniqueName: \"kubernetes.io/projected/7ff9b24b-c396-43a2-9a01-760b0b1b8dbc-kube-api-access-6xlmv\") pod \"ovnkube-node-44ltr\" (UID: \"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.306280 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.306238    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzgck\" (UniqueName: \"kubernetes.io/projected/1cd0253b-752b-4080-b5f2-4e8cd014ebb2-kube-api-access-bzgck\") pod \"iptables-alerter-h6w8f\" (UID: \"1cd0253b-752b-4080-b5f2-4e8cd014ebb2\") " pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.380941 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.380903    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rn9p6"
Sep 16 13:33:13.392728 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.392642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp"
Sep 16 13:33:13.400709 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.400686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5dh2l"
Sep 16 13:33:13.403663 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.403619    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:33:13.417558 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.417538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:13.418578 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.418556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-swts5"
Sep 16 13:33:13.426751 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.426732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h6w8f"
Sep 16 13:33:13.432774 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.432755    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dvxnq"
Sep 16 13:33:13.439898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.439836    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q88zn"
Sep 16 13:33:13.443705 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.443686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:13.697415 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.697328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:13.697578 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.697436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:13.697578 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.697535    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:13.697578 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.697537    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:33:13.697578 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.697565    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:33:13.697578 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.697578    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxnqr for pod openshift-network-diagnostics/network-check-target-27n7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:13.697849 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.697598    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret podName:5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:14.697578721 +0000 UTC m=+3.944456543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret") pod "global-pull-secret-syncer-gwjjm" (UID: "5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:13.697849 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.697652    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr podName:98edf2eb-520a-47ea-8b2c-6e3976f6b5e2 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:14.697633642 +0000 UTC m=+3.944511464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxnqr" (UniqueName: "kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr") pod "network-check-target-27n7f" (UID: "98edf2eb-520a-47ea-8b2c-6e3976f6b5e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:13.798557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:13.798525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:13.798717 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.798691    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:13.798778 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:13.798764    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs podName:da1a2822-eac6-413f-a0a4-e0609001d6f6 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:14.798746413 +0000 UTC m=+4.045624221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs") pod "network-metrics-daemon-kmgcm" (UID: "da1a2822-eac6-413f-a0a4-e0609001d6f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:14.138236 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:14.138193    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 13:28:13 +0000 UTC" deadline="2028-06-05 00:06:49.5935472 +0000 UTC"
Sep 16 13:33:14.138236 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:14.138232    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15058h33m35.455320477s"
Sep 16 13:33:14.210641 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:14.210602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:14.210825 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:14.210715    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:14.438823 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:14.438783    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870fa97a_2908_48db_b746_07ccc9a82c20.slice/crio-e727b41ddac98409f179fa3061bf0e18919df96aeddfc63743eca215991b13c6 WatchSource:0}: Error finding container e727b41ddac98409f179fa3061bf0e18919df96aeddfc63743eca215991b13c6: Status 404 returned error can't find the container with id e727b41ddac98409f179fa3061bf0e18919df96aeddfc63743eca215991b13c6
Sep 16 13:33:14.442130 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:14.442109    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a955d66_0e9e_4f78_b842_e74b42cde550.slice/crio-d5016e705f467cfb7ded7c8111f96ccf667a07843f4fa4cdcd637e6f25c38257 WatchSource:0}: Error finding container d5016e705f467cfb7ded7c8111f96ccf667a07843f4fa4cdcd637e6f25c38257: Status 404 returned error can't find the container with id d5016e705f467cfb7ded7c8111f96ccf667a07843f4fa4cdcd637e6f25c38257
Sep 16 13:33:14.444826 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:14.444514    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce2d887_1482_4f90_bfc0_742e2b7a6dc9.slice/crio-71c67899103e06b5c4e2b84471fb511ef7629c20ef7a4c0998e5e5853e59b5ed WatchSource:0}: Error finding container 71c67899103e06b5c4e2b84471fb511ef7629c20ef7a4c0998e5e5853e59b5ed: Status 404 returned error can't find the container with id 71c67899103e06b5c4e2b84471fb511ef7629c20ef7a4c0998e5e5853e59b5ed
Sep 16 13:33:14.446194 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:14.445471    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a12ca6_e32d_43b7_bfa4_ebd942adc292.slice/crio-c34ce4cc417398dd20522ffb5c8cdc7f46fbd05f3619be4d934418e408ad5fcc WatchSource:0}: Error finding container c34ce4cc417398dd20522ffb5c8cdc7f46fbd05f3619be4d934418e408ad5fcc: Status 404 returned error can't find the container with id c34ce4cc417398dd20522ffb5c8cdc7f46fbd05f3619be4d934418e408ad5fcc
Sep 16 13:33:14.446643 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:14.446346    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff9b24b_c396_43a2_9a01_760b0b1b8dbc.slice/crio-041b4c53ad29d21667e5751e6ab0d67a8544ab149a7e11f554aefc8a4ca1fe04 WatchSource:0}: Error finding container 041b4c53ad29d21667e5751e6ab0d67a8544ab149a7e11f554aefc8a4ca1fe04: Status 404 returned error can't find the container with id 041b4c53ad29d21667e5751e6ab0d67a8544ab149a7e11f554aefc8a4ca1fe04
Sep 16 13:33:14.448859 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:14.448828    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bbf7553_72a6_4af8_a03b_139fb12cae7e.slice/crio-b3168556394f7fb2a550d0b8d69135672dcaa2f49347a65a4c9e99bb0b918a20 WatchSource:0}: Error finding container b3168556394f7fb2a550d0b8d69135672dcaa2f49347a65a4c9e99bb0b918a20: Status 404 returned error can't find the container with id b3168556394f7fb2a550d0b8d69135672dcaa2f49347a65a4c9e99bb0b918a20
Sep 16 13:33:14.449131 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:14.449110    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd0253b_752b_4080_b5f2_4e8cd014ebb2.slice/crio-632f8d59ed661761c0e3ec3a5c6e84d3943904b80719b9254ad7604dc781aee2 WatchSource:0}: Error finding container 632f8d59ed661761c0e3ec3a5c6e84d3943904b80719b9254ad7604dc781aee2: Status 404 returned error can't find the container with id 632f8d59ed661761c0e3ec3a5c6e84d3943904b80719b9254ad7604dc781aee2
Sep 16 13:33:14.451416 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:14.451395    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289b1adc_71a6_415c_8a67_fe6cdaaef0fc.slice/crio-d0dbe2712f791d14b528bf7afead169da50ef663d4b0d9d5a47dc0c5927bab73 WatchSource:0}: Error finding container d0dbe2712f791d14b528bf7afead169da50ef663d4b0d9d5a47dc0c5927bab73: Status 404 returned error can't find the container with id d0dbe2712f791d14b528bf7afead169da50ef663d4b0d9d5a47dc0c5927bab73
Sep 16 13:33:14.453638 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:14.452275    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e45f57_dc70_4421_84d6_65738d7f19fc.slice/crio-28d1ee0b1d765f1c9eb1c3355b46f486ebd7ebeee359f2532a75c66274386f6f WatchSource:0}: Error finding container 28d1ee0b1d765f1c9eb1c3355b46f486ebd7ebeee359f2532a75c66274386f6f: Status 404 returned error can't find the container with id 28d1ee0b1d765f1c9eb1c3355b46f486ebd7ebeee359f2532a75c66274386f6f
Sep 16 13:33:14.706574 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:14.706372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:14.706685 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:14.706575    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:33:14.706685 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:14.706599    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:33:14.706685 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:14.706609    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxnqr for pod openshift-network-diagnostics/network-check-target-27n7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:14.706685 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:14.706619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:14.706685 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:14.706657    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr podName:98edf2eb-520a-47ea-8b2c-6e3976f6b5e2 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:16.706642206 +0000 UTC m=+5.953520015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxnqr" (UniqueName: "kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr") pod "network-check-target-27n7f" (UID: "98edf2eb-520a-47ea-8b2c-6e3976f6b5e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:14.706906 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:14.706727    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:14.706906 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:14.706797    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret podName:5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:16.706778564 +0000 UTC m=+5.953656370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret") pod "global-pull-secret-syncer-gwjjm" (UID: "5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:14.806976 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:14.806945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:14.807099 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:14.807051    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:14.807141 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:14.807112    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs podName:da1a2822-eac6-413f-a0a4-e0609001d6f6 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:16.807090063 +0000 UTC m=+6.053967867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs") pod "network-metrics-daemon-kmgcm" (UID: "da1a2822-eac6-413f-a0a4-e0609001d6f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:15.139436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.139394    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 13:28:13 +0000 UTC" deadline="2028-04-28 21:03:48.746995431 +0000 UTC"
Sep 16 13:33:15.139436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.139435    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14167h30m33.607565516s"
Sep 16 13:33:15.211632 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.211598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:15.211796 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:15.211735    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:15.212186 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.212161    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:15.212292 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:15.212276    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:15.233273 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.233241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" event={"ID":"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc","Type":"ContainerStarted","Data":"041b4c53ad29d21667e5751e6ab0d67a8544ab149a7e11f554aefc8a4ca1fe04"}
Sep 16 13:33:15.236593 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.236563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dvxnq" event={"ID":"6a955d66-0e9e-4f78-b842-e74b42cde550","Type":"ContainerStarted","Data":"d5016e705f467cfb7ded7c8111f96ccf667a07843f4fa4cdcd637e6f25c38257"}
Sep 16 13:33:15.241463 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.241413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-swts5" event={"ID":"870fa97a-2908-48db-b746-07ccc9a82c20","Type":"ContainerStarted","Data":"e727b41ddac98409f179fa3061bf0e18919df96aeddfc63743eca215991b13c6"}
Sep 16 13:33:15.248832 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.248802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" event={"ID":"cbfe9bfbe47f47cb125932644c1fcafa","Type":"ContainerStarted","Data":"ae47f95b7bb1655ccc79c63354be1dc1ead9055577ed779bbbec2acb8bc6621b"}
Sep 16 13:33:15.251488 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.251437    2563 generic.go:356] "Generic (PLEG): container finished" podID="ad521111b30fe68c819cee2f58c92845" containerID="c380fc5a47f34e7d4f7c789749fdd45e57203b3b603cd4a1243a4c4672b1d3fe" exitCode=0
Sep 16 13:33:15.251578 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.251549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" event={"ID":"ad521111b30fe68c819cee2f58c92845","Type":"ContainerDied","Data":"c380fc5a47f34e7d4f7c789749fdd45e57203b3b603cd4a1243a4c4672b1d3fe"}
Sep 16 13:33:15.259172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.259113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wm54d" event={"ID":"29e45f57-dc70-4421-84d6-65738d7f19fc","Type":"ContainerStarted","Data":"28d1ee0b1d765f1c9eb1c3355b46f486ebd7ebeee359f2532a75c66274386f6f"}
Sep 16 13:33:15.260949 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.260897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp" event={"ID":"289b1adc-71a6-415c-8a67-fe6cdaaef0fc","Type":"ContainerStarted","Data":"d0dbe2712f791d14b528bf7afead169da50ef663d4b0d9d5a47dc0c5927bab73"}
Sep 16 13:33:15.263737 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.263204    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" podStartSLOduration=2.26318739 podStartE2EDuration="2.26318739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:15.262519318 +0000 UTC m=+4.509397149" watchObservedRunningTime="2026-09-16 13:33:15.26318739 +0000 UTC m=+4.510065220"
Sep 16 13:33:15.265346 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.265316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5dh2l" event={"ID":"0bbf7553-72a6-4af8-a03b-139fb12cae7e","Type":"ContainerStarted","Data":"b3168556394f7fb2a550d0b8d69135672dcaa2f49347a65a4c9e99bb0b918a20"}
Sep 16 13:33:15.280527 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.278845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q88zn" event={"ID":"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9","Type":"ContainerStarted","Data":"71c67899103e06b5c4e2b84471fb511ef7629c20ef7a4c0998e5e5853e59b5ed"}
Sep 16 13:33:15.298520 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.296724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rn9p6" event={"ID":"09a12ca6-e32d-43b7-bfa4-ebd942adc292","Type":"ContainerStarted","Data":"c34ce4cc417398dd20522ffb5c8cdc7f46fbd05f3619be4d934418e408ad5fcc"}
Sep 16 13:33:15.300339 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:15.300311    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h6w8f" event={"ID":"1cd0253b-752b-4080-b5f2-4e8cd014ebb2","Type":"ContainerStarted","Data":"632f8d59ed661761c0e3ec3a5c6e84d3943904b80719b9254ad7604dc781aee2"}
Sep 16 13:33:16.211253 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:16.211213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:16.211857 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:16.211351    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:16.312878 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:16.312829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" event={"ID":"ad521111b30fe68c819cee2f58c92845","Type":"ContainerStarted","Data":"41c016f9041cab32e68cc2fc8a64543f788dcc8266d894912c86a13f7c21bab2"}
Sep 16 13:33:16.330070 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:16.329724    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" podStartSLOduration=3.329704859 podStartE2EDuration="3.329704859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:16.329632104 +0000 UTC m=+5.576509934" watchObservedRunningTime="2026-09-16 13:33:16.329704859 +0000 UTC m=+5.576582688"
Sep 16 13:33:16.722160 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:16.722123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:16.722366 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:16.722205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:16.722366 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:16.722335    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:16.722511 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:16.722395    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret podName:5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:20.722375866 +0000 UTC m=+9.969253674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret") pod "global-pull-secret-syncer-gwjjm" (UID: "5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:16.722858 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:16.722836    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:33:16.722949 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:16.722867    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:33:16.722949 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:16.722880    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxnqr for pod openshift-network-diagnostics/network-check-target-27n7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:16.722949 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:16.722927    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr podName:98edf2eb-520a-47ea-8b2c-6e3976f6b5e2 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:20.722910745 +0000 UTC m=+9.969788554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxnqr" (UniqueName: "kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr") pod "network-check-target-27n7f" (UID: "98edf2eb-520a-47ea-8b2c-6e3976f6b5e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:16.822651 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:16.822614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:16.822857 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:16.822785    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:16.822857 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:16.822853    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs podName:da1a2822-eac6-413f-a0a4-e0609001d6f6 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:20.822830597 +0000 UTC m=+10.069708426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs") pod "network-metrics-daemon-kmgcm" (UID: "da1a2822-eac6-413f-a0a4-e0609001d6f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:17.212185 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:17.211528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:17.212185 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:17.211671    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:17.212185 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:17.211540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:17.212185 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:17.212139    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:18.211293 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:18.211259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:18.211499 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:18.211414    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:19.213927 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:19.213877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:19.214568 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:19.214017    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:19.214568 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:19.214405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:19.214568 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:19.214534    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:20.210825 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:20.210732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:20.210985 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:20.210882    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:20.759043 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:20.758977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:20.759580 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:20.759050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:20.759580 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:20.759208    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:33:20.759580 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:20.759226    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:33:20.759580 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:20.759242    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxnqr for pod openshift-network-diagnostics/network-check-target-27n7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:20.759580 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:20.759331    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr podName:98edf2eb-520a-47ea-8b2c-6e3976f6b5e2 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:28.759309716 +0000 UTC m=+18.006187523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxnqr" (UniqueName: "kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr") pod "network-check-target-27n7f" (UID: "98edf2eb-520a-47ea-8b2c-6e3976f6b5e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:20.759895 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:20.759805    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:20.759895 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:20.759857    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret podName:5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:28.759841418 +0000 UTC m=+18.006719227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret") pod "global-pull-secret-syncer-gwjjm" (UID: "5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:20.859824 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:20.859787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:20.860006 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:20.859988    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:20.860107 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:20.860062    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs podName:da1a2822-eac6-413f-a0a4-e0609001d6f6 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:28.860034566 +0000 UTC m=+18.106912377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs") pod "network-metrics-daemon-kmgcm" (UID: "da1a2822-eac6-413f-a0a4-e0609001d6f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:21.210744 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:21.210699    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:21.210918 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:21.210844    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:21.210980 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:21.210920    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:21.211056 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:21.210976    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:22.211961 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:22.211447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:22.211961 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:22.211601    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:23.210878 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:23.210828    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:23.211033 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:23.210954    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:23.211334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:23.211315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:23.211441 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:23.211411    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:24.210771 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:24.210738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:24.211424 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:24.210866    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:25.214574 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:25.214543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:25.215006 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:25.214650    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:25.215006 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:25.214941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:25.215111 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:25.215013    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:26.211445 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:26.211411    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:26.211600 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:26.211529    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:27.211229 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:27.211198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:27.211696 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:27.211333    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:27.211696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:27.211425    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:27.211696 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:27.211528    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:28.211365 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:28.211335    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:28.211854 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:28.211450    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:28.822393 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:28.822347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:28.822586 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:28.822432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:28.822586 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:28.822521    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:28.822586 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:28.822571    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:33:28.822718 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:28.822589    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:33:28.822718 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:28.822602    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxnqr for pod openshift-network-diagnostics/network-check-target-27n7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:28.822718 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:28.822573    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret podName:5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:44.822559903 +0000 UTC m=+34.069437706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret") pod "global-pull-secret-syncer-gwjjm" (UID: "5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:28.822718 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:28.822661    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr podName:98edf2eb-520a-47ea-8b2c-6e3976f6b5e2 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:44.822644828 +0000 UTC m=+34.069522631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxnqr" (UniqueName: "kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr") pod "network-check-target-27n7f" (UID: "98edf2eb-520a-47ea-8b2c-6e3976f6b5e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:28.923210 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:28.923177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:28.923365 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:28.923345    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:28.923442 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:28.923434    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs podName:da1a2822-eac6-413f-a0a4-e0609001d6f6 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:44.923413306 +0000 UTC m=+34.170291116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs") pod "network-metrics-daemon-kmgcm" (UID: "da1a2822-eac6-413f-a0a4-e0609001d6f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:29.210716 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:29.210684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:29.210895 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:29.210684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:29.210895 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:29.210863    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:29.211060 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:29.211025    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:30.210672 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:30.210635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:30.211114 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:30.210753    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:31.211661 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:31.211630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:31.212109 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:31.211722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:31.212109 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:31.211745    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:31.212109 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:31.211816    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:32.210780 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:32.210749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:32.210951 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:32.210871    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:33.211406 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:33.211360    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:33.211833 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:33.211361    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:33.211833 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:33.211507    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:33.211833 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:33.211587    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:34.210796 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.210624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:34.210993 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:34.210862    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:34.354962 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.354875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wm54d" event={"ID":"29e45f57-dc70-4421-84d6-65738d7f19fc","Type":"ContainerStarted","Data":"ec207ea16ac8ed73b9f20912ddf12e9044e5d4224c74279baa8a2d4f79ba1217"}
Sep 16 13:33:34.356790 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.356761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp" event={"ID":"289b1adc-71a6-415c-8a67-fe6cdaaef0fc","Type":"ContainerStarted","Data":"c21da128f64d14d205c34d0872f26434f0194f9e2ff4cb3b100b185a35fefb4c"}
Sep 16 13:33:34.358456 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.358428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5dh2l" event={"ID":"0bbf7553-72a6-4af8-a03b-139fb12cae7e","Type":"ContainerStarted","Data":"32c1fd4c5c803c22e1ea825d9537c6c5abdfb86a1b21f7d71adfe37aef7e542a"}
Sep 16 13:33:34.360143 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.360114    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q88zn" event={"ID":"2ce2d887-1482-4f90-bfc0-742e2b7a6dc9","Type":"ContainerStarted","Data":"ec0cc8a8072846f0a95989d2e4ce2556a5161485e80272b1584f75631e9adf6c"}
Sep 16 13:33:34.361977 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.361952    2563 generic.go:356] "Generic (PLEG): container finished" podID="09a12ca6-e32d-43b7-bfa4-ebd942adc292" containerID="810c92699d9ccb27d7f8f70364f076a02d7479c151472c702267e9ff873f7180" exitCode=0
Sep 16 13:33:34.362099 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.362029    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rn9p6" event={"ID":"09a12ca6-e32d-43b7-bfa4-ebd942adc292","Type":"ContainerDied","Data":"810c92699d9ccb27d7f8f70364f076a02d7479c151472c702267e9ff873f7180"}
Sep 16 13:33:34.370092 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.370068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" event={"ID":"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc","Type":"ContainerStarted","Data":"f933c82f8d5d06fb1dd26bc9762db3132fd6df44e17a83f2d225d0142fbe8707"}
Sep 16 13:33:34.370193 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.370165    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" event={"ID":"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc","Type":"ContainerStarted","Data":"57ac2e6178080a4340e3ee36c50cc33449c4629d5996ed5f27b8df361d3cab67"}
Sep 16 13:33:34.370307 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.370199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" event={"ID":"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc","Type":"ContainerStarted","Data":"3749f5a784f1837dfbffac7767230fb5b14462dd333bc7b72f2bed32a358a818"}
Sep 16 13:33:34.370307 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.370231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" event={"ID":"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc","Type":"ContainerStarted","Data":"8c62a7cb77ee9a391619806b9c1ef50f0b92fd4b18e8c63e8bef5fa271add64f"}
Sep 16 13:33:34.370307 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.370277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" event={"ID":"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc","Type":"ContainerStarted","Data":"ae4babb794c1a66997cbbcfe9627a701dd732522ae88b446008d240a79d41a5b"}
Sep 16 13:33:34.370490 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.370320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" event={"ID":"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc","Type":"ContainerStarted","Data":"3fe300efbcd5a36642be4288b70444e52ff203d18614c442801db38f918a06bb"}
Sep 16 13:33:34.371650 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.371626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dvxnq" event={"ID":"6a955d66-0e9e-4f78-b842-e74b42cde550","Type":"ContainerStarted","Data":"95468701aa17d55505d33857a1269a8c8023dc17fdd32786dcfd8d17709dfe54"}
Sep 16 13:33:34.373414 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.373388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-swts5" event={"ID":"870fa97a-2908-48db-b746-07ccc9a82c20","Type":"ContainerStarted","Data":"6f02f017e31093dd760f60466d783ed06268eb22872bc36b41355db9fd7ff75b"}
Sep 16 13:33:34.385977 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.385926    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wm54d" podStartSLOduration=6.836491444 podStartE2EDuration="22.385913915s" totalImagesPullingTime="15.549422471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:34.369742556 +0000 UTC m=+23.616620382" watchObservedRunningTime="2026-09-16 13:33:34.385913915 +0000 UTC m=+23.632791739"
Sep 16 13:33:34.410631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.410573    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q88zn" podStartSLOduration=3.482108338 podStartE2EDuration="22.410556438s" totalImagesPullingTime="18.9284481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:34.410555738 +0000 UTC m=+23.657433562" watchObservedRunningTime="2026-09-16 13:33:34.410556438 +0000 UTC m=+23.657434263"
Sep 16 13:33:34.410723 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.410698    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5dh2l" podStartSLOduration=3.429959615 podStartE2EDuration="22.410693344s" totalImagesPullingTime="18.980733729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:34.398853822 +0000 UTC m=+23.645731674" watchObservedRunningTime="2026-09-16 13:33:34.410693344 +0000 UTC m=+23.657571183"
Sep 16 13:33:34.438003 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.437963    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dvxnq" podStartSLOduration=3.501822863 podStartE2EDuration="22.437949802s" totalImagesPullingTime="18.936126939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:34.437882601 +0000 UTC m=+23.684760425" watchObservedRunningTime="2026-09-16 13:33:34.437949802 +0000 UTC m=+23.684827626"
Sep 16 13:33:34.438210 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.438185    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-swts5" podStartSLOduration=3.485363187 podStartE2EDuration="22.438177932s" totalImagesPullingTime="18.952814745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:34.425240611 +0000 UTC m=+23.672118430" watchObservedRunningTime="2026-09-16 13:33:34.438177932 +0000 UTC m=+23.685055813"
Sep 16 13:33:34.825328 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:34.825308    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 13:33:35.155875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:35.155756    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T13:33:34.825324239Z","UUID":"07021311-0261-41b3-ae5b-00ac95c367b9","Handler":null,"Name":"","Endpoint":""}
Sep 16 13:33:35.157305 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:35.157286    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 13:33:35.157305 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:35.157322    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 13:33:35.212753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:35.212715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:35.212895 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:35.212848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:35.212961 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:35.212924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:35.213027 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:35.213006    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:35.378290 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:35.378255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp" event={"ID":"289b1adc-71a6-415c-8a67-fe6cdaaef0fc","Type":"ContainerStarted","Data":"578cc4ec2403f0bfae5402b03cf33497e64a88e016c4940e04a3d0498240109e"}
Sep 16 13:33:35.380837 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:35.380783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h6w8f" event={"ID":"1cd0253b-752b-4080-b5f2-4e8cd014ebb2","Type":"ContainerStarted","Data":"ccecd676b22929e81b0817931f7855591dc7afaee889cdb8b707794b9234356e"}
Sep 16 13:33:35.395319 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:35.395276    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h6w8f" podStartSLOduration=4.473853057 podStartE2EDuration="23.395264849s" totalImagesPullingTime="18.921411792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:35.394854707 +0000 UTC m=+24.641732533" watchObservedRunningTime="2026-09-16 13:33:35.395264849 +0000 UTC m=+24.642142674"
Sep 16 13:33:36.211345 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:36.211316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:36.211514 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:36.211447    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:36.384660 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:36.384620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp" event={"ID":"289b1adc-71a6-415c-8a67-fe6cdaaef0fc","Type":"ContainerStarted","Data":"01f223dc8158b5bd08de0ad446f30728b28f817354caad634ea3981036199291"}
Sep 16 13:33:36.389052 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:36.389024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" event={"ID":"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc","Type":"ContainerStarted","Data":"55b3e7af30077779a8a5890a12515d885e30bb9170b6e8e78031aaa9e787197f"}
Sep 16 13:33:36.400711 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:36.400665    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xc8fp" podStartSLOduration=3.3708469660000002 podStartE2EDuration="24.400647451s" totalImagesPullingTime="21.029800485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:36.399462968 +0000 UTC m=+25.646340796" watchObservedRunningTime="2026-09-16 13:33:36.400647451 +0000 UTC m=+25.647525277"
Sep 16 13:33:37.210966 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:37.210925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:37.211158 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:37.210930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:37.211158 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:37.211061    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:37.211158 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:37.211130    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:38.211094 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:38.210914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:38.211489 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:38.211176    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:38.395972 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:38.395938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:38.396703 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:38.396685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:39.210861 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:39.210830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:39.211019 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:39.210924    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:39.211060 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:39.211019    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:39.211128 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:39.211110    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:39.396725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:39.396686    2563 generic.go:356] "Generic (PLEG): container finished" podID="09a12ca6-e32d-43b7-bfa4-ebd942adc292" containerID="5103241b9aaec4306212be8de6e27be2f48934b59903a50fcdaa479d2d11733b" exitCode=0
Sep 16 13:33:39.396887 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:39.396770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rn9p6" event={"ID":"09a12ca6-e32d-43b7-bfa4-ebd942adc292","Type":"ContainerDied","Data":"5103241b9aaec4306212be8de6e27be2f48934b59903a50fcdaa479d2d11733b"}
Sep 16 13:33:39.403185 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:39.402994    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" event={"ID":"7ff9b24b-c396-43a2-9a01-760b0b1b8dbc","Type":"ContainerStarted","Data":"91c8e2086889a22d2022b5536ea318b38bc0fca1b214b4ea270a0aa281ebf16f"}
Sep 16 13:33:39.403299 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:39.403281    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:39.403671 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:39.403656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wm54d"
Sep 16 13:33:39.437015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:39.436970    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr" podStartSLOduration=8.450239186 podStartE2EDuration="27.436957153s" totalImagesPullingTime="18.986717967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:39.43596359 +0000 UTC m=+28.682841452" watchObservedRunningTime="2026-09-16 13:33:39.436957153 +0000 UTC m=+28.683834977"
Sep 16 13:33:40.211101 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.211078    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:40.211226 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:40.211202    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:40.388549 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.388464    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gwjjm"]
Sep 16 13:33:40.391610 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.391583    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-27n7f"]
Sep 16 13:33:40.391730 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.391676    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:40.391793 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:40.391768    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:40.392225 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.392210    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kmgcm"]
Sep 16 13:33:40.392290 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.392280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:40.392394 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:40.392361    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:40.407698 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.407672    2563 generic.go:356] "Generic (PLEG): container finished" podID="09a12ca6-e32d-43b7-bfa4-ebd942adc292" containerID="36cd68962b6455da1ffe497007ef8c3b1fd3f18c2950b5f7d99f4343606e786f" exitCode=0
Sep 16 13:33:40.407801 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.407778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rn9p6" event={"ID":"09a12ca6-e32d-43b7-bfa4-ebd942adc292","Type":"ContainerDied","Data":"36cd68962b6455da1ffe497007ef8c3b1fd3f18c2950b5f7d99f4343606e786f"}
Sep 16 13:33:40.407859 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.407789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:40.408221 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:40.408056    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:40.408221 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.408195    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:40.408400 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.408261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:40.409136 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.408654    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:40.425575 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.425554    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:40.427790 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:40.427717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:33:41.411956 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:41.411923    2563 generic.go:356] "Generic (PLEG): container finished" podID="09a12ca6-e32d-43b7-bfa4-ebd942adc292" containerID="f8f4ea4821f4f940716f3bcd5530755f6775b0025660e43e109a537617d0abe2" exitCode=0
Sep 16 13:33:41.412339 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:41.411993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rn9p6" event={"ID":"09a12ca6-e32d-43b7-bfa4-ebd942adc292","Type":"ContainerDied","Data":"f8f4ea4821f4f940716f3bcd5530755f6775b0025660e43e109a537617d0abe2"}
Sep 16 13:33:42.210640 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:42.210617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:42.210757 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:42.210727    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:42.210757 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:42.210747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:42.210757 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:42.210623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:42.210910 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:42.210843    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:42.210962 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:42.210916    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:44.211141 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:44.210966    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:44.211577 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:44.210971    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:44.211577 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.211223    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:44.211577 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:44.210977    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:44.211577 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.211313    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:44.211577 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.211366    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:44.837784 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:44.837751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:44.838015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:44.837798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:44.838015 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.837895    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:33:44.838015 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.837886    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:44.838015 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.837909    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:33:44.838015 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.837918    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxnqr for pod openshift-network-diagnostics/network-check-target-27n7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:44.838015 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.837955    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret podName:5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:16.837939809 +0000 UTC m=+66.084817612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret") pod "global-pull-secret-syncer-gwjjm" (UID: "5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:33:44.838015 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.837969    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr podName:98edf2eb-520a-47ea-8b2c-6e3976f6b5e2 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:16.837962757 +0000 UTC m=+66.084840560 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxnqr" (UniqueName: "kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr") pod "network-check-target-27n7f" (UID: "98edf2eb-520a-47ea-8b2c-6e3976f6b5e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:33:44.939035 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:44.939003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:44.939175 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.939098    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:44.939175 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:44.939145    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs podName:da1a2822-eac6-413f-a0a4-e0609001d6f6 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:16.939132578 +0000 UTC m=+66.186010382 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs") pod "network-metrics-daemon-kmgcm" (UID: "da1a2822-eac6-413f-a0a4-e0609001d6f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:33:46.210981 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:46.210953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:46.211354 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:46.210995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:46.211354 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:46.211048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:46.211354 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:46.211056    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmgcm" podUID="da1a2822-eac6-413f-a0a4-e0609001d6f6"
Sep 16 13:33:46.211354 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:46.211136    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27n7f" podUID="98edf2eb-520a-47ea-8b2c-6e3976f6b5e2"
Sep 16 13:33:46.211354 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:46.211244    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwjjm" podUID="5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7"
Sep 16 13:33:46.983424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:46.983399    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeReady"
Sep 16 13:33:46.983572 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:46.983520    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 13:33:47.024412 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.023659    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g2cp9"]
Sep 16 13:33:47.034953 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.034932    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-95t95"]
Sep 16 13:33:47.035070 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.035052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.036898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.036876    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 13:33:47.037012 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.036981    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nnkqw\""
Sep 16 13:33:47.037137 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.037121    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 13:33:47.044871 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.044852    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g2cp9"]
Sep 16 13:33:47.044988 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.044882    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-95t95"]
Sep 16 13:33:47.044988 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.044957    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-95t95"
Sep 16 13:33:47.047330 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.046734    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 13:33:47.047330 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.047024    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 13:33:47.047330 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.047028    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 13:33:47.047330 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.047067    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2fr7x\""
Sep 16 13:33:47.154764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.154696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e3534a5-1569-4161-8c8d-f1766a07661f-tmp-dir\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.154764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.154731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6bfh\" (UniqueName: \"kubernetes.io/projected/7e3534a5-1569-4161-8c8d-f1766a07661f-kube-api-access-z6bfh\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.154764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.154754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.154986 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.154830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhdbc\" (UniqueName: \"kubernetes.io/projected/6579a61f-e766-47d4-8de5-b4fea959481a-kube-api-access-lhdbc\") pod \"ingress-canary-95t95\" (UID: \"6579a61f-e766-47d4-8de5-b4fea959481a\") " pod="openshift-ingress-canary/ingress-canary-95t95"
Sep 16 13:33:47.154986 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.154854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7e3534a5-1569-4161-8c8d-f1766a07661f-config-volume\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.154986 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.154869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6579a61f-e766-47d4-8de5-b4fea959481a-cert\") pod \"ingress-canary-95t95\" (UID: \"6579a61f-e766-47d4-8de5-b4fea959481a\") " pod="openshift-ingress-canary/ingress-canary-95t95"
Sep 16 13:33:47.255925 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.255901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e3534a5-1569-4161-8c8d-f1766a07661f-tmp-dir\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.255925 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.255929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6bfh\" (UniqueName: \"kubernetes.io/projected/7e3534a5-1569-4161-8c8d-f1766a07661f-kube-api-access-z6bfh\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.256406 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.255948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.256406 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.256000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhdbc\" (UniqueName: \"kubernetes.io/projected/6579a61f-e766-47d4-8de5-b4fea959481a-kube-api-access-lhdbc\") pod \"ingress-canary-95t95\" (UID: \"6579a61f-e766-47d4-8de5-b4fea959481a\") " pod="openshift-ingress-canary/ingress-canary-95t95"
Sep 16 13:33:47.256406 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.256015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7e3534a5-1569-4161-8c8d-f1766a07661f-config-volume\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.256406 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.256030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6579a61f-e766-47d4-8de5-b4fea959481a-cert\") pod \"ingress-canary-95t95\" (UID: \"6579a61f-e766-47d4-8de5-b4fea959481a\") " pod="openshift-ingress-canary/ingress-canary-95t95"
Sep 16 13:33:47.256406 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:47.256164    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:33:47.256406 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:47.256223    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls podName:7e3534a5-1569-4161-8c8d-f1766a07661f nodeName:}" failed. No retries permitted until 2026-09-16 13:33:47.756204081 +0000 UTC m=+37.003081885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls") pod "dns-default-g2cp9" (UID: "7e3534a5-1569-4161-8c8d-f1766a07661f") : secret "dns-default-metrics-tls" not found
Sep 16 13:33:47.256406 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.256217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e3534a5-1569-4161-8c8d-f1766a07661f-tmp-dir\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.256729 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.256609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7e3534a5-1569-4161-8c8d-f1766a07661f-config-volume\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.260185 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.260166    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6579a61f-e766-47d4-8de5-b4fea959481a-cert\") pod \"ingress-canary-95t95\" (UID: \"6579a61f-e766-47d4-8de5-b4fea959481a\") " pod="openshift-ingress-canary/ingress-canary-95t95"
Sep 16 13:33:47.265120 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.265102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6bfh\" (UniqueName: \"kubernetes.io/projected/7e3534a5-1569-4161-8c8d-f1766a07661f-kube-api-access-z6bfh\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.268940 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.268921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhdbc\" (UniqueName: \"kubernetes.io/projected/6579a61f-e766-47d4-8de5-b4fea959481a-kube-api-access-lhdbc\") pod \"ingress-canary-95t95\" (UID: \"6579a61f-e766-47d4-8de5-b4fea959481a\") " pod="openshift-ingress-canary/ingress-canary-95t95"
Sep 16 13:33:47.356460 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.356436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-95t95"
Sep 16 13:33:47.758946 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.758918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:47.759063 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:47.759025    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:33:47.759102 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:47.759076    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls podName:7e3534a5-1569-4161-8c8d-f1766a07661f nodeName:}" failed. No retries permitted until 2026-09-16 13:33:48.759062952 +0000 UTC m=+38.005940754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls") pod "dns-default-g2cp9" (UID: "7e3534a5-1569-4161-8c8d-f1766a07661f") : secret "dns-default-metrics-tls" not found
Sep 16 13:33:47.846399 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:47.846351    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-95t95"]
Sep 16 13:33:47.858201 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:47.858169    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6579a61f_e766_47d4_8de5_b4fea959481a.slice/crio-b00dc303b69c404aff4e931c6a2f3511f2899503a375701423ddb0930c11307f WatchSource:0}: Error finding container b00dc303b69c404aff4e931c6a2f3511f2899503a375701423ddb0930c11307f: Status 404 returned error can't find the container with id b00dc303b69c404aff4e931c6a2f3511f2899503a375701423ddb0930c11307f
Sep 16 13:33:48.210623 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.210597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:33:48.210623 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.210620    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:33:48.210833 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.210597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:33:48.213482 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.213462    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 13:33:48.213970 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.213947    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 13:33:48.214079 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.213970    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 13:33:48.214079 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.213989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 13:33:48.214079 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.213995    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cz7s\""
Sep 16 13:33:48.214079 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.213999    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-69tl6\""
Sep 16 13:33:48.430459 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.430430    2563 generic.go:356] "Generic (PLEG): container finished" podID="09a12ca6-e32d-43b7-bfa4-ebd942adc292" containerID="8314835b0d78d09b421566313a42d9b90aa8e43e61ce91fed32e716abbb121ce" exitCode=0
Sep 16 13:33:48.430985 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.430506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rn9p6" event={"ID":"09a12ca6-e32d-43b7-bfa4-ebd942adc292","Type":"ContainerDied","Data":"8314835b0d78d09b421566313a42d9b90aa8e43e61ce91fed32e716abbb121ce"}
Sep 16 13:33:48.431891 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.431863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-95t95" event={"ID":"6579a61f-e766-47d4-8de5-b4fea959481a","Type":"ContainerStarted","Data":"b00dc303b69c404aff4e931c6a2f3511f2899503a375701423ddb0930c11307f"}
Sep 16 13:33:48.766581 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:48.766495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:48.766708 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:48.766676    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:33:48.766768 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:48.766756    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls podName:7e3534a5-1569-4161-8c8d-f1766a07661f nodeName:}" failed. No retries permitted until 2026-09-16 13:33:50.766734089 +0000 UTC m=+40.013611898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls") pod "dns-default-g2cp9" (UID: "7e3534a5-1569-4161-8c8d-f1766a07661f") : secret "dns-default-metrics-tls" not found
Sep 16 13:33:49.438545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:49.438505    2563 generic.go:356] "Generic (PLEG): container finished" podID="09a12ca6-e32d-43b7-bfa4-ebd942adc292" containerID="26b3d116c81511d677148895d834d6bea3eeb9ebd48310987b4791f6500346ce" exitCode=0
Sep 16 13:33:49.439076 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:49.438583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rn9p6" event={"ID":"09a12ca6-e32d-43b7-bfa4-ebd942adc292","Type":"ContainerDied","Data":"26b3d116c81511d677148895d834d6bea3eeb9ebd48310987b4791f6500346ce"}
Sep 16 13:33:50.444780 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:50.444751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rn9p6" event={"ID":"09a12ca6-e32d-43b7-bfa4-ebd942adc292","Type":"ContainerStarted","Data":"046a38e25c5ffdc9b1b698a01dba1a194259b97e6c4bc23008d6031752511647"}
Sep 16 13:33:50.465087 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:50.465045    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rn9p6" podStartSLOduration=7.871657377 podStartE2EDuration="38.465027985s" totalImagesPullingTime="30.593370608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:50.463777658 +0000 UTC m=+39.710655485" watchObservedRunningTime="2026-09-16 13:33:50.465027985 +0000 UTC m=+39.711905809"
Sep 16 13:33:50.784047 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:50.783962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:50.784215 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:50.784123    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:33:50.784215 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:50.784200    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls podName:7e3534a5-1569-4161-8c8d-f1766a07661f nodeName:}" failed. No retries permitted until 2026-09-16 13:33:54.784179646 +0000 UTC m=+44.031057448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls") pod "dns-default-g2cp9" (UID: "7e3534a5-1569-4161-8c8d-f1766a07661f") : secret "dns-default-metrics-tls" not found
Sep 16 13:33:51.447888 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:51.447845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-95t95" event={"ID":"6579a61f-e766-47d4-8de5-b4fea959481a","Type":"ContainerStarted","Data":"3ab8519c92dc0d7155ce49d13befa1e255698bd3d794f774f9264350c9b40570"}
Sep 16 13:33:51.463066 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:51.463020    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-95t95" podStartSLOduration=1.927699959 podStartE2EDuration="4.463005081s" totalImagesPullingTime="2.535305122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:51.462805865 +0000 UTC m=+40.709683703" watchObservedRunningTime="2026-09-16 13:33:51.463005081 +0000 UTC m=+40.709882900"
Sep 16 13:33:53.482421 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.482215    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x"]
Sep 16 13:33:53.512092 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.512066    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"]
Sep 16 13:33:53.512231 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.512183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x"
Sep 16 13:33:53.514353 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.514328    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 16 13:33:53.514543 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.514515    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-252ds\""
Sep 16 13:33:53.514702 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.514684    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 16 13:33:53.532497 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.532478    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-cts8d"]
Sep 16 13:33:53.532613 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.532596    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:33:53.534546 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.534525    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vjpcc\""
Sep 16 13:33:53.534668 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.534558    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 16 13:33:53.534851 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.534815    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 16 13:33:53.534959 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.534942    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 16 13:33:53.556524 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.556499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x"]
Sep 16 13:33:53.556616 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.556533    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"]
Sep 16 13:33:53.556616 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.556558    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-cts8d"]
Sep 16 13:33:53.556703 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.556630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.558656 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.558636    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 16 13:33:53.558734 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.558637    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 16 13:33:53.558920 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.558905    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 16 13:33:53.558965 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.558947    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-44rd9\""
Sep 16 13:33:53.559442 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.559356    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 16 13:33:53.565859 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.565839    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 16 13:33:53.587528 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.587510    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-jksst"]
Sep 16 13:33:53.604413 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.604370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:33:53.604514 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.604421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvm4q\" (UniqueName: \"kubernetes.io/projected/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-kube-api-access-zvm4q\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:33:53.604514 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.604460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rdd5\" (UniqueName: \"kubernetes.io/projected/edd82d9a-5e3c-4edb-a375-c173259b158e-kube-api-access-4rdd5\") pod \"volume-data-source-validator-86695b7cc7-mxr7x\" (UID: \"edd82d9a-5e3c-4edb-a375-c173259b158e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x"
Sep 16 13:33:53.608549 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.608535    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-jksst"]
Sep 16 13:33:53.608625 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.608615    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.610704 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.610670    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 13:33:53.610930 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.610915    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lwcnw\""
Sep 16 13:33:53.611222 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.611188    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 13:33:53.611334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.611320    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 16 13:33:53.611796 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.611781    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 16 13:33:53.616354 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.616333    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 16 13:33:53.705352 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:33:53.705488 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvm4q\" (UniqueName: \"kubernetes.io/projected/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-kube-api-access-zvm4q\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:33:53.705488 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:53.705467    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 13:33:53.705558 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e26432-9ffc-4fa7-af88-a9ac82242fad-service-ca-bundle\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.705558 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:53.705529    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls podName:f0f1abb1-6510-4ad8-92f9-2fbe6324f042 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:54.205513224 +0000 UTC m=+43.452391029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-29qmx" (UID: "f0f1abb1-6510-4ad8-92f9-2fbe6324f042") : secret "samples-operator-tls" not found
Sep 16 13:33:53.705558 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-serving-cert\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.705706 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e26432-9ffc-4fa7-af88-a9ac82242fad-trusted-ca-bundle\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.705706 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rdd5\" (UniqueName: \"kubernetes.io/projected/edd82d9a-5e3c-4edb-a375-c173259b158e-kube-api-access-4rdd5\") pod \"volume-data-source-validator-86695b7cc7-mxr7x\" (UID: \"edd82d9a-5e3c-4edb-a375-c173259b158e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x"
Sep 16 13:33:53.705807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-config\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.705807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-trusted-ca\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.705807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705780    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c4fk\" (UniqueName: \"kubernetes.io/projected/27e26432-9ffc-4fa7-af88-a9ac82242fad-kube-api-access-8c4fk\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.705950 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27e26432-9ffc-4fa7-af88-a9ac82242fad-serving-cert\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.705950 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27e26432-9ffc-4fa7-af88-a9ac82242fad-tmp\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.705950 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqcth\" (UniqueName: \"kubernetes.io/projected/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-kube-api-access-gqcth\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.706068 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.705968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27e26432-9ffc-4fa7-af88-a9ac82242fad-snapshots\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.720042 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.720022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rdd5\" (UniqueName: \"kubernetes.io/projected/edd82d9a-5e3c-4edb-a375-c173259b158e-kube-api-access-4rdd5\") pod \"volume-data-source-validator-86695b7cc7-mxr7x\" (UID: \"edd82d9a-5e3c-4edb-a375-c173259b158e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x"
Sep 16 13:33:53.720139 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.720072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvm4q\" (UniqueName: \"kubernetes.io/projected/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-kube-api-access-zvm4q\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:33:53.807181 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.807117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqcth\" (UniqueName: \"kubernetes.io/projected/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-kube-api-access-gqcth\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.807181 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.807166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27e26432-9ffc-4fa7-af88-a9ac82242fad-snapshots\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.807322 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.807207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e26432-9ffc-4fa7-af88-a9ac82242fad-service-ca-bundle\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.807322 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.807222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-serving-cert\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.807322 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.807239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e26432-9ffc-4fa7-af88-a9ac82242fad-trusted-ca-bundle\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.807322 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.807278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-config\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.807322 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.807300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-trusted-ca\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.807576 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.807325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c4fk\" (UniqueName: \"kubernetes.io/projected/27e26432-9ffc-4fa7-af88-a9ac82242fad-kube-api-access-8c4fk\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.808047 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.808021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e26432-9ffc-4fa7-af88-a9ac82242fad-service-ca-bundle\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.808126 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.808025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-config\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.808126 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.808099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27e26432-9ffc-4fa7-af88-a9ac82242fad-snapshots\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.808207 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.808124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27e26432-9ffc-4fa7-af88-a9ac82242fad-serving-cert\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.808207 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.808165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27e26432-9ffc-4fa7-af88-a9ac82242fad-tmp\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.808491 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.808470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e26432-9ffc-4fa7-af88-a9ac82242fad-trusted-ca-bundle\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.808561 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.808523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27e26432-9ffc-4fa7-af88-a9ac82242fad-tmp\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.808606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.808566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-trusted-ca\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.810343 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.810321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27e26432-9ffc-4fa7-af88-a9ac82242fad-serving-cert\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.814817 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.814794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c4fk\" (UniqueName: \"kubernetes.io/projected/27e26432-9ffc-4fa7-af88-a9ac82242fad-kube-api-access-8c4fk\") pod \"insights-operator-5844b856db-jksst\" (UID: \"27e26432-9ffc-4fa7-af88-a9ac82242fad\") " pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:53.815152 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.815133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqcth\" (UniqueName: \"kubernetes.io/projected/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-kube-api-access-gqcth\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.821931 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.821910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x"
Sep 16 13:33:53.822088 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.822073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35c1c44d-b926-4f14-8bfe-d3fea957a5c4-serving-cert\") pod \"console-operator-696884fb9c-cts8d\" (UID: \"35c1c44d-b926-4f14-8bfe-d3fea957a5c4\") " pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.867576 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.867555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:33:53.917679 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:53.917654    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-jksst"
Sep 16 13:33:54.128281 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:54.128255    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x"]
Sep 16 13:33:54.131287 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:54.131264    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd82d9a_5e3c_4edb_a375_c173259b158e.slice/crio-de8a54c3d3c399a782c145a8cab1ee2480e5e3485a43cc72894f06e621c60b37 WatchSource:0}: Error finding container de8a54c3d3c399a782c145a8cab1ee2480e5e3485a43cc72894f06e621c60b37: Status 404 returned error can't find the container with id de8a54c3d3c399a782c145a8cab1ee2480e5e3485a43cc72894f06e621c60b37
Sep 16 13:33:54.169639 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:54.169613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-cts8d"]
Sep 16 13:33:54.172731 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:54.172711    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c1c44d_b926_4f14_8bfe_d3fea957a5c4.slice/crio-c368e10ed2c51ed09da7bdeef492b0a202a994c32194d8e1ada9287a827594cf WatchSource:0}: Error finding container c368e10ed2c51ed09da7bdeef492b0a202a994c32194d8e1ada9287a827594cf: Status 404 returned error can't find the container with id c368e10ed2c51ed09da7bdeef492b0a202a994c32194d8e1ada9287a827594cf
Sep 16 13:33:54.209093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:54.209063    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-jksst"]
Sep 16 13:33:54.211326 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:54.211302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:33:54.211451 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:54.211430    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 13:33:54.211512 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:54.211488    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls podName:f0f1abb1-6510-4ad8-92f9-2fbe6324f042 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:55.211474652 +0000 UTC m=+44.458352455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-29qmx" (UID: "f0f1abb1-6510-4ad8-92f9-2fbe6324f042") : secret "samples-operator-tls" not found
Sep 16 13:33:54.212284 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:33:54.212260    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e26432_9ffc_4fa7_af88_a9ac82242fad.slice/crio-4672201b7aa71fed37e3aa55235ed66b7e7932530b1cc51e4f537ed20577b45b WatchSource:0}: Error finding container 4672201b7aa71fed37e3aa55235ed66b7e7932530b1cc51e4f537ed20577b45b: Status 404 returned error can't find the container with id 4672201b7aa71fed37e3aa55235ed66b7e7932530b1cc51e4f537ed20577b45b
Sep 16 13:33:54.456541 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:54.456448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-jksst" event={"ID":"27e26432-9ffc-4fa7-af88-a9ac82242fad","Type":"ContainerStarted","Data":"4672201b7aa71fed37e3aa55235ed66b7e7932530b1cc51e4f537ed20577b45b"}
Sep 16 13:33:54.457619 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:54.457587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cts8d" event={"ID":"35c1c44d-b926-4f14-8bfe-d3fea957a5c4","Type":"ContainerStarted","Data":"c368e10ed2c51ed09da7bdeef492b0a202a994c32194d8e1ada9287a827594cf"}
Sep 16 13:33:54.458672 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:54.458654    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x" event={"ID":"edd82d9a-5e3c-4edb-a375-c173259b158e","Type":"ContainerStarted","Data":"de8a54c3d3c399a782c145a8cab1ee2480e5e3485a43cc72894f06e621c60b37"}
Sep 16 13:33:54.816365 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:54.816287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:33:54.816716 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:54.816419    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:33:54.816716 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:54.816486    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls podName:7e3534a5-1569-4161-8c8d-f1766a07661f nodeName:}" failed. No retries permitted until 2026-09-16 13:34:02.816469035 +0000 UTC m=+52.063346855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls") pod "dns-default-g2cp9" (UID: "7e3534a5-1569-4161-8c8d-f1766a07661f") : secret "dns-default-metrics-tls" not found
Sep 16 13:33:55.219080 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:55.219052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:33:55.219223 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:55.219210    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 13:33:55.219289 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:55.219282    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls podName:f0f1abb1-6510-4ad8-92f9-2fbe6324f042 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:57.219264553 +0000 UTC m=+46.466142557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-29qmx" (UID: "f0f1abb1-6510-4ad8-92f9-2fbe6324f042") : secret "samples-operator-tls" not found
Sep 16 13:33:57.232843 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:57.232751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:33:57.233304 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:57.232921    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 13:33:57.233304 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:57.233005    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls podName:f0f1abb1-6510-4ad8-92f9-2fbe6324f042 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:01.232982943 +0000 UTC m=+50.479860766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-29qmx" (UID: "f0f1abb1-6510-4ad8-92f9-2fbe6324f042") : secret "samples-operator-tls" not found
Sep 16 13:33:57.472760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:57.472722    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x" event={"ID":"edd82d9a-5e3c-4edb-a375-c173259b158e","Type":"ContainerStarted","Data":"cc8f62296cfba8f2fd65a012e3741a9fcb13b586ff8f7b91e393bf4ea447b98d"}
Sep 16 13:33:57.474303 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:57.474268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-jksst" event={"ID":"27e26432-9ffc-4fa7-af88-a9ac82242fad","Type":"ContainerStarted","Data":"1f964810e5d549c608a368486a1ab8cde36f9c2fa90e594ee7b4855a8a9aa32a"}
Sep 16 13:33:57.488609 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:57.488523    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-mxr7x" podStartSLOduration=2.057781295 podStartE2EDuration="4.488508149s" totalImagesPullingTime="2.430726854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:57.487853121 +0000 UTC m=+46.734730959" watchObservedRunningTime="2026-09-16 13:33:57.488508149 +0000 UTC m=+46.735385973"
Sep 16 13:33:57.505195 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:57.504755    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-jksst" podStartSLOduration=1.813602719 podStartE2EDuration="4.504734683s" totalImagesPullingTime="2.691131964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:33:57.504125858 +0000 UTC m=+46.751003686" watchObservedRunningTime="2026-09-16 13:33:57.504734683 +0000 UTC m=+46.751612509"
Sep 16 13:33:58.478530 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.478502    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/0.log"
Sep 16 13:33:58.478926 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.478539    2563 generic.go:356] "Generic (PLEG): container finished" podID="35c1c44d-b926-4f14-8bfe-d3fea957a5c4" containerID="d6d46534bc13e50834bd55d029e33fd1afcc3c323668d825adfb4a9cbb6fd769" exitCode=255
Sep 16 13:33:58.478926 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.478566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cts8d" event={"ID":"35c1c44d-b926-4f14-8bfe-d3fea957a5c4","Type":"ContainerDied","Data":"d6d46534bc13e50834bd55d029e33fd1afcc3c323668d825adfb4a9cbb6fd769"}
Sep 16 13:33:58.479061 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.479006    2563 scope.go:117] "RemoveContainer" containerID="d6d46534bc13e50834bd55d029e33fd1afcc3c323668d825adfb4a9cbb6fd769"
Sep 16 13:33:58.720675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.720648    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tvbc8"]
Sep 16 13:33:58.736728 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.736669    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvbc8"]
Sep 16 13:33:58.736834 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.736785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.738831 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.738807    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 13:33:58.739054 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.739036    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 13:33:58.739134 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.739039    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sjsnp\""
Sep 16 13:33:58.847410 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.847364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdvjx\" (UniqueName: \"kubernetes.io/projected/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-api-access-cdvjx\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.847528 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.847491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cb91846-1e86-41fa-8f57-2d028d961b10-data-volume\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.847528 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.847517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.847592 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.847538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cb91846-1e86-41fa-8f57-2d028d961b10-crio-socket\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.847592 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.847567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.948432 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.948403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdvjx\" (UniqueName: \"kubernetes.io/projected/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-api-access-cdvjx\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.948534 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.948472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cb91846-1e86-41fa-8f57-2d028d961b10-data-volume\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.948595 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.948575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.948652 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.948611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cb91846-1e86-41fa-8f57-2d028d961b10-crio-socket\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.948652 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.948643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.951791 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:58.948786    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 13:33:58.951791 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:58.949080    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:33:58.951791 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.948905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cb91846-1e86-41fa-8f57-2d028d961b10-data-volume\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.951791 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:58.949158    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:59.449127807 +0000 UTC m=+48.696005616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:33:58.951791 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.949152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cb91846-1e86-41fa-8f57-2d028d961b10-crio-socket\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:58.951791 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:58.949198    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:33:59.449170487 +0000 UTC m=+48.696048295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : configmap "kube-rbac-proxy" not found
Sep 16 13:33:58.958390 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:58.958345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdvjx\" (UniqueName: \"kubernetes.io/projected/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-api-access-cdvjx\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:59.452988 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:59.452957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:59.453154 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:59.453001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:33:59.453154 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:59.453071    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 13:33:59.453154 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:59.453110    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:33:59.453154 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:59.453115    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:00.45310281 +0000 UTC m=+49.699980613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : configmap "kube-rbac-proxy" not found
Sep 16 13:33:59.453290 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:59.453207    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:00.453195191 +0000 UTC m=+49.700072994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:33:59.482566 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:59.482541    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:33:59.482936 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:59.482922    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/0.log"
Sep 16 13:33:59.482993 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:59.482958    2563 generic.go:356] "Generic (PLEG): container finished" podID="35c1c44d-b926-4f14-8bfe-d3fea957a5c4" containerID="f48338241efaaccc65b7765ef161cd5cffe2e2648838df570d2e7bec69a10980" exitCode=255
Sep 16 13:33:59.483043 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:59.482992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cts8d" event={"ID":"35c1c44d-b926-4f14-8bfe-d3fea957a5c4","Type":"ContainerDied","Data":"f48338241efaaccc65b7765ef161cd5cffe2e2648838df570d2e7bec69a10980"}
Sep 16 13:33:59.483088 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:59.483063    2563 scope.go:117] "RemoveContainer" containerID="d6d46534bc13e50834bd55d029e33fd1afcc3c323668d825adfb4a9cbb6fd769"
Sep 16 13:33:59.483234 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:33:59.483211    2563 scope.go:117] "RemoveContainer" containerID="f48338241efaaccc65b7765ef161cd5cffe2e2648838df570d2e7bec69a10980"
Sep 16 13:33:59.483417 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:33:59.483398    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-cts8d_openshift-console-operator(35c1c44d-b926-4f14-8bfe-d3fea957a5c4)\"" pod="openshift-console-operator/console-operator-696884fb9c-cts8d" podUID="35c1c44d-b926-4f14-8bfe-d3fea957a5c4"
Sep 16 13:34:00.459758 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.459724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:00.459968 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.459802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:00.459968 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:00.459883    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:34:00.459968 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:00.459930    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 13:34:00.459968 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:00.459962    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:02.459941802 +0000 UTC m=+51.706819605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:34:00.460128 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:00.459986    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:02.459974378 +0000 UTC m=+51.706852182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : configmap "kube-rbac-proxy" not found
Sep 16 13:34:00.486789 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.486767    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:34:00.487114 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.487094    2563 scope.go:117] "RemoveContainer" containerID="f48338241efaaccc65b7765ef161cd5cffe2e2648838df570d2e7bec69a10980"
Sep 16 13:34:00.487261 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:00.487243    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-cts8d_openshift-console-operator(35c1c44d-b926-4f14-8bfe-d3fea957a5c4)\"" pod="openshift-console-operator/console-operator-696884fb9c-cts8d" podUID="35c1c44d-b926-4f14-8bfe-d3fea957a5c4"
Sep 16 13:34:00.655546 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.655520    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q88zn_2ce2d887-1482-4f90-bfc0-742e2b7a6dc9/dns-node-resolver/0.log"
Sep 16 13:34:00.666353 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.666329    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2"]
Sep 16 13:34:00.671855 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.671839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2"
Sep 16 13:34:00.673920 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.673890    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 16 13:34:00.673920 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.673912    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ls2n6\""
Sep 16 13:34:00.674069 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.673968    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 16 13:34:00.678018 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.678002    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2"]
Sep 16 13:34:00.762158 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.762092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-225c2\" (UniqueName: \"kubernetes.io/projected/b00d773f-c5c8-43c3-a261-95602e8175f5-kube-api-access-225c2\") pod \"migrator-8b4d697c5-nwkm2\" (UID: \"b00d773f-c5c8-43c3-a261-95602e8175f5\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2"
Sep 16 13:34:00.862944 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.862912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-225c2\" (UniqueName: \"kubernetes.io/projected/b00d773f-c5c8-43c3-a261-95602e8175f5-kube-api-access-225c2\") pod \"migrator-8b4d697c5-nwkm2\" (UID: \"b00d773f-c5c8-43c3-a261-95602e8175f5\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2"
Sep 16 13:34:00.870233 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.870209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-225c2\" (UniqueName: \"kubernetes.io/projected/b00d773f-c5c8-43c3-a261-95602e8175f5-kube-api-access-225c2\") pod \"migrator-8b4d697c5-nwkm2\" (UID: \"b00d773f-c5c8-43c3-a261-95602e8175f5\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2"
Sep 16 13:34:00.981283 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:00.981247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2"
Sep 16 13:34:01.256063 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:01.256032    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2"]
Sep 16 13:34:01.258985 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:01.258958    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dvxnq_6a955d66-0e9e-4f78-b842-e74b42cde550/node-ca/0.log"
Sep 16 13:34:01.259320 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:01.259299    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00d773f_c5c8_43c3_a261_95602e8175f5.slice/crio-6cd8afcb78cd28dcdeb5c56d64b2198c4e5f26b4233c4f1af1c82a153e21bb77 WatchSource:0}: Error finding container 6cd8afcb78cd28dcdeb5c56d64b2198c4e5f26b4233c4f1af1c82a153e21bb77: Status 404 returned error can't find the container with id 6cd8afcb78cd28dcdeb5c56d64b2198c4e5f26b4233c4f1af1c82a153e21bb77
Sep 16 13:34:01.265713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:01.265692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:34:01.265808 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:01.265796    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 13:34:01.265847 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:01.265840    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls podName:f0f1abb1-6510-4ad8-92f9-2fbe6324f042 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:09.265827779 +0000 UTC m=+58.512705583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-29qmx" (UID: "f0f1abb1-6510-4ad8-92f9-2fbe6324f042") : secret "samples-operator-tls" not found
Sep 16 13:34:01.490775 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:01.490735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2" event={"ID":"b00d773f-c5c8-43c3-a261-95602e8175f5","Type":"ContainerStarted","Data":"6cd8afcb78cd28dcdeb5c56d64b2198c4e5f26b4233c4f1af1c82a153e21bb77"}
Sep 16 13:34:02.058513 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:02.058467    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-95t95_6579a61f-e766-47d4-8de5-b4fea959481a/serve-healthcheck-canary/0.log"
Sep 16 13:34:02.474501 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:02.474455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:02.474501 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:02.474511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:02.474783 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:02.474612    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 13:34:02.474783 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:02.474641    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:34:02.474783 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:02.474670    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:06.474653165 +0000 UTC m=+55.721530968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : configmap "kube-rbac-proxy" not found
Sep 16 13:34:02.474783 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:02.474708    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:06.474689921 +0000 UTC m=+55.721567739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:34:02.877665 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:02.877634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:34:02.878013 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:02.877795    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:34:02.878013 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:02.877855    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls podName:7e3534a5-1569-4161-8c8d-f1766a07661f nodeName:}" failed. No retries permitted until 2026-09-16 13:34:18.877839838 +0000 UTC m=+68.124717647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls") pod "dns-default-g2cp9" (UID: "7e3534a5-1569-4161-8c8d-f1766a07661f") : secret "dns-default-metrics-tls" not found
Sep 16 13:34:03.497315 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:03.497227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2" event={"ID":"b00d773f-c5c8-43c3-a261-95602e8175f5","Type":"ContainerStarted","Data":"0b935a931b992a8c2afbd4b40ffb95a7bd61cb4e08b6c00a73857973493e9d58"}
Sep 16 13:34:03.497315 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:03.497285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2" event={"ID":"b00d773f-c5c8-43c3-a261-95602e8175f5","Type":"ContainerStarted","Data":"9d4a57078e8bb39b779fb029665c934cf0037766e0a9c6ecb00089b4bde1791c"}
Sep 16 13:34:03.512507 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:03.512464    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-nwkm2" podStartSLOduration=1.743831973 podStartE2EDuration="3.512449568s" totalImagesPullingTime="1.768617595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:03.511551249 +0000 UTC m=+52.758429087" watchObservedRunningTime="2026-09-16 13:34:03.512449568 +0000 UTC m=+52.759327392"
Sep 16 13:34:03.868506 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:03.868429    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:34:03.868506 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:03.868488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:34:03.868836 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:03.868824    2563 scope.go:117] "RemoveContainer" containerID="f48338241efaaccc65b7765ef161cd5cffe2e2648838df570d2e7bec69a10980"
Sep 16 13:34:03.868982 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:03.868964    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-cts8d_openshift-console-operator(35c1c44d-b926-4f14-8bfe-d3fea957a5c4)\"" pod="openshift-console-operator/console-operator-696884fb9c-cts8d" podUID="35c1c44d-b926-4f14-8bfe-d3fea957a5c4"
Sep 16 13:34:06.508431 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:06.508403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:06.508431 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:06.508444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:06.508844 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:06.508515    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 13:34:06.508844 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:06.508542    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:34:06.508844 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:06.508573    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:14.508556997 +0000 UTC m=+63.755434820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : configmap "kube-rbac-proxy" not found
Sep 16 13:34:06.508844 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:06.508605    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls podName:0cb91846-1e86-41fa-8f57-2d028d961b10 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:14.508591537 +0000 UTC m=+63.755469340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvbc8" (UID: "0cb91846-1e86-41fa-8f57-2d028d961b10") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:34:09.329632 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:09.329593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:34:09.332138 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:09.332116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0f1abb1-6510-4ad8-92f9-2fbe6324f042-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-29qmx\" (UID: \"f0f1abb1-6510-4ad8-92f9-2fbe6324f042\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:34:09.440580 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:09.440545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"
Sep 16 13:34:09.707763 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:09.707736    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx"]
Sep 16 13:34:10.521433 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:10.521400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx" event={"ID":"f0f1abb1-6510-4ad8-92f9-2fbe6324f042","Type":"ContainerStarted","Data":"6ba8e768507ac367fca0cac23db4c16599f519927bb644d1bbb6c776f5bc8a73"}
Sep 16 13:34:12.425825 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:12.425799    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44ltr"
Sep 16 13:34:12.529240 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:12.529214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx" event={"ID":"f0f1abb1-6510-4ad8-92f9-2fbe6324f042","Type":"ContainerStarted","Data":"35ce86aaf8b809453b7bad2c44a79b2a43b89dbd2f00ae152d689d6815723181"}
Sep 16 13:34:12.529328 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:12.529263    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx" event={"ID":"f0f1abb1-6510-4ad8-92f9-2fbe6324f042","Type":"ContainerStarted","Data":"2bf2b189cc42e2e7dab2c6ac32dcaf7efa659294421ea56f5b9de4963c5541a6"}
Sep 16 13:34:12.545391 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:12.545320    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-29qmx" podStartSLOduration=16.919152073 podStartE2EDuration="19.545298267s" totalImagesPullingTime="2.626146194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:12.544458047 +0000 UTC m=+61.791335877" watchObservedRunningTime="2026-09-16 13:34:12.545298267 +0000 UTC m=+61.792176095"
Sep 16 13:34:14.573592 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:14.573558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:14.573938 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:14.573604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:14.574043 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:14.574027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cb91846-1e86-41fa-8f57-2d028d961b10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:14.575972 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:14.575940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cb91846-1e86-41fa-8f57-2d028d961b10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvbc8\" (UID: \"0cb91846-1e86-41fa-8f57-2d028d961b10\") " pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:14.647382 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:14.647355    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sjsnp\""
Sep 16 13:34:14.655892 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:14.655874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvbc8"
Sep 16 13:34:14.923248 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:14.923217    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvbc8"]
Sep 16 13:34:14.926654 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:14.926629    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb91846_1e86_41fa_8f57_2d028d961b10.slice/crio-6ca7f61c966c52de247d1fd3672e8975e33fc4d5a7229dc838fe0232b5381c77 WatchSource:0}: Error finding container 6ca7f61c966c52de247d1fd3672e8975e33fc4d5a7229dc838fe0232b5381c77: Status 404 returned error can't find the container with id 6ca7f61c966c52de247d1fd3672e8975e33fc4d5a7229dc838fe0232b5381c77
Sep 16 13:34:15.540340 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:15.540304    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvbc8" event={"ID":"0cb91846-1e86-41fa-8f57-2d028d961b10","Type":"ContainerStarted","Data":"9d1f1e6e9547064d7c6e87f5b9fd0af7e4cb1bfe681da04986953ac3efd223c1"}
Sep 16 13:34:15.540522 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:15.540360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvbc8" event={"ID":"0cb91846-1e86-41fa-8f57-2d028d961b10","Type":"ContainerStarted","Data":"6ca7f61c966c52de247d1fd3672e8975e33fc4d5a7229dc838fe0232b5381c77"}
Sep 16 13:34:16.545041 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.545008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvbc8" event={"ID":"0cb91846-1e86-41fa-8f57-2d028d961b10","Type":"ContainerStarted","Data":"264dddd0d4322336f454e47c1a21f18a6acc7bd9a4e4d0d0c49a6ebe40774365"}
Sep 16 13:34:16.886781 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.886743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:34:16.887118 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.886828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:34:16.889143 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.889080    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 13:34:16.889143 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.889136    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 13:34:16.899901 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.899878    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 13:34:16.900548 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.900527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7-original-pull-secret\") pod \"global-pull-secret-syncer-gwjjm\" (UID: \"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7\") " pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:34:16.910916 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.910895    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxnqr\" (UniqueName: \"kubernetes.io/projected/98edf2eb-520a-47ea-8b2c-6e3976f6b5e2-kube-api-access-wxnqr\") pod \"network-check-target-27n7f\" (UID: \"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2\") " pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:34:16.987883 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.987854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:34:16.989883 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:16.989863    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 13:34:17.000741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:17.000720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da1a2822-eac6-413f-a0a4-e0609001d6f6-metrics-certs\") pod \"network-metrics-daemon-kmgcm\" (UID: \"da1a2822-eac6-413f-a0a4-e0609001d6f6\") " pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:34:17.021633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:17.021615    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-69tl6\""
Sep 16 13:34:17.026953 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:17.026938    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cz7s\""
Sep 16 13:34:17.030522 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:17.030489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwjjm"
Sep 16 13:34:17.030627 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:17.030607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:34:17.035709 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:17.035691    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmgcm"
Sep 16 13:34:17.759390 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:17.759284    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-27n7f"]
Sep 16 13:34:17.763038 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:17.763017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kmgcm"]
Sep 16 13:34:17.763825 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:17.763793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gwjjm"]
Sep 16 13:34:17.833091 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:17.833058    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98edf2eb_520a_47ea_8b2c_6e3976f6b5e2.slice/crio-d7b905a43c07d1037577b852c9e5441cc9e9b7ab8035f6f5be0c798a0c44d5d0 WatchSource:0}: Error finding container d7b905a43c07d1037577b852c9e5441cc9e9b7ab8035f6f5be0c798a0c44d5d0: Status 404 returned error can't find the container with id d7b905a43c07d1037577b852c9e5441cc9e9b7ab8035f6f5be0c798a0c44d5d0
Sep 16 13:34:17.833762 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:17.833742    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7b1004_d23b_485b_ab34_ea5d2ec5c0c7.slice/crio-6b7c1362b6aabf3b0b86cb31559b57ed22a15ea47da35957dd964a8f970471d6 WatchSource:0}: Error finding container 6b7c1362b6aabf3b0b86cb31559b57ed22a15ea47da35957dd964a8f970471d6: Status 404 returned error can't find the container with id 6b7c1362b6aabf3b0b86cb31559b57ed22a15ea47da35957dd964a8f970471d6
Sep 16 13:34:17.834649 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:17.834624    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1a2822_eac6_413f_a0a4_e0609001d6f6.slice/crio-4c1bfdba06696e2127729c37e6df356e600fc2f587e9474d12a87d88a9aa37a5 WatchSource:0}: Error finding container 4c1bfdba06696e2127729c37e6df356e600fc2f587e9474d12a87d88a9aa37a5: Status 404 returned error can't find the container with id 4c1bfdba06696e2127729c37e6df356e600fc2f587e9474d12a87d88a9aa37a5
Sep 16 13:34:18.211662 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.211639    2563 scope.go:117] "RemoveContainer" containerID="f48338241efaaccc65b7765ef161cd5cffe2e2648838df570d2e7bec69a10980"
Sep 16 13:34:18.557715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.557635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvbc8" event={"ID":"0cb91846-1e86-41fa-8f57-2d028d961b10","Type":"ContainerStarted","Data":"ae0d037865cef3b15215a0902580f9b5653ca7b319ab4faca18e2df5923a7d0d"}
Sep 16 13:34:18.558934 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.558907    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kmgcm" event={"ID":"da1a2822-eac6-413f-a0a4-e0609001d6f6","Type":"ContainerStarted","Data":"4c1bfdba06696e2127729c37e6df356e600fc2f587e9474d12a87d88a9aa37a5"}
Sep 16 13:34:18.562572 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.562554    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:34:18.562674 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.562621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cts8d" event={"ID":"35c1c44d-b926-4f14-8bfe-d3fea957a5c4","Type":"ContainerStarted","Data":"bbc13ce318ff76e7cba28153f9bb3a8cb7ab7086566424161fafe45869acbd47"}
Sep 16 13:34:18.562884 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.562863    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:34:18.563893 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.563875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gwjjm" event={"ID":"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7","Type":"ContainerStarted","Data":"6b7c1362b6aabf3b0b86cb31559b57ed22a15ea47da35957dd964a8f970471d6"}
Sep 16 13:34:18.565081 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.565061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-27n7f" event={"ID":"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2","Type":"ContainerStarted","Data":"d7b905a43c07d1037577b852c9e5441cc9e9b7ab8035f6f5be0c798a0c44d5d0"}
Sep 16 13:34:18.578325 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.578279    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tvbc8" podStartSLOduration=17.766032097 podStartE2EDuration="20.578264645s" totalImagesPullingTime="2.812232548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:18.578175266 +0000 UTC m=+67.825053128" watchObservedRunningTime="2026-09-16 13:34:18.578264645 +0000 UTC m=+67.825142468"
Sep 16 13:34:18.594117 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.594071    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-cts8d" podStartSLOduration=21.736461895 podStartE2EDuration="25.594055733s" totalImagesPullingTime="3.857593838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:18.593361688 +0000 UTC m=+67.840239513" watchObservedRunningTime="2026-09-16 13:34:18.594055733 +0000 UTC m=+67.840933561"
Sep 16 13:34:18.902188 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.902156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:34:18.905024 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:18.904990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e3534a5-1569-4161-8c8d-f1766a07661f-metrics-tls\") pod \"dns-default-g2cp9\" (UID: \"7e3534a5-1569-4161-8c8d-f1766a07661f\") " pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:34:19.127466 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.127132    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-cts8d"
Sep 16 13:34:19.149758 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.149571    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nnkqw\""
Sep 16 13:34:19.158753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.158525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:34:19.470775 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.470692    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g2cp9"]
Sep 16 13:34:19.476562 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:19.476520    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3534a5_1569_4161_8c8d_f1766a07661f.slice/crio-1ded14c967eeb380373efa929bb9d8081f810d6e7414a0b592d06af55f6626be WatchSource:0}: Error finding container 1ded14c967eeb380373efa929bb9d8081f810d6e7414a0b592d06af55f6626be: Status 404 returned error can't find the container with id 1ded14c967eeb380373efa929bb9d8081f810d6e7414a0b592d06af55f6626be
Sep 16 13:34:19.571074 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.571040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g2cp9" event={"ID":"7e3534a5-1569-4161-8c8d-f1766a07661f","Type":"ContainerStarted","Data":"1ded14c967eeb380373efa929bb9d8081f810d6e7414a0b592d06af55f6626be"}
Sep 16 13:34:19.956331 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.956039    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b7b54869b-sxf4d"]
Sep 16 13:34:19.961401 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.961354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:19.964524 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.964233    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 13:34:19.964524 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.964331    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 13:34:19.964680 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.964578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 13:34:19.965431 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.965241    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c5bs9\""
Sep 16 13:34:19.971081 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.971062    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 13:34:19.986932 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.986859    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b7b54869b-sxf4d"]
Sep 16 13:34:19.997438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:19.997142    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b7b54869b-sxf4d"]
Sep 16 13:34:19.997438 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:19.997394    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-9cz8s registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-9cz8s registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-b7b54869b-sxf4d" podUID="c8294d38-30f9-48cf-9638-fb4814417779"
Sep 16 13:34:20.012060 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.011981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8294d38-30f9-48cf-9638-fb4814417779-ca-trust-extracted\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.012060 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.012037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-installation-pull-secrets\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.012241 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.012083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-registry-tls\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.012241 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.012106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-bound-sa-token\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.012241 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.012165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-image-registry-private-configuration\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.012241 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.012201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-trusted-ca\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.012465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.012293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cz8s\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-kube-api-access-9cz8s\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.012465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.012330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-registry-certificates\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.051746 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.051718    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-mszlq"]
Sep 16 13:34:20.056237 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.056216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-mszlq"
Sep 16 13:34:20.058646 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.058624    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-w4v5t\""
Sep 16 13:34:20.058770 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.058655    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 13:34:20.058770 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.058655    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 13:34:20.069962 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.069940    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-mszlq"]
Sep 16 13:34:20.114261 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.114205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cz8s\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-kube-api-access-9cz8s\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.114261 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.114252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-registry-certificates\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.114476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.114273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8294d38-30f9-48cf-9638-fb4814417779-ca-trust-extracted\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.114476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.114300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmmdh\" (UniqueName: \"kubernetes.io/projected/3561d972-ac2d-4ba0-8a44-ab82ee44527c-kube-api-access-bmmdh\") pod \"downloads-76f99584f4-mszlq\" (UID: \"3561d972-ac2d-4ba0-8a44-ab82ee44527c\") " pod="openshift-console/downloads-76f99584f4-mszlq"
Sep 16 13:34:20.114476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.114331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-installation-pull-secrets\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.114476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.114356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-registry-tls\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.114476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.114397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-bound-sa-token\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.114476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.114424    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-image-registry-private-configuration\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.114476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.114454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-trusted-ca\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.119239 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.118900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-registry-tls\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.119239 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.118993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-registry-certificates\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.119605 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.119582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8294d38-30f9-48cf-9638-fb4814417779-ca-trust-extracted\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.120620 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.120597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-image-registry-private-configuration\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.120938 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.120852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-trusted-ca\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.124009 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.123982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-installation-pull-secrets\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.128118 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.128076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-bound-sa-token\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.130286 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.130255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cz8s\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-kube-api-access-9cz8s\") pod \"image-registry-b7b54869b-sxf4d\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") " pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.215358 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.215330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmmdh\" (UniqueName: \"kubernetes.io/projected/3561d972-ac2d-4ba0-8a44-ab82ee44527c-kube-api-access-bmmdh\") pod \"downloads-76f99584f4-mszlq\" (UID: \"3561d972-ac2d-4ba0-8a44-ab82ee44527c\") " pod="openshift-console/downloads-76f99584f4-mszlq"
Sep 16 13:34:20.227423 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.227394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmmdh\" (UniqueName: \"kubernetes.io/projected/3561d972-ac2d-4ba0-8a44-ab82ee44527c-kube-api-access-bmmdh\") pod \"downloads-76f99584f4-mszlq\" (UID: \"3561d972-ac2d-4ba0-8a44-ab82ee44527c\") " pod="openshift-console/downloads-76f99584f4-mszlq"
Sep 16 13:34:20.389176 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.388947    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-mszlq"
Sep 16 13:34:20.579986 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.579935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kmgcm" event={"ID":"da1a2822-eac6-413f-a0a4-e0609001d6f6","Type":"ContainerStarted","Data":"00ec1ae7c726c66a5e305fc65b08fcf8f5017ce9b046304e8f20cb1077d1eab4"}
Sep 16 13:34:20.580169 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.580036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kmgcm" event={"ID":"da1a2822-eac6-413f-a0a4-e0609001d6f6","Type":"ContainerStarted","Data":"480d11552974a4d3624a7ff77132bf442ac159420f580f8a43f538654c080cd7"}
Sep 16 13:34:20.580394 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.580344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.588694 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.588672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:20.618516 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.618454    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-installation-pull-secrets\") pod \"c8294d38-30f9-48cf-9638-fb4814417779\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") "
Sep 16 13:34:20.618696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.618536    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-registry-certificates\") pod \"c8294d38-30f9-48cf-9638-fb4814417779\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") "
Sep 16 13:34:20.618696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.618612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-bound-sa-token\") pod \"c8294d38-30f9-48cf-9638-fb4814417779\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") "
Sep 16 13:34:20.618816 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.618705    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8294d38-30f9-48cf-9638-fb4814417779-ca-trust-extracted\") pod \"c8294d38-30f9-48cf-9638-fb4814417779\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") "
Sep 16 13:34:20.618816 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.618759    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-image-registry-private-configuration\") pod \"c8294d38-30f9-48cf-9638-fb4814417779\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") "
Sep 16 13:34:20.618816 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.618812    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cz8s\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-kube-api-access-9cz8s\") pod \"c8294d38-30f9-48cf-9638-fb4814417779\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") "
Sep 16 13:34:20.619019 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.618842    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-trusted-ca\") pod \"c8294d38-30f9-48cf-9638-fb4814417779\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") "
Sep 16 13:34:20.619019 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.618894    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-registry-tls\") pod \"c8294d38-30f9-48cf-9638-fb4814417779\" (UID: \"c8294d38-30f9-48cf-9638-fb4814417779\") "
Sep 16 13:34:20.619667 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.619560    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c8294d38-30f9-48cf-9638-fb4814417779" (UID: "c8294d38-30f9-48cf-9638-fb4814417779"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:34:20.619780 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.619665    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8294d38-30f9-48cf-9638-fb4814417779-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c8294d38-30f9-48cf-9638-fb4814417779" (UID: "c8294d38-30f9-48cf-9638-fb4814417779"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:34:20.621033 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.620044    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kmgcm" podStartSLOduration=66.619518516 podStartE2EDuration="1m8.620023861s" totalImagesPullingTime="2.000505345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:20.596134177 +0000 UTC m=+69.843012004" watchObservedRunningTime="2026-09-16 13:34:20.620023861 +0000 UTC m=+69.866901687"
Sep 16 13:34:20.621033 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.620119    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c8294d38-30f9-48cf-9638-fb4814417779" (UID: "c8294d38-30f9-48cf-9638-fb4814417779"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:34:20.621033 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.620320    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8294d38-30f9-48cf-9638-fb4814417779-ca-trust-extracted\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:34:20.621033 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.620339    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-trusted-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:34:20.621033 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.620354    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8294d38-30f9-48cf-9638-fb4814417779-registry-certificates\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:34:20.621289 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.621146    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c8294d38-30f9-48cf-9638-fb4814417779" (UID: "c8294d38-30f9-48cf-9638-fb4814417779"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:34:20.622746 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.622722    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c8294d38-30f9-48cf-9638-fb4814417779" (UID: "c8294d38-30f9-48cf-9638-fb4814417779"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:34:20.623498 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.623466    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-kube-api-access-9cz8s" (OuterVolumeSpecName: "kube-api-access-9cz8s") pod "c8294d38-30f9-48cf-9638-fb4814417779" (UID: "c8294d38-30f9-48cf-9638-fb4814417779"). InnerVolumeSpecName "kube-api-access-9cz8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:34:20.624686 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.624627    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c8294d38-30f9-48cf-9638-fb4814417779" (UID: "c8294d38-30f9-48cf-9638-fb4814417779"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:34:20.625749 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.625721    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c8294d38-30f9-48cf-9638-fb4814417779" (UID: "c8294d38-30f9-48cf-9638-fb4814417779"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:34:20.721649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.721485    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-image-registry-private-configuration\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:34:20.721649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.721513    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cz8s\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-kube-api-access-9cz8s\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:34:20.721649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.721530    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-registry-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:34:20.721649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.721546    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8294d38-30f9-48cf-9638-fb4814417779-installation-pull-secrets\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:34:20.721649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:20.721558    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8294d38-30f9-48cf-9638-fb4814417779-bound-sa-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:34:21.584490 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:21.584418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b7b54869b-sxf4d"
Sep 16 13:34:21.613065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:21.613036    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b7b54869b-sxf4d"]
Sep 16 13:34:21.616908 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:21.616885    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b7b54869b-sxf4d"]
Sep 16 13:34:23.216785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:23.216752    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8294d38-30f9-48cf-9638-fb4814417779" path="/var/lib/kubelet/pods/c8294d38-30f9-48cf-9638-fb4814417779/volumes"
Sep 16 13:34:23.600967 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:23.600938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g2cp9" event={"ID":"7e3534a5-1569-4161-8c8d-f1766a07661f","Type":"ContainerStarted","Data":"215ffd49241cfaf0442ee42aedaa292dfcf016ddc1ccf8a7a037ba1c44f1a304"}
Sep 16 13:34:23.602956 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:23.602677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gwjjm" event={"ID":"5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7","Type":"ContainerStarted","Data":"4166749c4bac5c01cb4b5ea7ecbc59c75c3fc20f15d557e645da5f7d931d4040"}
Sep 16 13:34:23.604873 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:23.604847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-27n7f" event={"ID":"98edf2eb-520a-47ea-8b2c-6e3976f6b5e2","Type":"ContainerStarted","Data":"a8b0229cbaa8eba0e40d76d5d2fd15110b07214c8e5729a3ebf5217b5df6a151"}
Sep 16 13:34:23.604968 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:23.604953    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:34:23.630660 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:23.630254    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-27n7f" podStartSLOduration=66.06636569 podStartE2EDuration="1m11.63023619s" totalImagesPullingTime="5.5638705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:23.629998634 +0000 UTC m=+72.876876462" watchObservedRunningTime="2026-09-16 13:34:23.63023619 +0000 UTC m=+72.877114014"
Sep 16 13:34:23.630660 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:23.630503    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gwjjm" podStartSLOduration=66.048166385 podStartE2EDuration="1m11.630494567s" totalImagesPullingTime="5.582328182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:23.616678766 +0000 UTC m=+72.863556590" watchObservedRunningTime="2026-09-16 13:34:23.630494567 +0000 UTC m=+72.877372393"
Sep 16 13:34:23.698203 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:23.698135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-mszlq"]
Sep 16 13:34:23.702998 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:23.702975    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3561d972_ac2d_4ba0_8a44_ab82ee44527c.slice/crio-ca3f0df0a1000cab7ff1383c6fd9279c9479369b49a786a0f07c50d6236d8e59 WatchSource:0}: Error finding container ca3f0df0a1000cab7ff1383c6fd9279c9479369b49a786a0f07c50d6236d8e59: Status 404 returned error can't find the container with id ca3f0df0a1000cab7ff1383c6fd9279c9479369b49a786a0f07c50d6236d8e59
Sep 16 13:34:24.609764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:24.609725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-mszlq" event={"ID":"3561d972-ac2d-4ba0-8a44-ab82ee44527c","Type":"ContainerStarted","Data":"ca3f0df0a1000cab7ff1383c6fd9279c9479369b49a786a0f07c50d6236d8e59"}
Sep 16 13:34:24.611586 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:24.611552    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g2cp9" event={"ID":"7e3534a5-1569-4161-8c8d-f1766a07661f","Type":"ContainerStarted","Data":"f34b04f825164bac8510dbf60953a98939e1c7e45099b924d368e307ddfc9252"}
Sep 16 13:34:24.627779 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:24.627737    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g2cp9" podStartSLOduration=33.683761024 podStartE2EDuration="37.627722067s" totalImagesPullingTime="3.943961043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:24.626503056 +0000 UTC m=+73.873380880" watchObservedRunningTime="2026-09-16 13:34:24.627722067 +0000 UTC m=+73.874599931"
Sep 16 13:34:25.615695 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:25.615660    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:34:27.434632 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.434599    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7778f49b4b-c6466"]
Sep 16 13:34:27.437905 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.437875    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.440210 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.440017    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 13:34:27.440210 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.440107    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 13:34:27.440845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.440696    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q7ntl\""
Sep 16 13:34:27.440845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.440731    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 13:34:27.440845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.440731    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 13:34:27.441100 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.441080    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 13:34:27.448010 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.447958    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7778f49b4b-c6466"]
Sep 16 13:34:27.465250 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.465221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-oauth-config\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.465358 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.465264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-config\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.465358 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.465320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-oauth-serving-cert\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.465476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.465403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-serving-cert\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.465476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.465423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-service-ca\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.465476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.465446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vhzv\" (UniqueName: \"kubernetes.io/projected/91de8217-85d9-415a-b35e-ed2b34aeb2de-kube-api-access-5vhzv\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.566500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.566470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-serving-cert\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.566649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.566508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-service-ca\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.566649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.566541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vhzv\" (UniqueName: \"kubernetes.io/projected/91de8217-85d9-415a-b35e-ed2b34aeb2de-kube-api-access-5vhzv\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.566649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.566565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-oauth-config\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.566649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.566596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-config\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.566649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.566624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-oauth-serving-cert\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.567315 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.567284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-service-ca\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.567491 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.567454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-config\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.567717 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.567693    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-oauth-serving-cert\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.569303 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.569280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-oauth-config\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.569573 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.569529    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-serving-cert\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.573903 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.573882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vhzv\" (UniqueName: \"kubernetes.io/projected/91de8217-85d9-415a-b35e-ed2b34aeb2de-kube-api-access-5vhzv\") pod \"console-7778f49b4b-c6466\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") " pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:27.749196 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:27.749132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:28.036424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.036316    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7778f49b4b-c6466"]
Sep 16 13:34:28.043234 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:28.043207    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91de8217_85d9_415a_b35e_ed2b34aeb2de.slice/crio-d4e04a632c806ec1fd2bf9c02b16f92ce00299294f90a847f6348c06ca97cc01 WatchSource:0}: Error finding container d4e04a632c806ec1fd2bf9c02b16f92ce00299294f90a847f6348c06ca97cc01: Status 404 returned error can't find the container with id d4e04a632c806ec1fd2bf9c02b16f92ce00299294f90a847f6348c06ca97cc01
Sep 16 13:34:28.198246 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.198218    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"]
Sep 16 13:34:28.202554 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.202538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"
Sep 16 13:34:28.204427 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.204406    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 16 13:34:28.204537 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.204435    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f9j2v\""
Sep 16 13:34:28.208099 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.208074    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"]
Sep 16 13:34:28.272571 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.272493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4c8e4a19-6c9a-44a1-95f5-a726960cd74d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-88r8l\" (UID: \"4c8e4a19-6c9a-44a1-95f5-a726960cd74d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"
Sep 16 13:34:28.373537 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.373508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4c8e4a19-6c9a-44a1-95f5-a726960cd74d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-88r8l\" (UID: \"4c8e4a19-6c9a-44a1-95f5-a726960cd74d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"
Sep 16 13:34:28.376282 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.376261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4c8e4a19-6c9a-44a1-95f5-a726960cd74d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-88r8l\" (UID: \"4c8e4a19-6c9a-44a1-95f5-a726960cd74d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"
Sep 16 13:34:28.512576 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.512551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"
Sep 16 13:34:28.627666 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.627597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7778f49b4b-c6466" event={"ID":"91de8217-85d9-415a-b35e-ed2b34aeb2de","Type":"ContainerStarted","Data":"d4e04a632c806ec1fd2bf9c02b16f92ce00299294f90a847f6348c06ca97cc01"}
Sep 16 13:34:28.785353 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:28.785325    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"]
Sep 16 13:34:28.788411 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:28.788362    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8e4a19_6c9a_44a1_95f5_a726960cd74d.slice/crio-2c52b6a442366c2b71da5703c8cc4c5c822a1d09de42dfed891722d8e815d0d5 WatchSource:0}: Error finding container 2c52b6a442366c2b71da5703c8cc4c5c822a1d09de42dfed891722d8e815d0d5: Status 404 returned error can't find the container with id 2c52b6a442366c2b71da5703c8cc4c5c822a1d09de42dfed891722d8e815d0d5
Sep 16 13:34:29.635316 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:29.635245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l" event={"ID":"4c8e4a19-6c9a-44a1-95f5-a726960cd74d","Type":"ContainerStarted","Data":"2c52b6a442366c2b71da5703c8cc4c5c822a1d09de42dfed891722d8e815d0d5"}
Sep 16 13:34:31.645695 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:31.645652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l" event={"ID":"4c8e4a19-6c9a-44a1-95f5-a726960cd74d","Type":"ContainerStarted","Data":"ea27a653fa2e1c1ffdbb2ba460d3d78e38010774126eb86f8ea9f51579a99a77"}
Sep 16 13:34:31.646159 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:31.645969    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"
Sep 16 13:34:31.651675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:31.651652    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l"
Sep 16 13:34:31.660110 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:31.660055    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-88r8l" podStartSLOduration=1.783885097 podStartE2EDuration="3.660040179s" totalImagesPullingTime="1.876155082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:31.659276698 +0000 UTC m=+80.906154522" watchObservedRunningTime="2026-09-16 13:34:31.660040179 +0000 UTC m=+80.906918003"
Sep 16 13:34:32.270543 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.270507    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"]
Sep 16 13:34:32.274991 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.274968    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.277189 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.277171    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 13:34:32.277285 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.277202    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 13:34:32.278287 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.278262    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 13:34:32.278421 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.278268    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 16 13:34:32.278421 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.278296    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 16 13:34:32.278421 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.278333    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lzjbt\""
Sep 16 13:34:32.280882 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.280862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"]
Sep 16 13:34:32.305003 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.304973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.305127 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.305009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62g2v\" (UniqueName: \"kubernetes.io/projected/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-kube-api-access-62g2v\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.305127 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.305031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.305127 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.305102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.406611 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.406578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.406780 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.406632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62g2v\" (UniqueName: \"kubernetes.io/projected/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-kube-api-access-62g2v\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.406780 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.406663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.406780 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.406699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.407544 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.407513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.409455 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.409429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.409546 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.409484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.414998 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.414973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62g2v\" (UniqueName: \"kubernetes.io/projected/ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f-kube-api-access-62g2v\") pod \"prometheus-operator-68bcd7f987-qphfz\" (UID: \"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.614140 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.613993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"
Sep 16 13:34:32.652243 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.652191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7778f49b4b-c6466" event={"ID":"91de8217-85d9-415a-b35e-ed2b34aeb2de","Type":"ContainerStarted","Data":"0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec"}
Sep 16 13:34:32.672549 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.671988    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7778f49b4b-c6466" podStartSLOduration=1.469124382 podStartE2EDuration="5.671965879s" totalImagesPullingTime="4.202841497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:32.668111401 +0000 UTC m=+81.914989227" watchObservedRunningTime="2026-09-16 13:34:32.671965879 +0000 UTC m=+81.918843706"
Sep 16 13:34:32.897646 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:32.897613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-qphfz"]
Sep 16 13:34:32.900556 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:32.900528    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8e7e3d_5ada_4c03_83ab_e7ddf7a1362f.slice/crio-ba04ace6bf3e94fda593d146ec4f61523116cfdba1b386faee2d56a614e2971c WatchSource:0}: Error finding container ba04ace6bf3e94fda593d146ec4f61523116cfdba1b386faee2d56a614e2971c: Status 404 returned error can't find the container with id ba04ace6bf3e94fda593d146ec4f61523116cfdba1b386faee2d56a614e2971c
Sep 16 13:34:33.424416 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.424364    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5965fb6dcb-6k8ms"]
Sep 16 13:34:33.428907 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.428881    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.436799 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.436776    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 13:34:33.436964 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.436938    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5965fb6dcb-6k8ms"]
Sep 16 13:34:33.515889 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.515859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-oauth-config\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.516041 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.515909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-service-ca\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.516041 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.515943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-oauth-serving-cert\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.516041 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.515974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-trusted-ca-bundle\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.516140 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.516059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-console-config\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.516140 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.516090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7q2m\" (UniqueName: \"kubernetes.io/projected/424a43f4-6c09-4906-a799-bb0d50aba686-kube-api-access-s7q2m\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.516140 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.516120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-serving-cert\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.617448 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.617408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-serving-cert\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.617637 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.617459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-oauth-config\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.617637 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.617512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-service-ca\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.617637 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.617543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-oauth-serving-cert\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.617637 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.617570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-trusted-ca-bundle\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.617637 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.617607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-console-config\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.617637 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.617633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7q2m\" (UniqueName: \"kubernetes.io/projected/424a43f4-6c09-4906-a799-bb0d50aba686-kube-api-access-s7q2m\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.618309 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.618275    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-service-ca\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.618529 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.618495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-console-config\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.618649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.618563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-oauth-serving-cert\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.618649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.618619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-trusted-ca-bundle\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.620311 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.620289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-oauth-config\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.620881 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.620863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-serving-cert\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.625391 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.625356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7q2m\" (UniqueName: \"kubernetes.io/projected/424a43f4-6c09-4906-a799-bb0d50aba686-kube-api-access-s7q2m\") pod \"console-5965fb6dcb-6k8ms\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") " pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:33.657160 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.657130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz" event={"ID":"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f","Type":"ContainerStarted","Data":"ba04ace6bf3e94fda593d146ec4f61523116cfdba1b386faee2d56a614e2971c"}
Sep 16 13:34:33.741241 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:33.741159    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:34.021478 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:34.021455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5965fb6dcb-6k8ms"]
Sep 16 13:34:34.024414 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:34.024370    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424a43f4_6c09_4906_a799_bb0d50aba686.slice/crio-01de8c3fe4091440d88bcbe5d09fbd1f6cd80acc9fad8f54aa1af90651960061 WatchSource:0}: Error finding container 01de8c3fe4091440d88bcbe5d09fbd1f6cd80acc9fad8f54aa1af90651960061: Status 404 returned error can't find the container with id 01de8c3fe4091440d88bcbe5d09fbd1f6cd80acc9fad8f54aa1af90651960061
Sep 16 13:34:34.666692 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:34.666661    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5965fb6dcb-6k8ms" event={"ID":"424a43f4-6c09-4906-a799-bb0d50aba686","Type":"ContainerStarted","Data":"560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9"}
Sep 16 13:34:34.667114 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:34.666759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5965fb6dcb-6k8ms" event={"ID":"424a43f4-6c09-4906-a799-bb0d50aba686","Type":"ContainerStarted","Data":"01de8c3fe4091440d88bcbe5d09fbd1f6cd80acc9fad8f54aa1af90651960061"}
Sep 16 13:34:34.669465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:34.669438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz" event={"ID":"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f","Type":"ContainerStarted","Data":"a6dea94e574113f8cc9fd78ff70c0dadf3c36c3dc0515833c8a3b32c87eceb0e"}
Sep 16 13:34:34.669561 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:34.669489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz" event={"ID":"ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f","Type":"ContainerStarted","Data":"c6dd052f48dbd6c989c2f59556529271ac9d5fc9c2a27015fdf805e9a53b7660"}
Sep 16 13:34:34.711768 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:34.711714    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5965fb6dcb-6k8ms" podStartSLOduration=1.711699209 podStartE2EDuration="1.711699209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:34.710370599 +0000 UTC m=+83.957248429" watchObservedRunningTime="2026-09-16 13:34:34.711699209 +0000 UTC m=+83.958577027"
Sep 16 13:34:34.729631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:34.729590    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qphfz" podStartSLOduration=1.105252506 podStartE2EDuration="2.729574237s" totalImagesPullingTime="1.624321731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:34.728409537 +0000 UTC m=+83.975287367" watchObservedRunningTime="2026-09-16 13:34:34.729574237 +0000 UTC m=+83.976452063"
Sep 16 13:34:35.621305 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:35.621273    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g2cp9"
Sep 16 13:34:36.609035 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.608996    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"]
Sep 16 13:34:36.615351 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.615326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.618236 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.618215    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 16 13:34:36.618394 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.618219    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 16 13:34:36.618394 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.618263    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nv4cg\""
Sep 16 13:34:36.625300 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.625257    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"]
Sep 16 13:34:36.633824 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.633802    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jsvkm"]
Sep 16 13:34:36.639907 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.639880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.641761 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.641741    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bdhnc\""
Sep 16 13:34:36.642135 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.641969    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 13:34:36.642135 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.642052    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 13:34:36.642135 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.642061    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 13:34:36.744591 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c51152c-8d4d-495b-aeba-cf5719ae7952-sys\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.744758 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-wtmp\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.744758 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae5cbee4-901d-4b22-b411-a7516467548f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.744758 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-accelerators-collector-config\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.744758 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c51152c-8d4d-495b-aeba-cf5719ae7952-root\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.744758 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae5cbee4-901d-4b22-b411-a7516467548f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.744758 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae5cbee4-901d-4b22-b411-a7516467548f-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.745015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mmct\" (UniqueName: \"kubernetes.io/projected/ae5cbee4-901d-4b22-b411-a7516467548f-kube-api-access-8mmct\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.745015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.745015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-textfile\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.745015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c51152c-8d4d-495b-aeba-cf5719ae7952-metrics-client-ca\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.745015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.744983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc6vl\" (UniqueName: \"kubernetes.io/projected/2c51152c-8d4d-495b-aeba-cf5719ae7952-kube-api-access-pc6vl\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.745206 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.745074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-tls\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.845765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c51152c-8d4d-495b-aeba-cf5719ae7952-root\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.845809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae5cbee4-901d-4b22-b411-a7516467548f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.845843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae5cbee4-901d-4b22-b411-a7516467548f-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.845882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmct\" (UniqueName: \"kubernetes.io/projected/ae5cbee4-901d-4b22-b411-a7516467548f-kube-api-access-8mmct\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.845896    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c51152c-8d4d-495b-aeba-cf5719ae7952-root\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.845908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.845936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-textfile\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.845983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c51152c-8d4d-495b-aeba-cf5719ae7952-metrics-client-ca\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc6vl\" (UniqueName: \"kubernetes.io/projected/2c51152c-8d4d-495b-aeba-cf5719ae7952-kube-api-access-pc6vl\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:36.846012    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-tls\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:36.846073    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5cbee4-901d-4b22-b411-a7516467548f-openshift-state-metrics-tls podName:ae5cbee4-901d-4b22-b411-a7516467548f nodeName:}" failed. No retries permitted until 2026-09-16 13:34:37.346054065 +0000 UTC m=+86.592931873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ae5cbee4-901d-4b22-b411-a7516467548f-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-8vj5v" (UID: "ae5cbee4-901d-4b22-b411-a7516467548f") : secret "openshift-state-metrics-tls" not found
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c51152c-8d4d-495b-aeba-cf5719ae7952-sys\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:36.846124    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:34:36.846174    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-tls podName:2c51152c-8d4d-495b-aeba-cf5719ae7952 nodeName:}" failed. No retries permitted until 2026-09-16 13:34:37.346161879 +0000 UTC m=+86.593039682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-tls") pod "node-exporter-jsvkm" (UID: "2c51152c-8d4d-495b-aeba-cf5719ae7952") : secret "node-exporter-tls" not found
Sep 16 13:34:36.846785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c51152c-8d4d-495b-aeba-cf5719ae7952-sys\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.847500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-wtmp\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.847500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae5cbee4-901d-4b22-b411-a7516467548f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.847500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-accelerators-collector-config\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.847500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846481    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-textfile\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.847500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-wtmp\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.847500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae5cbee4-901d-4b22-b411-a7516467548f-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.847500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846895    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-accelerators-collector-config\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.847500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.846965    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c51152c-8d4d-495b-aeba-cf5719ae7952-metrics-client-ca\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.849398 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.849348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae5cbee4-901d-4b22-b411-a7516467548f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.849967 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.849923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:36.854756 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.854732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mmct\" (UniqueName: \"kubernetes.io/projected/ae5cbee4-901d-4b22-b411-a7516467548f-kube-api-access-8mmct\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:36.854863 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:36.854768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc6vl\" (UniqueName: \"kubernetes.io/projected/2c51152c-8d4d-495b-aeba-cf5719ae7952-kube-api-access-pc6vl\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:37.352094 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.352052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae5cbee4-901d-4b22-b411-a7516467548f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:37.352278 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.352169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-tls\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:37.354825 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.354803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c51152c-8d4d-495b-aeba-cf5719ae7952-node-exporter-tls\") pod \"node-exporter-jsvkm\" (UID: \"2c51152c-8d4d-495b-aeba-cf5719ae7952\") " pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:37.358084 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.358062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae5cbee4-901d-4b22-b411-a7516467548f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-8vj5v\" (UID: \"ae5cbee4-901d-4b22-b411-a7516467548f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:37.527533 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.527500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"
Sep 16 13:34:37.551530 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.551504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jsvkm"
Sep 16 13:34:37.675425 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.675395    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 13:34:37.681633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.681611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.683584 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.683564    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 16 13:34:37.683816 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.683802    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2kv4d\""
Sep 16 13:34:37.683913 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.683895    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 16 13:34:37.683950 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.683933    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 16 13:34:37.684108 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.684094    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 16 13:34:37.684161 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.684147    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 16 13:34:37.684232 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.684216    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 16 13:34:37.684271 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.684233    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 16 13:34:37.684773 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.684751    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 16 13:34:37.689138 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.689114    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 16 13:34:37.692645 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.692621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 13:34:37.749826 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.749798    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:37.749967 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.749851    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:37.754853 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.754829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.754992 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.754868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.754992 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.754901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-web-config\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.754992 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.754907    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:37.754992 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.754929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.755199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.754994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-config-out\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.755199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.755020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.755199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.755048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.755199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.755067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.755199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.755098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.755199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.755129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mnpt\" (UniqueName: \"kubernetes.io/projected/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-kube-api-access-6mnpt\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.755199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.755154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.755199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.755179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.755476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.755240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856428 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-web-config\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856864 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-config-out\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856864 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856864 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856864 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856864 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856864 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mnpt\" (UniqueName: \"kubernetes.io/projected/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-kube-api-access-6mnpt\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.856864 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.856815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.857723 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.857687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.860399 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.860347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.860487 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.860455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.860532 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.860485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.861880 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.861434    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-config-out\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.861880 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.861605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.861880 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.861643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.861880 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.861665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.861880 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.861846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.862170 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.861899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.862170 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.862100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-web-config\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.863784 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.863755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.867794 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.867773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mnpt\" (UniqueName: \"kubernetes.io/projected/b7cf7aff-4dae-456f-be8e-10a7ffbf3222-kube-api-access-6mnpt\") pod \"alertmanager-main-0\" (UID: \"b7cf7aff-4dae-456f-be8e-10a7ffbf3222\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:37.994594 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:37.994506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 13:34:38.696457 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:38.696426    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:34:40.918282 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.918242    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-756dfbb69d-td6zz"]
Sep 16 13:34:40.924898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.924871    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:40.927614 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.927583    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 13:34:40.928331 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.928306    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 16 13:34:40.928475 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.928417    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 16 13:34:40.929674 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.928670    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-68rvqo36aq8k8\""
Sep 16 13:34:40.929674 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.928860    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5s82z\""
Sep 16 13:34:40.929674 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.929555    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 16 13:34:40.930626 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.930605    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-756dfbb69d-td6zz"]
Sep 16 13:34:40.985023 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.984991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/453c77df-ac7b-4682-861e-f46a759a8fcd-secret-metrics-server-tls\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:40.985210 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.985043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/453c77df-ac7b-4682-861e-f46a759a8fcd-secret-metrics-server-client-certs\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:40.985210 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.985120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453c77df-ac7b-4682-861e-f46a759a8fcd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:40.985304 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.985209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/453c77df-ac7b-4682-861e-f46a759a8fcd-metrics-server-audit-profiles\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:40.985304 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.985259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/453c77df-ac7b-4682-861e-f46a759a8fcd-audit-log\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:40.985416 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.985311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmrx4\" (UniqueName: \"kubernetes.io/projected/453c77df-ac7b-4682-861e-f46a759a8fcd-kube-api-access-wmrx4\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:40.985416 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:40.985395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/453c77df-ac7b-4682-861e-f46a759a8fcd-client-ca-bundle\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.086285 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.086249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/453c77df-ac7b-4682-861e-f46a759a8fcd-metrics-server-audit-profiles\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.086465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.086313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/453c77df-ac7b-4682-861e-f46a759a8fcd-audit-log\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.086465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.086357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmrx4\" (UniqueName: \"kubernetes.io/projected/453c77df-ac7b-4682-861e-f46a759a8fcd-kube-api-access-wmrx4\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.086465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.086402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/453c77df-ac7b-4682-861e-f46a759a8fcd-client-ca-bundle\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.086465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.086445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/453c77df-ac7b-4682-861e-f46a759a8fcd-secret-metrics-server-tls\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.086691 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.086476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/453c77df-ac7b-4682-861e-f46a759a8fcd-secret-metrics-server-client-certs\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.086691 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.086501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453c77df-ac7b-4682-861e-f46a759a8fcd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.087492 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.087167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/453c77df-ac7b-4682-861e-f46a759a8fcd-audit-log\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.087492 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.087270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/453c77df-ac7b-4682-861e-f46a759a8fcd-metrics-server-audit-profiles\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.088167 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.088138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/453c77df-ac7b-4682-861e-f46a759a8fcd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.089441 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.089416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/453c77df-ac7b-4682-861e-f46a759a8fcd-secret-metrics-server-tls\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.089634 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.089618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/453c77df-ac7b-4682-861e-f46a759a8fcd-client-ca-bundle\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.089859 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.089842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/453c77df-ac7b-4682-861e-f46a759a8fcd-secret-metrics-server-client-certs\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.097760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.097739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmrx4\" (UniqueName: \"kubernetes.io/projected/453c77df-ac7b-4682-861e-f46a759a8fcd-kube-api-access-wmrx4\") pod \"metrics-server-756dfbb69d-td6zz\" (UID: \"453c77df-ac7b-4682-861e-f46a759a8fcd\") " pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.237620 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.237540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:34:41.410510 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.410479    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"]
Sep 16 13:34:41.416510 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.416446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:41.418791 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.418769    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 13:34:41.418931 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.418887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-767kp\""
Sep 16 13:34:41.422735 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.422713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"]
Sep 16 13:34:41.490602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.490513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkjvr\" (UniqueName: \"kubernetes.io/projected/aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50-kube-api-access-bkjvr\") pod \"monitoring-plugin-5d85778b9d-s8l4p\" (UID: \"aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:41.490602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.490590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-s8l4p\" (UID: \"aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:41.591795 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.591767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkjvr\" (UniqueName: \"kubernetes.io/projected/aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50-kube-api-access-bkjvr\") pod \"monitoring-plugin-5d85778b9d-s8l4p\" (UID: \"aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:41.591978 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.591820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-s8l4p\" (UID: \"aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:41.594915 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.594890    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-s8l4p\" (UID: \"aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:41.600035 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.600007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkjvr\" (UniqueName: \"kubernetes.io/projected/aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50-kube-api-access-bkjvr\") pod \"monitoring-plugin-5d85778b9d-s8l4p\" (UID: \"aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:41.730229 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:41.730194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:42.870308 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.870273    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 13:34:42.895293 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.895256    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 13:34:42.896847 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.895478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:42.898945 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.898675    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fan2abgjsc5bm\""
Sep 16 13:34:42.898945 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.898697    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 13:34:42.898945 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.898750    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 13:34:42.898945 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.898775    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 13:34:42.898945 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.898937    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 13:34:42.899282 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.899230    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 13:34:42.899282 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.899270    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 13:34:42.899491 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.899475    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 13:34:42.900454 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.899725    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qzlvm\""
Sep 16 13:34:42.900454 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.899977    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 13:34:42.900454 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.900171    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 13:34:42.900454 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.900172    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 13:34:42.900733 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.900687    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 13:34:42.900947 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.900928    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 13:34:42.907157 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.905285    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 13:34:42.910875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:42.910756    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 13:34:42.924318 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:42.924287    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c51152c_8d4d_495b_aeba_cf5719ae7952.slice/crio-266b8ed2c3be44c6c1c9995bcf9a9c4782cff0393f4005b196b00199c7cab188 WatchSource:0}: Error finding container 266b8ed2c3be44c6c1c9995bcf9a9c4782cff0393f4005b196b00199c7cab188: Status 404 returned error can't find the container with id 266b8ed2c3be44c6c1c9995bcf9a9c4782cff0393f4005b196b00199c7cab188
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c62cfcd2-0a97-4968-adfe-df8cd0140a11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpt4l\" (UniqueName: \"kubernetes.io/projected/c62cfcd2-0a97-4968-adfe-df8cd0140a11-kube-api-access-kpt4l\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-config\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c62cfcd2-0a97-4968-adfe-df8cd0140a11-config-out\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-web-config\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.010725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.011610 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.011610 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.011610 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.011610 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.010574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.111664 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.111632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-web-config\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.111664 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.111670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.111902 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.111694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.111959 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.111896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.111959 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.111939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112153 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112295 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c62cfcd2-0a97-4968-adfe-df8cd0140a11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112295 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112295 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112295 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpt4l\" (UniqueName: \"kubernetes.io/projected/c62cfcd2-0a97-4968-adfe-df8cd0140a11-kube-api-access-kpt4l\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-config\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.112602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.113093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c62cfcd2-0a97-4968-adfe-df8cd0140a11-config-out\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.113093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.113093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.113093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.112787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.114724 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.113436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.114724 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.114148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.114724 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.114243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.116274 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.115511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.116274 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.115564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c62cfcd2-0a97-4968-adfe-df8cd0140a11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.116274 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.115971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.116546 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.116296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.117666 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.117459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.118145 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.118116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-web-config\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.118241 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.118121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-config\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.118860 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.118798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c62cfcd2-0a97-4968-adfe-df8cd0140a11-config-out\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.119280 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.119237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.120859 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.120806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c62cfcd2-0a97-4968-adfe-df8cd0140a11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.121281 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.121254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.121439 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.121418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.121601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.121584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c62cfcd2-0a97-4968-adfe-df8cd0140a11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.123328 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.123312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpt4l\" (UniqueName: \"kubernetes.io/projected/c62cfcd2-0a97-4968-adfe-df8cd0140a11-kube-api-access-kpt4l\") pod \"prometheus-k8s-0\" (UID: \"c62cfcd2-0a97-4968-adfe-df8cd0140a11\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.201635 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.201544    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v"]
Sep 16 13:34:43.203776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.203687    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 13:34:43.204790 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:43.204766    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5cbee4_901d_4b22_b411_a7516467548f.slice/crio-8507d8a349582656ef76b2a529c9d5148334dcdbac93666d6da9ee5e59c5e17f WatchSource:0}: Error finding container 8507d8a349582656ef76b2a529c9d5148334dcdbac93666d6da9ee5e59c5e17f: Status 404 returned error can't find the container with id 8507d8a349582656ef76b2a529c9d5148334dcdbac93666d6da9ee5e59c5e17f
Sep 16 13:34:43.206098 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:43.206074    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7cf7aff_4dae_456f_be8e_10a7ffbf3222.slice/crio-cc6debe46d60b1a3462ae14ae36b9954f16cdd55fafea663bae589bd8cb7b05d WatchSource:0}: Error finding container cc6debe46d60b1a3462ae14ae36b9954f16cdd55fafea663bae589bd8cb7b05d: Status 404 returned error can't find the container with id cc6debe46d60b1a3462ae14ae36b9954f16cdd55fafea663bae589bd8cb7b05d
Sep 16 13:34:43.231768 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.231735    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"]
Sep 16 13:34:43.232885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.232866    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-756dfbb69d-td6zz"]
Sep 16 13:34:43.238648 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:43.238616    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec8d5fa_3a05_4f47_9edb_ff4b0e43fb50.slice/crio-a3081e8a67fde72f1dc914b48270806a8b2ec1e9a11b61f03ae759e3f6ed01d4 WatchSource:0}: Error finding container a3081e8a67fde72f1dc914b48270806a8b2ec1e9a11b61f03ae759e3f6ed01d4: Status 404 returned error can't find the container with id a3081e8a67fde72f1dc914b48270806a8b2ec1e9a11b61f03ae759e3f6ed01d4
Sep 16 13:34:43.239262 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:43.239241    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453c77df_ac7b_4682_861e_f46a759a8fcd.slice/crio-653a0b69d1730b07399c1451e99beac3a5afc712f3062510f56d2bc962fd1ac5 WatchSource:0}: Error finding container 653a0b69d1730b07399c1451e99beac3a5afc712f3062510f56d2bc962fd1ac5: Status 404 returned error can't find the container with id 653a0b69d1730b07399c1451e99beac3a5afc712f3062510f56d2bc962fd1ac5
Sep 16 13:34:43.239481 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.239458    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:34:43.562829 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.562791    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 13:34:43.566478 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:34:43.566443    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62cfcd2_0a97_4968_adfe_df8cd0140a11.slice/crio-4d141a9de9ed0b9b39c7d1a435d6f2fd736f2861474593c493372a294f1bb6f1 WatchSource:0}: Error finding container 4d141a9de9ed0b9b39c7d1a435d6f2fd736f2861474593c493372a294f1bb6f1: Status 404 returned error can't find the container with id 4d141a9de9ed0b9b39c7d1a435d6f2fd736f2861474593c493372a294f1bb6f1
Sep 16 13:34:43.719955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.719881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v" event={"ID":"ae5cbee4-901d-4b22-b411-a7516467548f","Type":"ContainerStarted","Data":"3cbe776344c8d501dd63e7f63872292b4e82565cbfa0b3d48fb20a8bf1a36799"}
Sep 16 13:34:43.720161 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.719958    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v" event={"ID":"ae5cbee4-901d-4b22-b411-a7516467548f","Type":"ContainerStarted","Data":"aded6a1adc6388779204f3f82fc082e6b6678a084af8c1b8f65b3ac8dc624e2a"}
Sep 16 13:34:43.720161 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.719987    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v" event={"ID":"ae5cbee4-901d-4b22-b411-a7516467548f","Type":"ContainerStarted","Data":"8507d8a349582656ef76b2a529c9d5148334dcdbac93666d6da9ee5e59c5e17f"}
Sep 16 13:34:43.724840 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.722030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-mszlq" event={"ID":"3561d972-ac2d-4ba0-8a44-ab82ee44527c","Type":"ContainerStarted","Data":"b4176197b669300d88f88a2cc07cc91b0022657a3d27fac4e050e4892fb4615d"}
Sep 16 13:34:43.724840 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.724520    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-mszlq"
Sep 16 13:34:43.726265 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.726198    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c62cfcd2-0a97-4968-adfe-df8cd0140a11","Type":"ContainerStarted","Data":"4d141a9de9ed0b9b39c7d1a435d6f2fd736f2861474593c493372a294f1bb6f1"}
Sep 16 13:34:43.727462 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.727442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz" event={"ID":"453c77df-ac7b-4682-861e-f46a759a8fcd","Type":"ContainerStarted","Data":"653a0b69d1730b07399c1451e99beac3a5afc712f3062510f56d2bc962fd1ac5"}
Sep 16 13:34:43.729343 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.729321    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-mszlq"
Sep 16 13:34:43.729504 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.729482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jsvkm" event={"ID":"2c51152c-8d4d-495b-aeba-cf5719ae7952","Type":"ContainerStarted","Data":"266b8ed2c3be44c6c1c9995bcf9a9c4782cff0393f4005b196b00199c7cab188"}
Sep 16 13:34:43.730914 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.730873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p" event={"ID":"aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50","Type":"ContainerStarted","Data":"a3081e8a67fde72f1dc914b48270806a8b2ec1e9a11b61f03ae759e3f6ed01d4"}
Sep 16 13:34:43.732398 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.732355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7cf7aff-4dae-456f-be8e-10a7ffbf3222","Type":"ContainerStarted","Data":"cc6debe46d60b1a3462ae14ae36b9954f16cdd55fafea663bae589bd8cb7b05d"}
Sep 16 13:34:43.739922 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.739394    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-mszlq" podStartSLOduration=4.194982481 podStartE2EDuration="23.739356267s" totalImagesPullingTime="19.544373786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:43.738958957 +0000 UTC m=+92.985836780" watchObservedRunningTime="2026-09-16 13:34:43.739356267 +0000 UTC m=+92.986234092"
Sep 16 13:34:43.741959 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.741290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:43.741959 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.741332    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:43.747545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:43.747527    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:44.745754 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:44.745514    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:34:44.791147 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:44.791017    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7778f49b4b-c6466"]
Sep 16 13:34:47.758158 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.758118    2563 generic.go:356] "Generic (PLEG): container finished" podID="b7cf7aff-4dae-456f-be8e-10a7ffbf3222" containerID="669755ea60770824518776a3d2c226ab12ef60299f4ad28213c5e5680c53e0b4" exitCode=0
Sep 16 13:34:47.758711 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.758286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7cf7aff-4dae-456f-be8e-10a7ffbf3222","Type":"ContainerDied","Data":"669755ea60770824518776a3d2c226ab12ef60299f4ad28213c5e5680c53e0b4"}
Sep 16 13:34:47.762696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.762129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz" event={"ID":"453c77df-ac7b-4682-861e-f46a759a8fcd","Type":"ContainerStarted","Data":"02ec4dd77f9f166efa3d8fe720d2b144375eb7ab78db91aa71d6a40781082d93"}
Sep 16 13:34:47.765702 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.765071    2563 generic.go:356] "Generic (PLEG): container finished" podID="2c51152c-8d4d-495b-aeba-cf5719ae7952" containerID="8523de5e0217107f028df1fd1d6f9628969c61b91511735547a75f5e9654d937" exitCode=0
Sep 16 13:34:47.765702 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.765145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jsvkm" event={"ID":"2c51152c-8d4d-495b-aeba-cf5719ae7952","Type":"ContainerDied","Data":"8523de5e0217107f028df1fd1d6f9628969c61b91511735547a75f5e9654d937"}
Sep 16 13:34:47.768078 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.768052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p" event={"ID":"aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50","Type":"ContainerStarted","Data":"e74745d88919406207bc29d06310f32143d36e0d5faee54562ac6db370364beb"}
Sep 16 13:34:47.770518 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.770496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:47.775441 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.775424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p"
Sep 16 13:34:47.845345 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.845285    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz" podStartSLOduration=3.784993987 podStartE2EDuration="7.845264002s" totalImagesPullingTime="4.060270015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:47.843679499 +0000 UTC m=+97.090557325" watchObservedRunningTime="2026-09-16 13:34:47.845264002 +0000 UTC m=+97.092141826"
Sep 16 13:34:47.864150 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:47.864094    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s8l4p" podStartSLOduration=3.185345526 podStartE2EDuration="6.86407632s" totalImagesPullingTime="3.678730794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:47.863663986 +0000 UTC m=+97.110541812" watchObservedRunningTime="2026-09-16 13:34:47.86407632 +0000 UTC m=+97.110954144"
Sep 16 13:34:48.775889 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:48.775849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jsvkm" event={"ID":"2c51152c-8d4d-495b-aeba-cf5719ae7952","Type":"ContainerStarted","Data":"a60bffa12451a4759d70503c0c4b89d36a1b03338522a761bfeb29a007ccfa80"}
Sep 16 13:34:48.776352 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:48.775946    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jsvkm" event={"ID":"2c51152c-8d4d-495b-aeba-cf5719ae7952","Type":"ContainerStarted","Data":"306b39357780c9eee02ed896f2ec28e597b427e65d1120aa7d172277aad97d74"}
Sep 16 13:34:48.778517 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:48.778482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v" event={"ID":"ae5cbee4-901d-4b22-b411-a7516467548f","Type":"ContainerStarted","Data":"8fd0a3dd497654325c0f08c9c50026000d7d3f71e95823cf0e3b7345df7cf4d1"}
Sep 16 13:34:48.780346 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:48.780317    2563 generic.go:356] "Generic (PLEG): container finished" podID="c62cfcd2-0a97-4968-adfe-df8cd0140a11" containerID="54f45311227ff46cd8ac3c3337e2c941f7ea316dc369e4428e59294c8ca2ab3a" exitCode=0
Sep 16 13:34:48.780489 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:48.780403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c62cfcd2-0a97-4968-adfe-df8cd0140a11","Type":"ContainerDied","Data":"54f45311227ff46cd8ac3c3337e2c941f7ea316dc369e4428e59294c8ca2ab3a"}
Sep 16 13:34:48.792452 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:48.792415    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jsvkm" podStartSLOduration=8.709794925 podStartE2EDuration="12.79239676s" totalImagesPullingTime="3.992051747s" totalInitContainerRuntime="90.550088ms" isStatefulPod=true podCreationTimestamp="2026-09-16 13:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:48.791984383 +0000 UTC m=+98.038862241" watchObservedRunningTime="2026-09-16 13:34:48.79239676 +0000 UTC m=+98.039274585"
Sep 16 13:34:48.840159 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:48.840109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-8vj5v" podStartSLOduration=7.919466906 podStartE2EDuration="12.840094588s" totalImagesPullingTime="4.920627682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:48.839583246 +0000 UTC m=+98.086461071" watchObservedRunningTime="2026-09-16 13:34:48.840094588 +0000 UTC m=+98.086972416"
Sep 16 13:34:51.807786 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:51.807754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7cf7aff-4dae-456f-be8e-10a7ffbf3222","Type":"ContainerStarted","Data":"178f3823f4b15e5c476c04815cb974b412f4d0a0ab619489347e3922f29a9e1f"}
Sep 16 13:34:51.808169 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:51.807844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7cf7aff-4dae-456f-be8e-10a7ffbf3222","Type":"ContainerStarted","Data":"5bb99cf91be133b7aebbef38ac5774b84a664de17abdee3a6c03cd4cfb8c3dd9"}
Sep 16 13:34:51.808169 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:51.807894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7cf7aff-4dae-456f-be8e-10a7ffbf3222","Type":"ContainerStarted","Data":"22c634fee565bc137d6af3d36352874f346198f593ddad69f3dcffccaafb3c76"}
Sep 16 13:34:51.808169 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:51.807935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7cf7aff-4dae-456f-be8e-10a7ffbf3222","Type":"ContainerStarted","Data":"c0f5b99a06e9b2cc33d1ea8274b91098d4062a75ce414ba3adcfddec69f64375"}
Sep 16 13:34:52.817300 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:52.817265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7cf7aff-4dae-456f-be8e-10a7ffbf3222","Type":"ContainerStarted","Data":"4f5551424cb019eed3be7d170cd50661da8a9b35ee4c05e659836aa84e0e1832"}
Sep 16 13:34:53.822956 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:53.822876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c62cfcd2-0a97-4968-adfe-df8cd0140a11","Type":"ContainerStarted","Data":"d610bc0ac8d23f8b515228890b2f50bef0cf3e41cc1e980f0d38b9605d681aa4"}
Sep 16 13:34:54.613975 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:54.613911    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-27n7f"
Sep 16 13:34:54.831641 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:54.831605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7cf7aff-4dae-456f-be8e-10a7ffbf3222","Type":"ContainerStarted","Data":"80f5b664db1d098c593d2dfa2bf835d4429c5046f99e519ef9d129e2a34fc012"}
Sep 16 13:34:54.833715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:54.833693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c62cfcd2-0a97-4968-adfe-df8cd0140a11","Type":"ContainerStarted","Data":"92ab15cf6471bacc8af3513a1778584a5c0186ac007c9721ec292c99eae806b9"}
Sep 16 13:34:54.857770 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:54.857718    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.429388015 podStartE2EDuration="17.857703071s" totalImagesPullingTime="9.403737879s" totalInitContainerRuntime="24.577177ms" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:54.854860381 +0000 UTC m=+104.101738205" watchObservedRunningTime="2026-09-16 13:34:54.857703071 +0000 UTC m=+104.104580974"
Sep 16 13:34:57.608040 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:57.607989    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5965fb6dcb-6k8ms"]
Sep 16 13:34:58.856721 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:58.856687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c62cfcd2-0a97-4968-adfe-df8cd0140a11","Type":"ContainerStarted","Data":"f1cecaf62ce721d8a9fe17ff92a5d9ad1165d8209f48ed59813a2608796dbd82"}
Sep 16 13:34:58.857087 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:58.856754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c62cfcd2-0a97-4968-adfe-df8cd0140a11","Type":"ContainerStarted","Data":"1170a3d06b44c808fa65379cf80574803f4fbf256fab5eeb6db2d79c60d741c3"}
Sep 16 13:34:58.857087 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:58.856780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c62cfcd2-0a97-4968-adfe-df8cd0140a11","Type":"ContainerStarted","Data":"414d581e1d192bafc5332cc714c40ae4bdd42c81172830ace742c891913890c4"}
Sep 16 13:34:58.857087 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:58.856802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c62cfcd2-0a97-4968-adfe-df8cd0140a11","Type":"ContainerStarted","Data":"18889b41180b831a96b67fd61a1a700c53d4f8cd5d78d76cc7e83a496265ccff"}
Sep 16 13:34:58.889546 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:34:58.889488    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.920139458 podStartE2EDuration="16.889465664s" totalImagesPullingTime="12.949408114s" totalInitContainerRuntime="19.918092ms" isStatefulPod=false podCreationTimestamp="2026-09-16 13:34:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:34:58.88867119 +0000 UTC m=+108.135549015" watchObservedRunningTime="2026-09-16 13:34:58.889465664 +0000 UTC m=+108.136343491"
Sep 16 13:35:01.237768 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:01.237739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:35:01.238121 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:01.237787    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:35:03.239916 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:03.239838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:35:03.877464 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:03.877435    2563 generic.go:356] "Generic (PLEG): container finished" podID="27e26432-9ffc-4fa7-af88-a9ac82242fad" containerID="1f964810e5d549c608a368486a1ab8cde36f9c2fa90e594ee7b4855a8a9aa32a" exitCode=0
Sep 16 13:35:03.877689 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:03.877512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-jksst" event={"ID":"27e26432-9ffc-4fa7-af88-a9ac82242fad","Type":"ContainerDied","Data":"1f964810e5d549c608a368486a1ab8cde36f9c2fa90e594ee7b4855a8a9aa32a"}
Sep 16 13:35:03.877870 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:03.877856    2563 scope.go:117] "RemoveContainer" containerID="1f964810e5d549c608a368486a1ab8cde36f9c2fa90e594ee7b4855a8a9aa32a"
Sep 16 13:35:04.736521 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:04.736492    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-95t95_6579a61f-e766-47d4-8de5-b4fea959481a/serve-healthcheck-canary/0.log"
Sep 16 13:35:04.888183 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:04.888147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-jksst" event={"ID":"27e26432-9ffc-4fa7-af88-a9ac82242fad","Type":"ContainerStarted","Data":"370ba18f0de10f90841502d53ffc8dfcaeb2646e2a49928cd4eff99d55b0364b"}
Sep 16 13:35:09.836491 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:09.836436    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7778f49b4b-c6466" podUID="91de8217-85d9-415a-b35e-ed2b34aeb2de" containerName="console" containerID="cri-o://0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec" gracePeriod=15
Sep 16 13:35:10.119571 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.119535    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:35:10.171772 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.171736    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-config\") pod \"91de8217-85d9-415a-b35e-ed2b34aeb2de\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") "
Sep 16 13:35:10.171955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.171791    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vhzv\" (UniqueName: \"kubernetes.io/projected/91de8217-85d9-415a-b35e-ed2b34aeb2de-kube-api-access-5vhzv\") pod \"91de8217-85d9-415a-b35e-ed2b34aeb2de\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") "
Sep 16 13:35:10.171955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.171817    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-oauth-serving-cert\") pod \"91de8217-85d9-415a-b35e-ed2b34aeb2de\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") "
Sep 16 13:35:10.171955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.171856    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-oauth-config\") pod \"91de8217-85d9-415a-b35e-ed2b34aeb2de\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") "
Sep 16 13:35:10.171955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.171886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-service-ca\") pod \"91de8217-85d9-415a-b35e-ed2b34aeb2de\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") "
Sep 16 13:35:10.171955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.171911    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-serving-cert\") pod \"91de8217-85d9-415a-b35e-ed2b34aeb2de\" (UID: \"91de8217-85d9-415a-b35e-ed2b34aeb2de\") "
Sep 16 13:35:10.172305 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.172255    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-config" (OuterVolumeSpecName: "console-config") pod "91de8217-85d9-415a-b35e-ed2b34aeb2de" (UID: "91de8217-85d9-415a-b35e-ed2b34aeb2de"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:35:10.172460 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.172432    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91de8217-85d9-415a-b35e-ed2b34aeb2de" (UID: "91de8217-85d9-415a-b35e-ed2b34aeb2de"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:35:10.172530 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.172436    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-service-ca" (OuterVolumeSpecName: "service-ca") pod "91de8217-85d9-415a-b35e-ed2b34aeb2de" (UID: "91de8217-85d9-415a-b35e-ed2b34aeb2de"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:35:10.174419 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.174394    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91de8217-85d9-415a-b35e-ed2b34aeb2de" (UID: "91de8217-85d9-415a-b35e-ed2b34aeb2de"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:35:10.174585 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.174569    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91de8217-85d9-415a-b35e-ed2b34aeb2de-kube-api-access-5vhzv" (OuterVolumeSpecName: "kube-api-access-5vhzv") pod "91de8217-85d9-415a-b35e-ed2b34aeb2de" (UID: "91de8217-85d9-415a-b35e-ed2b34aeb2de"). InnerVolumeSpecName "kube-api-access-5vhzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:35:10.174585 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.174576    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91de8217-85d9-415a-b35e-ed2b34aeb2de" (UID: "91de8217-85d9-415a-b35e-ed2b34aeb2de"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:35:10.273346 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.273311    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-oauth-config\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:10.273346 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.273339    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:10.273346 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.273348    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-serving-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:10.273346 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.273358    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-console-config\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:10.273715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.273366    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vhzv\" (UniqueName: \"kubernetes.io/projected/91de8217-85d9-415a-b35e-ed2b34aeb2de-kube-api-access-5vhzv\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:10.273715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.273397    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91de8217-85d9-415a-b35e-ed2b34aeb2de-oauth-serving-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:10.912297 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.912264    2563 generic.go:356] "Generic (PLEG): container finished" podID="91de8217-85d9-415a-b35e-ed2b34aeb2de" containerID="0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec" exitCode=0
Sep 16 13:35:10.912810 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.912317    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7778f49b4b-c6466"
Sep 16 13:35:10.912810 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.912343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7778f49b4b-c6466" event={"ID":"91de8217-85d9-415a-b35e-ed2b34aeb2de","Type":"ContainerDied","Data":"0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec"}
Sep 16 13:35:10.912810 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.912424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7778f49b4b-c6466" event={"ID":"91de8217-85d9-415a-b35e-ed2b34aeb2de","Type":"ContainerDied","Data":"d4e04a632c806ec1fd2bf9c02b16f92ce00299294f90a847f6348c06ca97cc01"}
Sep 16 13:35:10.912810 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.912444    2563 scope.go:117] "RemoveContainer" containerID="0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec"
Sep 16 13:35:10.921817 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.921802    2563 scope.go:117] "RemoveContainer" containerID="0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec"
Sep 16 13:35:10.922079 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:35:10.922062    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec\": container with ID starting with 0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec not found: ID does not exist" containerID="0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec"
Sep 16 13:35:10.922116 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.922088    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec"} err="failed to get container status \"0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec\": rpc error: code = NotFound desc = could not find container \"0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec\": container with ID starting with 0662476dca859c14f29fde4ad21c25591326643a76bf5d4b2d18c36c8cc726ec not found: ID does not exist"
Sep 16 13:35:10.931856 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.931803    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7778f49b4b-c6466"]
Sep 16 13:35:10.933837 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:10.933818    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7778f49b4b-c6466"]
Sep 16 13:35:11.215582 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:11.215517    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91de8217-85d9-415a-b35e-ed2b34aeb2de" path="/var/lib/kubelet/pods/91de8217-85d9-415a-b35e-ed2b34aeb2de/volumes"
Sep 16 13:35:21.243115 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:21.243082    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:35:21.246942 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:21.246920    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-756dfbb69d-td6zz"
Sep 16 13:35:22.635966 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.635924    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5965fb6dcb-6k8ms" podUID="424a43f4-6c09-4906-a799-bb0d50aba686" containerName="console" containerID="cri-o://560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9" gracePeriod=15
Sep 16 13:35:22.915113 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.915031    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:35:22.969729 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.969697    2563 generic.go:356] "Generic (PLEG): container finished" podID="424a43f4-6c09-4906-a799-bb0d50aba686" containerID="560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9" exitCode=0
Sep 16 13:35:22.969898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.969746    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5965fb6dcb-6k8ms"
Sep 16 13:35:22.969898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.969790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5965fb6dcb-6k8ms" event={"ID":"424a43f4-6c09-4906-a799-bb0d50aba686","Type":"ContainerDied","Data":"560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9"}
Sep 16 13:35:22.969898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.969843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5965fb6dcb-6k8ms" event={"ID":"424a43f4-6c09-4906-a799-bb0d50aba686","Type":"ContainerDied","Data":"01de8c3fe4091440d88bcbe5d09fbd1f6cd80acc9fad8f54aa1af90651960061"}
Sep 16 13:35:22.969898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.969868    2563 scope.go:117] "RemoveContainer" containerID="560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9"
Sep 16 13:35:22.978241 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.978223    2563 scope.go:117] "RemoveContainer" containerID="560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9"
Sep 16 13:35:22.978644 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:35:22.978593    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9\": container with ID starting with 560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9 not found: ID does not exist" containerID="560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9"
Sep 16 13:35:22.978704 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.978655    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9"} err="failed to get container status \"560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9\": rpc error: code = NotFound desc = could not find container \"560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9\": container with ID starting with 560157af9e8fcf0cd2cac4f3f5ca54b1ad6095b5abab5491b89f42e355cf86e9 not found: ID does not exist"
Sep 16 13:35:22.984896 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.984877    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-trusted-ca-bundle\") pod \"424a43f4-6c09-4906-a799-bb0d50aba686\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") "
Sep 16 13:35:22.984986 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.984907    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-service-ca\") pod \"424a43f4-6c09-4906-a799-bb0d50aba686\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") "
Sep 16 13:35:22.984986 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.984957    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-oauth-config\") pod \"424a43f4-6c09-4906-a799-bb0d50aba686\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") "
Sep 16 13:35:22.985094 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.985069    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-console-config\") pod \"424a43f4-6c09-4906-a799-bb0d50aba686\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") "
Sep 16 13:35:22.985145 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.985099    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7q2m\" (UniqueName: \"kubernetes.io/projected/424a43f4-6c09-4906-a799-bb0d50aba686-kube-api-access-s7q2m\") pod \"424a43f4-6c09-4906-a799-bb0d50aba686\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") "
Sep 16 13:35:22.985205 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.985152    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-oauth-serving-cert\") pod \"424a43f4-6c09-4906-a799-bb0d50aba686\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") "
Sep 16 13:35:22.985272 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.985231    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-serving-cert\") pod \"424a43f4-6c09-4906-a799-bb0d50aba686\" (UID: \"424a43f4-6c09-4906-a799-bb0d50aba686\") "
Sep 16 13:35:22.985568 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.985514    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-service-ca" (OuterVolumeSpecName: "service-ca") pod "424a43f4-6c09-4906-a799-bb0d50aba686" (UID: "424a43f4-6c09-4906-a799-bb0d50aba686"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:35:22.985568 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.985522    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "424a43f4-6c09-4906-a799-bb0d50aba686" (UID: "424a43f4-6c09-4906-a799-bb0d50aba686"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:35:22.985568 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.985536    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-console-config" (OuterVolumeSpecName: "console-config") pod "424a43f4-6c09-4906-a799-bb0d50aba686" (UID: "424a43f4-6c09-4906-a799-bb0d50aba686"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:35:22.985991 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.985625    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "424a43f4-6c09-4906-a799-bb0d50aba686" (UID: "424a43f4-6c09-4906-a799-bb0d50aba686"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:35:22.987277 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.987252    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "424a43f4-6c09-4906-a799-bb0d50aba686" (UID: "424a43f4-6c09-4906-a799-bb0d50aba686"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:35:22.987429 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.987353    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/424a43f4-6c09-4906-a799-bb0d50aba686-kube-api-access-s7q2m" (OuterVolumeSpecName: "kube-api-access-s7q2m") pod "424a43f4-6c09-4906-a799-bb0d50aba686" (UID: "424a43f4-6c09-4906-a799-bb0d50aba686"). InnerVolumeSpecName "kube-api-access-s7q2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:35:22.987429 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:22.987389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "424a43f4-6c09-4906-a799-bb0d50aba686" (UID: "424a43f4-6c09-4906-a799-bb0d50aba686"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:35:23.086606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:23.086568    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-serving-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:23.086606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:23.086596    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-trusted-ca-bundle\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:23.086606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:23.086607    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:23.086606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:23.086618    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/424a43f4-6c09-4906-a799-bb0d50aba686-console-oauth-config\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:23.086875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:23.086627    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-console-config\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:23.086875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:23.086635    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7q2m\" (UniqueName: \"kubernetes.io/projected/424a43f4-6c09-4906-a799-bb0d50aba686-kube-api-access-s7q2m\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:23.086875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:23.086643    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/424a43f4-6c09-4906-a799-bb0d50aba686-oauth-serving-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:35:23.284528 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:23.284494    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5965fb6dcb-6k8ms"]
Sep 16 13:35:23.286537 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:23.286510    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5965fb6dcb-6k8ms"]
Sep 16 13:35:25.216052 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:25.216017    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="424a43f4-6c09-4906-a799-bb0d50aba686" path="/var/lib/kubelet/pods/424a43f4-6c09-4906-a799-bb0d50aba686/volumes"
Sep 16 13:35:43.240444 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:43.240411    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:35:43.259733 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:43.259705    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:35:44.073182 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:35:44.073151    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:37:55.206138 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.206102    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"]
Sep 16 13:37:55.206597 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.206432    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="424a43f4-6c09-4906-a799-bb0d50aba686" containerName="console"
Sep 16 13:37:55.206597 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.206443    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="424a43f4-6c09-4906-a799-bb0d50aba686" containerName="console"
Sep 16 13:37:55.206597 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.206463    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91de8217-85d9-415a-b35e-ed2b34aeb2de" containerName="console"
Sep 16 13:37:55.206597 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.206469    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="91de8217-85d9-415a-b35e-ed2b34aeb2de" containerName="console"
Sep 16 13:37:55.206597 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.206554    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="91de8217-85d9-415a-b35e-ed2b34aeb2de" containerName="console"
Sep 16 13:37:55.206597 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.206561    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="424a43f4-6c09-4906-a799-bb0d50aba686" containerName="console"
Sep 16 13:37:55.209669 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.209653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"
Sep 16 13:37:55.211826 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.211805    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 13:37:55.212481 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.212460    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 13:37:55.212631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.212533    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-d65xx\""
Sep 16 13:37:55.218574 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.218552    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"]
Sep 16 13:37:55.289282 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.289240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jhlw\" (UniqueName: \"kubernetes.io/projected/65bf85b9-8f67-48a7-9005-261c16245c8d-kube-api-access-7jhlw\") pod \"cert-manager-cainjector-559cdd8c87-tdd99\" (UID: \"65bf85b9-8f67-48a7-9005-261c16245c8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"
Sep 16 13:37:55.289489 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.289316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65bf85b9-8f67-48a7-9005-261c16245c8d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tdd99\" (UID: \"65bf85b9-8f67-48a7-9005-261c16245c8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"
Sep 16 13:37:55.390515 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.390482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65bf85b9-8f67-48a7-9005-261c16245c8d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tdd99\" (UID: \"65bf85b9-8f67-48a7-9005-261c16245c8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"
Sep 16 13:37:55.390718 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.390570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jhlw\" (UniqueName: \"kubernetes.io/projected/65bf85b9-8f67-48a7-9005-261c16245c8d-kube-api-access-7jhlw\") pod \"cert-manager-cainjector-559cdd8c87-tdd99\" (UID: \"65bf85b9-8f67-48a7-9005-261c16245c8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"
Sep 16 13:37:55.397976 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.397941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65bf85b9-8f67-48a7-9005-261c16245c8d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tdd99\" (UID: \"65bf85b9-8f67-48a7-9005-261c16245c8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"
Sep 16 13:37:55.398517 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.398498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jhlw\" (UniqueName: \"kubernetes.io/projected/65bf85b9-8f67-48a7-9005-261c16245c8d-kube-api-access-7jhlw\") pod \"cert-manager-cainjector-559cdd8c87-tdd99\" (UID: \"65bf85b9-8f67-48a7-9005-261c16245c8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"
Sep 16 13:37:55.528836 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.528749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"
Sep 16 13:37:55.799434 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:55.799319    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tdd99"]
Sep 16 13:37:55.801949 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:37:55.801926    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65bf85b9_8f67_48a7_9005_261c16245c8d.slice/crio-5527a4c974111eed129e50f958b85dc50930f70268c9d8a70d68419f33edafa3 WatchSource:0}: Error finding container 5527a4c974111eed129e50f958b85dc50930f70268c9d8a70d68419f33edafa3: Status 404 returned error can't find the container with id 5527a4c974111eed129e50f958b85dc50930f70268c9d8a70d68419f33edafa3
Sep 16 13:37:56.588093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:56.588034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99" event={"ID":"65bf85b9-8f67-48a7-9005-261c16245c8d","Type":"ContainerStarted","Data":"5527a4c974111eed129e50f958b85dc50930f70268c9d8a70d68419f33edafa3"}
Sep 16 13:37:59.603715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:59.603680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99" event={"ID":"65bf85b9-8f67-48a7-9005-261c16245c8d","Type":"ContainerStarted","Data":"abf8136f65e6b40ea96db93357a5a14f0c5a72aad2c26f461221c556a7cd6623"}
Sep 16 13:37:59.619807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:37:59.619752    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdd99" podStartSLOduration=1.532670854 podStartE2EDuration="4.619736991s" totalImagesPullingTime="3.087066137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:37:59.618789575 +0000 UTC m=+288.865667446" watchObservedRunningTime="2026-09-16 13:37:59.619736991 +0000 UTC m=+288.866614815"
Sep 16 13:38:11.096850 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:11.096824    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:38:11.100983 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:11.100957    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:38:11.107358 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:11.107339    2563 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 13:38:22.130387 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.130340    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"]
Sep 16 13:38:22.133630 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.133615    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.136056 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.136029    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 13:38:22.136194 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.136115    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 13:38:22.136297 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.136281    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 13:38:22.136365 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.136315    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8t96b\""
Sep 16 13:38:22.136365 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.136354    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 13:38:22.156219 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.156197    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"]
Sep 16 13:38:22.220647 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.220603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-tmp\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.220814 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.220668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.220814 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.220727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-manifests\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.220814 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.220749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.220925 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.220842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9cvb\" (UniqueName: \"kubernetes.io/projected/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-kube-api-access-q9cvb\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.321790 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.321747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9cvb\" (UniqueName: \"kubernetes.io/projected/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-kube-api-access-q9cvb\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.321790 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.321800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-tmp\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.322045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.321839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.322045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.321872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-manifests\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.322045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.321946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.322266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.322248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-manifests\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.324357 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.324336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-tmp\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.324488 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.324438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.324594 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.324576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.333787 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.333765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9cvb\" (UniqueName: \"kubernetes.io/projected/9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc-kube-api-access-q9cvb\") pod \"opendatahub-operator-controller-manager-6444576fdb-zkqqr\" (UID: \"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.443684 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.443600    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:22.763785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.763759    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"]
Sep 16 13:38:22.765446 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:38:22.765418    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cab71ed_cfd7_4c88_bd58_ffe4bb3b57dc.slice/crio-d8e452a4c13e90764fbdfbb657c84d6e77dfa06c2db793cc34020e7c44a034e3 WatchSource:0}: Error finding container d8e452a4c13e90764fbdfbb657c84d6e77dfa06c2db793cc34020e7c44a034e3: Status 404 returned error can't find the container with id d8e452a4c13e90764fbdfbb657c84d6e77dfa06c2db793cc34020e7c44a034e3
Sep 16 13:38:22.767145 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:22.767128    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:38:23.702621 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:23.702582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr" event={"ID":"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc","Type":"ContainerStarted","Data":"d8e452a4c13e90764fbdfbb657c84d6e77dfa06c2db793cc34020e7c44a034e3"}
Sep 16 13:38:25.713756 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:25.713674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr" event={"ID":"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc","Type":"ContainerStarted","Data":"d3ed92c368cc80145d0d8ac4bc4c7f1209d4e46a7ec28c90c84408d251d6343e"}
Sep 16 13:38:26.719073 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:26.719039    2563 generic.go:356] "Generic (PLEG): container finished" podID="9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc" containerID="d3ed92c368cc80145d0d8ac4bc4c7f1209d4e46a7ec28c90c84408d251d6343e" exitCode=0
Sep 16 13:38:26.719470 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:26.719127    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr" event={"ID":"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc","Type":"ContainerDied","Data":"d3ed92c368cc80145d0d8ac4bc4c7f1209d4e46a7ec28c90c84408d251d6343e"}
Sep 16 13:38:27.726282 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:27.726241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr" event={"ID":"9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc","Type":"ContainerStarted","Data":"eaa4763745712dad2af09a9adf14436fc01b081b00986e57936e6cc5406b13d9"}
Sep 16 13:38:27.726701 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:27.726416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:27.749123 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:27.749073    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr" podStartSLOduration=1.718079762 podStartE2EDuration="5.749058096s" totalImagesPullingTime="2.965778218s" totalInitContainerRuntime="1.065200116s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:38:27.748156968 +0000 UTC m=+316.995034793" watchObservedRunningTime="2026-09-16 13:38:27.749058096 +0000 UTC m=+316.995935918"
Sep 16 13:38:38.733050 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:38.733015    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6444576fdb-zkqqr"
Sep 16 13:38:42.196538 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.196506    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"]
Sep 16 13:38:42.199675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.199656    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.203024 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.202998    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 13:38:42.203138 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.203047    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 13:38:42.203138 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.203103    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 13:38:42.203138 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.203123    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 13:38:42.203296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.203275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ccjkg\""
Sep 16 13:38:42.203352 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.203309    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 13:38:42.211996 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.211976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"]
Sep 16 13:38:42.293937 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.293900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngpg6\" (UniqueName: \"kubernetes.io/projected/b3322248-37be-4a7e-92fa-2f360a093770-kube-api-access-ngpg6\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.293937 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.293939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3322248-37be-4a7e-92fa-2f360a093770-manager-config\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.294168 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.293973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3322248-37be-4a7e-92fa-2f360a093770-metrics-cert\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.294168 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.294007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3322248-37be-4a7e-92fa-2f360a093770-cert\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.394782 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.394736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngpg6\" (UniqueName: \"kubernetes.io/projected/b3322248-37be-4a7e-92fa-2f360a093770-kube-api-access-ngpg6\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.394782 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.394785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3322248-37be-4a7e-92fa-2f360a093770-manager-config\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.395025 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.394802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3322248-37be-4a7e-92fa-2f360a093770-metrics-cert\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.395025 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.394827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3322248-37be-4a7e-92fa-2f360a093770-cert\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.395363 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.395344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3322248-37be-4a7e-92fa-2f360a093770-manager-config\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.397406 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.397359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3322248-37be-4a7e-92fa-2f360a093770-cert\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.397603 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.397584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3322248-37be-4a7e-92fa-2f360a093770-metrics-cert\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.404510 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.404483    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngpg6\" (UniqueName: \"kubernetes.io/projected/b3322248-37be-4a7e-92fa-2f360a093770-kube-api-access-ngpg6\") pod \"lws-controller-manager-8878d4c7-jbqc6\" (UID: \"b3322248-37be-4a7e-92fa-2f360a093770\") " pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.508750 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.508668    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:42.784555 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.784440    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"]
Sep 16 13:38:42.787071 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:38:42.787045    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3322248_37be_4a7e_92fa_2f360a093770.slice/crio-46b709f09fb531de9e2dcdd4c7d443d574f695c33883aa6250d34b928c5937c0 WatchSource:0}: Error finding container 46b709f09fb531de9e2dcdd4c7d443d574f695c33883aa6250d34b928c5937c0: Status 404 returned error can't find the container with id 46b709f09fb531de9e2dcdd4c7d443d574f695c33883aa6250d34b928c5937c0
Sep 16 13:38:42.793948 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:42.793922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6" event={"ID":"b3322248-37be-4a7e-92fa-2f360a093770","Type":"ContainerStarted","Data":"46b709f09fb531de9e2dcdd4c7d443d574f695c33883aa6250d34b928c5937c0"}
Sep 16 13:38:45.815569 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:45.815532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6" event={"ID":"b3322248-37be-4a7e-92fa-2f360a093770","Type":"ContainerStarted","Data":"6a8d9f14ed7410667cc774288c310aebb2ba2ae8fcdab1eff875be9eaf5bea8b"}
Sep 16 13:38:45.815943 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:45.815611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:45.830922 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:45.830880    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6" podStartSLOduration=1.666591181 podStartE2EDuration="3.830866555s" totalImagesPullingTime="2.164275374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:38:45.829463472 +0000 UTC m=+335.076341296" watchObservedRunningTime="2026-09-16 13:38:45.830866555 +0000 UTC m=+335.077744378"
Sep 16 13:38:49.073805 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.073774    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"]
Sep 16 13:38:49.077360 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.077339    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.081283 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.081264    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 13:38:49.081627 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.081612    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 13:38:49.083350 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.083329    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8k8g7\""
Sep 16 13:38:49.083567 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.083547    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 13:38:49.091535 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.091515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"]
Sep 16 13:38:49.153605 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.153574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.153605 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.153609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.153836 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.153631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.153836 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.153670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.153836 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.153737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/324cdf62-32ba-4686-a2db-7429d0c87486-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.153836 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.153784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/324cdf62-32ba-4686-a2db-7429d0c87486-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.153836 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.153810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66sv9\" (UniqueName: \"kubernetes.io/projected/324cdf62-32ba-4686-a2db-7429d0c87486-kube-api-access-66sv9\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.153836 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.153827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/324cdf62-32ba-4686-a2db-7429d0c87486-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.154042 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.153872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.254644 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.254607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.254644 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.254650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.254879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.254672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.254879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.254702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.254879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.254727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/324cdf62-32ba-4686-a2db-7429d0c87486-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.254879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.254753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/324cdf62-32ba-4686-a2db-7429d0c87486-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.254879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.254780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66sv9\" (UniqueName: \"kubernetes.io/projected/324cdf62-32ba-4686-a2db-7429d0c87486-kube-api-access-66sv9\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.254879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.254818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/324cdf62-32ba-4686-a2db-7429d0c87486-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.254879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.254851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.255207 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.255078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.255207 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.255137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.255207 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.255185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.255330 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.255308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.255707 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.255690    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/324cdf62-32ba-4686-a2db-7429d0c87486-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.257577 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.257563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/324cdf62-32ba-4686-a2db-7429d0c87486-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.257898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.257876    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/324cdf62-32ba-4686-a2db-7429d0c87486-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.262854 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.262833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66sv9\" (UniqueName: \"kubernetes.io/projected/324cdf62-32ba-4686-a2db-7429d0c87486-kube-api-access-66sv9\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.262967 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.262913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/324cdf62-32ba-4686-a2db-7429d0c87486-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7\" (UID: \"324cdf62-32ba-4686-a2db-7429d0c87486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.387213 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.387179    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:49.661730 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.661675    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"]
Sep 16 13:38:49.666332 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:38:49.666299    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324cdf62_32ba_4686_a2db_7429d0c87486.slice/crio-c59fd9c2971a858bffbe47edb9a89f1f727bedc282d1ab89cecf8b6dbac9e083 WatchSource:0}: Error finding container c59fd9c2971a858bffbe47edb9a89f1f727bedc282d1ab89cecf8b6dbac9e083: Status 404 returned error can't find the container with id c59fd9c2971a858bffbe47edb9a89f1f727bedc282d1ab89cecf8b6dbac9e083
Sep 16 13:38:49.832468 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:49.832431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7" event={"ID":"324cdf62-32ba-4686-a2db-7429d0c87486","Type":"ContainerStarted","Data":"c59fd9c2971a858bffbe47edb9a89f1f727bedc282d1ab89cecf8b6dbac9e083"}
Sep 16 13:38:52.164197 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.164159    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-r7q6m"]
Sep 16 13:38:52.168830 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.168811    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:38:52.170804 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.170786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 16 13:38:52.170906 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.170859    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-sbvwt\""
Sep 16 13:38:52.175194 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.175172    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-r7q6m"]
Sep 16 13:38:52.282889 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.282851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3c776c2-1340-496b-9c2b-54b18235599e-cert\") pod \"odh-model-controller-7998c67dc4-r7q6m\" (UID: \"c3c776c2-1340-496b-9c2b-54b18235599e\") " pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:38:52.283072 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.282946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82gkn\" (UniqueName: \"kubernetes.io/projected/c3c776c2-1340-496b-9c2b-54b18235599e-kube-api-access-82gkn\") pod \"odh-model-controller-7998c67dc4-r7q6m\" (UID: \"c3c776c2-1340-496b-9c2b-54b18235599e\") " pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:38:52.384192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.384158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3c776c2-1340-496b-9c2b-54b18235599e-cert\") pod \"odh-model-controller-7998c67dc4-r7q6m\" (UID: \"c3c776c2-1340-496b-9c2b-54b18235599e\") " pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:38:52.384435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.384240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82gkn\" (UniqueName: \"kubernetes.io/projected/c3c776c2-1340-496b-9c2b-54b18235599e-kube-api-access-82gkn\") pod \"odh-model-controller-7998c67dc4-r7q6m\" (UID: \"c3c776c2-1340-496b-9c2b-54b18235599e\") " pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:38:52.394206 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.392880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3c776c2-1340-496b-9c2b-54b18235599e-cert\") pod \"odh-model-controller-7998c67dc4-r7q6m\" (UID: \"c3c776c2-1340-496b-9c2b-54b18235599e\") " pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:38:52.404594 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.404562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82gkn\" (UniqueName: \"kubernetes.io/projected/c3c776c2-1340-496b-9c2b-54b18235599e-kube-api-access-82gkn\") pod \"odh-model-controller-7998c67dc4-r7q6m\" (UID: \"c3c776c2-1340-496b-9c2b-54b18235599e\") " pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:38:52.480560 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.480390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:38:52.765250 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.765222    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2rfx8"]
Sep 16 13:38:52.768811 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.768770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:52.771031 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.771009    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 13:38:52.777449 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.777427    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2rfx8"]
Sep 16 13:38:52.888168 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.888132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcd8b\" (UniqueName: \"kubernetes.io/projected/c2a88169-8184-4efa-803d-ee8aa0f53fb4-kube-api-access-vcd8b\") pod \"model-serving-api-54d89bd5fc-2rfx8\" (UID: \"c2a88169-8184-4efa-803d-ee8aa0f53fb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:52.888360 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.888206    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2a88169-8184-4efa-803d-ee8aa0f53fb4-tls-certs\") pod \"model-serving-api-54d89bd5fc-2rfx8\" (UID: \"c2a88169-8184-4efa-803d-ee8aa0f53fb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:52.963776 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.963728    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-r7q6m"]
Sep 16 13:38:52.967028 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:38:52.966996    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c776c2_1340_496b_9c2b_54b18235599e.slice/crio-8a80bccac3321621c63bf41429e9f7f4648b460aa153bf9bc13cbca3a4dac797 WatchSource:0}: Error finding container 8a80bccac3321621c63bf41429e9f7f4648b460aa153bf9bc13cbca3a4dac797: Status 404 returned error can't find the container with id 8a80bccac3321621c63bf41429e9f7f4648b460aa153bf9bc13cbca3a4dac797
Sep 16 13:38:52.989164 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.989133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcd8b\" (UniqueName: \"kubernetes.io/projected/c2a88169-8184-4efa-803d-ee8aa0f53fb4-kube-api-access-vcd8b\") pod \"model-serving-api-54d89bd5fc-2rfx8\" (UID: \"c2a88169-8184-4efa-803d-ee8aa0f53fb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:52.989286 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.989191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2a88169-8184-4efa-803d-ee8aa0f53fb4-tls-certs\") pod \"model-serving-api-54d89bd5fc-2rfx8\" (UID: \"c2a88169-8184-4efa-803d-ee8aa0f53fb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:52.989491 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:38:52.989396    2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 16 13:38:52.989491 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:38:52.989471    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2a88169-8184-4efa-803d-ee8aa0f53fb4-tls-certs podName:c2a88169-8184-4efa-803d-ee8aa0f53fb4 nodeName:}" failed. No retries permitted until 2026-09-16 13:38:53.489442529 +0000 UTC m=+342.736320349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c2a88169-8184-4efa-803d-ee8aa0f53fb4-tls-certs") pod "model-serving-api-54d89bd5fc-2rfx8" (UID: "c2a88169-8184-4efa-803d-ee8aa0f53fb4") : secret "model-serving-api-tls" not found
Sep 16 13:38:52.997734 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:52.997675    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcd8b\" (UniqueName: \"kubernetes.io/projected/c2a88169-8184-4efa-803d-ee8aa0f53fb4-kube-api-access-vcd8b\") pod \"model-serving-api-54d89bd5fc-2rfx8\" (UID: \"c2a88169-8184-4efa-803d-ee8aa0f53fb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:53.495045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:53.494988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2a88169-8184-4efa-803d-ee8aa0f53fb4-tls-certs\") pod \"model-serving-api-54d89bd5fc-2rfx8\" (UID: \"c2a88169-8184-4efa-803d-ee8aa0f53fb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:53.498115 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:53.498030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2a88169-8184-4efa-803d-ee8aa0f53fb4-tls-certs\") pod \"model-serving-api-54d89bd5fc-2rfx8\" (UID: \"c2a88169-8184-4efa-803d-ee8aa0f53fb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:53.684461 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:53.684411    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:53.854053 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:53.853964    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m" event={"ID":"c3c776c2-1340-496b-9c2b-54b18235599e","Type":"ContainerStarted","Data":"8a80bccac3321621c63bf41429e9f7f4648b460aa153bf9bc13cbca3a4dac797"}
Sep 16 13:38:54.284241 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:54.284200    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:38:54.284354 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:54.284295    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:38:54.284354 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:54.284338    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:38:54.488056 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:54.487925    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2rfx8"]
Sep 16 13:38:54.860526 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:54.860406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8" event={"ID":"c2a88169-8184-4efa-803d-ee8aa0f53fb4","Type":"ContainerStarted","Data":"555acd48294727469824db2bb5523133679e8ba32e155cbe25559bf38a97d062"}
Sep 16 13:38:54.869115 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:54.869042    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7" event={"ID":"324cdf62-32ba-4686-a2db-7429d0c87486","Type":"ContainerStarted","Data":"d2c4d69419b0bd6765dcc74242c423c2a9eff22d07a30d74b798073ee0fec593"}
Sep 16 13:38:54.889252 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:54.889190    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7" podStartSLOduration=1.2746616880000001 podStartE2EDuration="5.889169826s" totalImagesPullingTime="4.614508138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:38:54.887451432 +0000 UTC m=+344.134329258" watchObservedRunningTime="2026-09-16 13:38:54.889169826 +0000 UTC m=+344.136047651"
Sep 16 13:38:55.392003 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:55.391927    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:55.398733 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:55.398498    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:55.875559 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:55.875524    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:55.876855 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:55.876829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7"
Sep 16 13:38:56.821764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:56.821734    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8878d4c7-jbqc6"
Sep 16 13:38:58.893651 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:58.893620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m" event={"ID":"c3c776c2-1340-496b-9c2b-54b18235599e","Type":"ContainerStarted","Data":"078b39f6613e4460a613c176d5d26e16c90031413111d784c6f33c8a392183ab"}
Sep 16 13:38:58.894096 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:58.893734    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:38:58.895219 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:58.895193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8" event={"ID":"c2a88169-8184-4efa-803d-ee8aa0f53fb4","Type":"ContainerStarted","Data":"87c54d2d72aa080d24707edcba110ddce20ed9f0e501c2e04a592cbb80c66901"}
Sep 16 13:38:58.895332 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:58.895318    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:38:58.939164 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:58.939117    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m" podStartSLOduration=2.042327536 podStartE2EDuration="6.939102173s" totalImagesPullingTime="4.896774637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:38:58.937465463 +0000 UTC m=+348.184343287" watchObservedRunningTime="2026-09-16 13:38:58.939102173 +0000 UTC m=+348.185979997"
Sep 16 13:38:58.972523 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:58.972468    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8" podStartSLOduration=3.564928368 podStartE2EDuration="6.972452473s" totalImagesPullingTime="3.407524105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:38:58.971164512 +0000 UTC m=+348.218042335" watchObservedRunningTime="2026-09-16 13:38:58.972452473 +0000 UTC m=+348.219330296"
Sep 16 13:38:59.830821 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.830788    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"]
Sep 16 13:38:59.840756 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.840735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:38:59.843104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.843085    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 13:38:59.843234 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.843083    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 13:38:59.843234 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.843175    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 13:38:59.843234 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.843204    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6ml29\""
Sep 16 13:38:59.847195 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.847175    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"]
Sep 16 13:38:59.960323 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.960280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtndd\" (UniqueName: \"kubernetes.io/projected/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-kube-api-access-vtndd\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:38:59.960323 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.960321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:38:59.960842 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.960452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:38:59.960842 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.960554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:38:59.960842 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.960608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:38:59.960842 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.960653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:38:59.960842 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:38:59.960678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.061876 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.061839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtndd\" (UniqueName: \"kubernetes.io/projected/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-kube-api-access-vtndd\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.061876 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.061878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.062104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.061946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.062104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.061981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.062104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.062011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.062104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.062037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.062104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.062060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.062769 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.062744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.064556 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.064523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.064678 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.064534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.064775 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.064756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.064857 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.064835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.070216 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.070195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtndd\" (UniqueName: \"kubernetes.io/projected/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-kube-api-access-vtndd\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.071561 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.071540    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d3d4ca-5d76-4e9f-afc5-9a7927f14885-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-q5psz\" (UID: \"38d3d4ca-5d76-4e9f-afc5-9a7927f14885\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.151718 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.151683    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:00.430575 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.430545    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"]
Sep 16 13:39:00.432672 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:39:00.432642    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d3d4ca_5d76_4e9f_afc5_9a7927f14885.slice/crio-74e7ede732dd97c13128934e5c78de77d3b00dcae192955f4ad39babd1176005 WatchSource:0}: Error finding container 74e7ede732dd97c13128934e5c78de77d3b00dcae192955f4ad39babd1176005: Status 404 returned error can't find the container with id 74e7ede732dd97c13128934e5c78de77d3b00dcae192955f4ad39babd1176005
Sep 16 13:39:00.907255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:00.907220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz" event={"ID":"38d3d4ca-5d76-4e9f-afc5-9a7927f14885","Type":"ContainerStarted","Data":"74e7ede732dd97c13128934e5c78de77d3b00dcae192955f4ad39babd1176005"}
Sep 16 13:39:02.640894 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:02.640860    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:39:02.641457 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:02.640926    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:39:02.918127 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:02.918034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz" event={"ID":"38d3d4ca-5d76-4e9f-afc5-9a7927f14885","Type":"ContainerStarted","Data":"20cac62d22f6d747ed15d887c35165e0251ee1e3e6f686c531c84ce903cd179d"}
Sep 16 13:39:02.918127 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:02.918118    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:02.940876 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:02.940826    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz" podStartSLOduration=1.7349196839999999 podStartE2EDuration="3.94080874s" totalImagesPullingTime="2.205889056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:39:02.939596248 +0000 UTC m=+352.186474072" watchObservedRunningTime="2026-09-16 13:39:02.94080874 +0000 UTC m=+352.187686564"
Sep 16 13:39:03.924019 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:03.923992    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-q5psz"
Sep 16 13:39:09.905146 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:09.905108    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-r7q6m"
Sep 16 13:39:09.907940 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:39:09.907920    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-2rfx8"
Sep 16 13:40:48.633411 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.633311    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"]
Sep 16 13:40:48.636825 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.636809    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:40:48.639642 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.639609    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 13:40:48.639977 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.639961    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ldzgv\""
Sep 16 13:40:48.640233 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.640219    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 13:40:48.649838 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.649815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"]
Sep 16 13:40:48.669337 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.669309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c61cef-8fa3-41fb-a2f7-e6e240432171-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cfs9\" (UID: \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:40:48.669513 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.669404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvgtn\" (UniqueName: \"kubernetes.io/projected/e3c61cef-8fa3-41fb-a2f7-e6e240432171-kube-api-access-lvgtn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cfs9\" (UID: \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:40:48.769861 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.769831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c61cef-8fa3-41fb-a2f7-e6e240432171-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cfs9\" (UID: \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:40:48.770028 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.769925    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvgtn\" (UniqueName: \"kubernetes.io/projected/e3c61cef-8fa3-41fb-a2f7-e6e240432171-kube-api-access-lvgtn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cfs9\" (UID: \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:40:48.770223 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.770206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c61cef-8fa3-41fb-a2f7-e6e240432171-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cfs9\" (UID: \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:40:48.783022 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.782987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvgtn\" (UniqueName: \"kubernetes.io/projected/e3c61cef-8fa3-41fb-a2f7-e6e240432171-kube-api-access-lvgtn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-8cfs9\" (UID: \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:40:48.946602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:48.946517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:40:49.221352 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:49.221258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"]
Sep 16 13:40:49.224226 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:40:49.224198    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c61cef_8fa3_41fb_a2f7_e6e240432171.slice/crio-94fb58a45a046311d24fe311419f09c93416f4bd95ab5ea22b19514759f60860 WatchSource:0}: Error finding container 94fb58a45a046311d24fe311419f09c93416f4bd95ab5ea22b19514759f60860: Status 404 returned error can't find the container with id 94fb58a45a046311d24fe311419f09c93416f4bd95ab5ea22b19514759f60860
Sep 16 13:40:49.403929 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:49.403894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9" event={"ID":"e3c61cef-8fa3-41fb-a2f7-e6e240432171","Type":"ContainerStarted","Data":"94fb58a45a046311d24fe311419f09c93416f4bd95ab5ea22b19514759f60860"}
Sep 16 13:40:53.428250 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:53.428216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9" event={"ID":"e3c61cef-8fa3-41fb-a2f7-e6e240432171","Type":"ContainerStarted","Data":"ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7"}
Sep 16 13:40:53.428633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:53.428284    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:40:53.446676 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:40:53.446617    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9" podStartSLOduration=1.725776725 podStartE2EDuration="5.446598857s" totalImagesPullingTime="3.720822132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:40:53.445905822 +0000 UTC m=+462.692783649" watchObservedRunningTime="2026-09-16 13:40:53.446598857 +0000 UTC m=+462.693476683"
Sep 16 13:41:04.435543 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:41:04.435513    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:43:11.132531 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:11.132505    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:43:11.133019 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:11.132763    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:43:14.632367 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.632333    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"]
Sep 16 13:43:14.636995 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.636972    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.640255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.640121    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 13:43:14.640255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.640135    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 13:43:14.640255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.640143    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xh5w6\""
Sep 16 13:43:14.640255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.640121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 13:43:14.645817 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.645795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"]
Sep 16 13:43:14.777044 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.777013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.777044 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.777046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.777260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.777066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.777260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.777089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/117d6a45-2a88-4803-ba78-b726453bb834-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.777260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.777166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.777260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.777191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cn4v\" (UniqueName: \"kubernetes.io/projected/117d6a45-2a88-4803-ba78-b726453bb834-kube-api-access-9cn4v\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.878449 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.878411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.878449 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.878451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.878705 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.878476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.878705 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.878502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/117d6a45-2a88-4803-ba78-b726453bb834-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.878705 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.878543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.878705 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.878570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cn4v\" (UniqueName: \"kubernetes.io/projected/117d6a45-2a88-4803-ba78-b726453bb834-kube-api-access-9cn4v\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.878908 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.878868    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.878968 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.878919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.879038 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.879018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.880993 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.880969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/117d6a45-2a88-4803-ba78-b726453bb834-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.881116 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.881044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/117d6a45-2a88-4803-ba78-b726453bb834-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.886294 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.886236    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cn4v\" (UniqueName: \"kubernetes.io/projected/117d6a45-2a88-4803-ba78-b726453bb834-kube-api-access-9cn4v\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5s4p\" (UID: \"117d6a45-2a88-4803-ba78-b726453bb834\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:14.949988 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:14.949949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:15.221155 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:15.221135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"]
Sep 16 13:43:15.223543 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:43:15.223519    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117d6a45_2a88_4803_ba78_b726453bb834.slice/crio-965b850e061868f1fae0db2ad6ec4673da4dc37d794c307b953c1e6f76d88768 WatchSource:0}: Error finding container 965b850e061868f1fae0db2ad6ec4673da4dc37d794c307b953c1e6f76d88768: Status 404 returned error can't find the container with id 965b850e061868f1fae0db2ad6ec4673da4dc37d794c307b953c1e6f76d88768
Sep 16 13:43:16.104966 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:16.104925    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p" event={"ID":"117d6a45-2a88-4803-ba78-b726453bb834","Type":"ContainerStarted","Data":"965b850e061868f1fae0db2ad6ec4673da4dc37d794c307b953c1e6f76d88768"}
Sep 16 13:43:17.111899 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:17.111864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p" event={"ID":"117d6a45-2a88-4803-ba78-b726453bb834","Type":"ContainerStarted","Data":"53f918960ecf96372fe1f492b8b4a349fea72145a58ea2a3bd222e63073695ca"}
Sep 16 13:43:17.129193 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:17.129145    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p" podStartSLOduration=2.104995556 podStartE2EDuration="3.129128037s" totalImagesPullingTime="1.024132481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:43:17.127737153 +0000 UTC m=+606.374614979" watchObservedRunningTime="2026-09-16 13:43:17.129128037 +0000 UTC m=+606.376005862"
Sep 16 13:43:24.037580 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.037545    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"]
Sep 16 13:43:24.042009 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.041987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.044015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.043996    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 16 13:43:24.050181 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.050156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"]
Sep 16 13:43:24.166858 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.166821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.167029 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.166879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.167029 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.166968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.167109 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.167059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2b2d87-8085-4358-a35c-b48b4129512f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.167109 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.167081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8r4\" (UniqueName: \"kubernetes.io/projected/cc2b2d87-8085-4358-a35c-b48b4129512f-kube-api-access-9j8r4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.167204 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.167143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.268130 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.268096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.268334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.268147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.268334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.268180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.268334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.268215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2b2d87-8085-4358-a35c-b48b4129512f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.268334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.268236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8r4\" (UniqueName: \"kubernetes.io/projected/cc2b2d87-8085-4358-a35c-b48b4129512f-kube-api-access-9j8r4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.268334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.268268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.268656 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.268573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.268656 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.268605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.268731 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.268699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.270746 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.270724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2b2d87-8085-4358-a35c-b48b4129512f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.270885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.270868    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2b2d87-8085-4358-a35c-b48b4129512f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.277506 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.277485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8r4\" (UniqueName: \"kubernetes.io/projected/cc2b2d87-8085-4358-a35c-b48b4129512f-kube-api-access-9j8r4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk\" (UID: \"cc2b2d87-8085-4358-a35c-b48b4129512f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.354645 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.354556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:24.626279 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.626258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"]
Sep 16 13:43:24.631547 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.631522    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:43:24.951036 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.950999    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:24.951199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.951065    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:24.963297 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:24.963274    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:25.151683 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:25.151592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk" event={"ID":"cc2b2d87-8085-4358-a35c-b48b4129512f","Type":"ContainerStarted","Data":"0a82cdbc2281b7eb319c1fc52987d2c29a2e42e4ca3cdab3a61f7c8bd96988d2"}
Sep 16 13:43:25.151683 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:25.151651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk" event={"ID":"cc2b2d87-8085-4358-a35c-b48b4129512f","Type":"ContainerStarted","Data":"a7dc4a8fe3007800228f995cdcda9e819db8e879ea53b6711d430f0034273eab"}
Sep 16 13:43:25.163009 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:25.162984    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5s4p"
Sep 16 13:43:25.168926 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:25.168885    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk" podStartSLOduration=0.953136422 podStartE2EDuration="1.168869215s" totalImagesPullingTime="215.732793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:43:25.167217015 +0000 UTC m=+614.414094840" watchObservedRunningTime="2026-09-16 13:43:25.168869215 +0000 UTC m=+614.415747040"
Sep 16 13:43:34.355157 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:34.355063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:34.355157 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:34.355144    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:34.367621 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:34.367596    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:43:35.216528 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:43:35.216500    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk"
Sep 16 13:45:00.146468 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:00.146437    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f"]
Sep 16 13:45:00.149866 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:00.149849    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f"
Sep 16 13:45:00.152037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:00.152014    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmnnx\""
Sep 16 13:45:00.157298 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:00.157283    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f"]
Sep 16 13:45:00.160486 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:00.160466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f"
Sep 16 13:45:00.430466 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:00.430442    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f"]
Sep 16 13:45:00.432555 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:45:00.432521    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fd4327_d20a_4e13_8c21_ff792bcaf84a.slice/crio-861c928d44c75d93567379238fb5bae74aa8868ffe37ed32770d21258067c43f WatchSource:0}: Error finding container 861c928d44c75d93567379238fb5bae74aa8868ffe37ed32770d21258067c43f: Status 404 returned error can't find the container with id 861c928d44c75d93567379238fb5bae74aa8868ffe37ed32770d21258067c43f
Sep 16 13:45:00.623142 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:00.623117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f" event={"ID":"e9fd4327-d20a-4e13-8c21-ff792bcaf84a","Type":"ContainerStarted","Data":"861c928d44c75d93567379238fb5bae74aa8868ffe37ed32770d21258067c43f"}
Sep 16 13:45:03.641547 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:03.641509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f" event={"ID":"e9fd4327-d20a-4e13-8c21-ff792bcaf84a","Type":"ContainerStarted","Data":"31131be513f189ce1a16c9469a74ccaa4662d2e604cf153f846ba00d08a649fe"}
Sep 16 13:45:03.654890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:03.654843    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f" podStartSLOduration=1.327456488 podStartE2EDuration="3.654828031s" totalImagesPullingTime="2.327371543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:03.654206727 +0000 UTC m=+712.901084555" watchObservedRunningTime="2026-09-16 13:45:03.654828031 +0000 UTC m=+712.901705856"
Sep 16 13:45:04.650647 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:04.650616    2563 generic.go:356] "Generic (PLEG): container finished" podID="e9fd4327-d20a-4e13-8c21-ff792bcaf84a" containerID="31131be513f189ce1a16c9469a74ccaa4662d2e604cf153f846ba00d08a649fe" exitCode=0
Sep 16 13:45:04.651013 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:04.650680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f" event={"ID":"e9fd4327-d20a-4e13-8c21-ff792bcaf84a","Type":"ContainerDied","Data":"31131be513f189ce1a16c9469a74ccaa4662d2e604cf153f846ba00d08a649fe"}
Sep 16 13:45:05.785732 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:05.785708    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f"
Sep 16 13:45:06.662029 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:06.661997    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f"
Sep 16 13:45:06.662029 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:06.662024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-fhb6f" event={"ID":"e9fd4327-d20a-4e13-8c21-ff792bcaf84a","Type":"ContainerDied","Data":"861c928d44c75d93567379238fb5bae74aa8868ffe37ed32770d21258067c43f"}
Sep 16 13:45:06.662290 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:06.662070    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="861c928d44c75d93567379238fb5bae74aa8868ffe37ed32770d21258067c43f"
Sep 16 13:45:29.319727 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.319692    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"]
Sep 16 13:45:29.320106 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.320095    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9fd4327-d20a-4e13-8c21-ff792bcaf84a" containerName="cleanup"
Sep 16 13:45:29.320106 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.320107    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9fd4327-d20a-4e13-8c21-ff792bcaf84a" containerName="cleanup"
Sep 16 13:45:29.320205 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.320193    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9fd4327-d20a-4e13-8c21-ff792bcaf84a" containerName="cleanup"
Sep 16 13:45:29.323513 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.323493    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.325690 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.325672    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-401a67-openshift-default-dockercfg-bm9pv\""
Sep 16 13:45:29.334845 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.334824    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"]
Sep 16 13:45:29.401210 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.401178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-credential-socket\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.401210 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.401209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-certs\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.401418 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.401231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8klv9\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-kube-api-access-8klv9\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.401418 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.401256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-socket\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.401418 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.401297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-envoy\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.401418 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.401390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-token\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.401418 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.401415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istiod-ca-cert\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.401630 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.401445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-podinfo\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.401630 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.401541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-data\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.456770 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.456740    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"]
Sep 16 13:45:29.460292 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.460275    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.462752 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.462732    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-fc8c65-openshift-default-dockercfg-cxg8c\""
Sep 16 13:45:29.477541 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.477514    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"]
Sep 16 13:45:29.502395 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.502355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-token\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.502486 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.502411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istiod-ca-cert\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.502486 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.502446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-podinfo\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.502486 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.502475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-data\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.502622 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.502548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-credential-socket\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.502622 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.502587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-certs\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.502731 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.502616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8klv9\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-kube-api-access-8klv9\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.502731 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.502648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-socket\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.502731 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.502691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-envoy\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.503040 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.503016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-certs\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.503254 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.503061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-credential-socket\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.503365 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.503251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-socket\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.503365 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.503119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-data\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.503509 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.503466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istiod-ca-cert\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.504941 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.504921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-podinfo\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.505058 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.505039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-envoy\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.509729 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.509707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-token\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.510476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.510455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8klv9\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-kube-api-access-8klv9\") pod \"e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") " pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.603750 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.603674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb63975-a64e-4b22-a087-674e20ba3294-istiod-ca-cert\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.603750 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.603721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndcpm\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-kube-api-access-ndcpm\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.603924 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.603758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-envoy\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.603924 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.603852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-credential-socket\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.603924 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.603907    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-data\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.604022 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.603936    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-certs\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.604022 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.603994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-istio-token\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.604022 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.604013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-socket\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.604139 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.604033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb63975-a64e-4b22-a087-674e20ba3294-istio-podinfo\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.634223 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.634198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:29.706392 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.706297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb63975-a64e-4b22-a087-674e20ba3294-istiod-ca-cert\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.706548 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.706412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndcpm\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-kube-api-access-ndcpm\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.706548 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.706464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-envoy\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.706548 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.706491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-credential-socket\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.706548 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.706519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-data\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.706762 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.706561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-certs\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.706762 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.706635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-istio-token\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.706762 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.706664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-socket\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.706762 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.706716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb63975-a64e-4b22-a087-674e20ba3294-istio-podinfo\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.707170 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.707147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb63975-a64e-4b22-a087-674e20ba3294-istiod-ca-cert\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.707778 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.707407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-data\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.707778 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.707717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-credential-socket\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.708022 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.707994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-socket\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.708101 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.708068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-certs\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.710807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.710306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb63975-a64e-4b22-a087-674e20ba3294-istio-podinfo\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.711633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.711609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-envoy\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.721351 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.721328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndcpm\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-kube-api-access-ndcpm\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.721611 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.721588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-istio-token\") pod \"e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") " pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.770535 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.770507    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:29.917682 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.917660    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"]
Sep 16 13:45:29.919455 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:45:29.919430    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8e0b1e_c90a_4a4b_b0c4_097326055f0c.slice/crio-f733b7f363d9e0ef511dea7bfa2cc83847f7d396b8e30269a9ca89ea7657ba08 WatchSource:0}: Error finding container f733b7f363d9e0ef511dea7bfa2cc83847f7d396b8e30269a9ca89ea7657ba08: Status 404 returned error can't find the container with id f733b7f363d9e0ef511dea7bfa2cc83847f7d396b8e30269a9ca89ea7657ba08
Sep 16 13:45:29.921480 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.921450    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:29.921552 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.921512    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:29.921552 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:29.921539    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:30.050461 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.050433    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"]
Sep 16 13:45:30.051279 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:45:30.051252    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb63975_a64e_4b22_a087_674e20ba3294.slice/crio-39fc9bfb491f4c7581ccefed295025c58ef423832a792de7a0287107cc8b9d1d WatchSource:0}: Error finding container 39fc9bfb491f4c7581ccefed295025c58ef423832a792de7a0287107cc8b9d1d: Status 404 returned error can't find the container with id 39fc9bfb491f4c7581ccefed295025c58ef423832a792de7a0287107cc8b9d1d
Sep 16 13:45:30.053579 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.053550    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:30.053679 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.053624    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:30.053679 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.053669    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:30.777434 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.777397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" event={"ID":"fbb63975-a64e-4b22-a087-674e20ba3294","Type":"ContainerStarted","Data":"576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962"}
Sep 16 13:45:30.777875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.777460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" event={"ID":"fbb63975-a64e-4b22-a087-674e20ba3294","Type":"ContainerStarted","Data":"39fc9bfb491f4c7581ccefed295025c58ef423832a792de7a0287107cc8b9d1d"}
Sep 16 13:45:30.779087 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.779066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" event={"ID":"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c","Type":"ContainerStarted","Data":"8518828058a65b7cc898ec52c9c1bebf8d90f032fd327f8ba2c8ec0c754ddad7"}
Sep 16 13:45:30.779199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.779101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" event={"ID":"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c","Type":"ContainerStarted","Data":"f733b7f363d9e0ef511dea7bfa2cc83847f7d396b8e30269a9ca89ea7657ba08"}
Sep 16 13:45:30.803064 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.803014    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podStartSLOduration=1.8029987109999999 podStartE2EDuration="1.802998711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:30.801940316 +0000 UTC m=+740.048818141" watchObservedRunningTime="2026-09-16 13:45:30.802998711 +0000 UTC m=+740.049876534"
Sep 16 13:45:30.823302 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:30.823267    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" podStartSLOduration=1.8232545789999999 podStartE2EDuration="1.823254579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:30.821095241 +0000 UTC m=+740.067973104" watchObservedRunningTime="2026-09-16 13:45:30.823254579 +0000 UTC m=+740.070132403"
Sep 16 13:45:31.634949 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:31.634916    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:31.639674 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:31.639653    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:31.770863 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:31.770838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:31.775280 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:31.775258    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:31.783792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:31.783768    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:31.784182 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:31.783821    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:31.784560 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:31.784540    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:31.784652 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:31.784589    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:35.984080 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:35.984052    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"]
Sep 16 13:45:35.987770 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:35.987749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:35.990108 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:35.990088    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-401a67\""
Sep 16 13:45:35.990202 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:35.990123    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-401a67-dockercfg-5ftxz\""
Sep 16 13:45:36.003504 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.003484    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"]
Sep 16 13:45:36.072839 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.072790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v\" (UID: \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\") " pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:36.073018 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.072879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb8tc\" (UniqueName: \"kubernetes.io/projected/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-kube-api-access-pb8tc\") pod \"payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v\" (UID: \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\") " pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:36.173935 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.173906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v\" (UID: \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\") " pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:36.174078 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.173945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb8tc\" (UniqueName: \"kubernetes.io/projected/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-kube-api-access-pb8tc\") pod \"payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v\" (UID: \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\") " pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:36.174615 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.174595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v\" (UID: \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\") " pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:36.181685 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.181659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb8tc\" (UniqueName: \"kubernetes.io/projected/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-kube-api-access-pb8tc\") pod \"payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v\" (UID: \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\") " pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:36.298668 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.298585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:36.576555 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.576527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"]
Sep 16 13:45:36.578691 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:45:36.578659    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9f3598_3a65_40d4_b2ed_e9c39dccd391.slice/crio-5deeb75a58ffdfe8ad04185936a705245d61b09d4930b848ba5241b88173cdf7 WatchSource:0}: Error finding container 5deeb75a58ffdfe8ad04185936a705245d61b09d4930b848ba5241b88173cdf7: Status 404 returned error can't find the container with id 5deeb75a58ffdfe8ad04185936a705245d61b09d4930b848ba5241b88173cdf7
Sep 16 13:45:36.810346 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:36.810309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v" event={"ID":"2a9f3598-3a65-40d4-b2ed-e9c39dccd391","Type":"ContainerStarted","Data":"5deeb75a58ffdfe8ad04185936a705245d61b09d4930b848ba5241b88173cdf7"}
Sep 16 13:45:38.227090 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.226996    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"]
Sep 16 13:45:38.236276 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.236254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.238418 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.238399    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-d94fd9-openshift-default-dockercfg-xrwwp\""
Sep 16 13:45:38.243276 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.243250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"]
Sep 16 13:45:38.399192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.398782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-certs\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.399192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.398828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-data\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.399192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.398859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm4w2\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-kube-api-access-jm4w2\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.399192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.398886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-credential-socket\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.399192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.398955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-token\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.399192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.398988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-envoy\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.399192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.399041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-podinfo\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.399192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.399063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66691c21-9fa0-4dc6-9fbd-2224943a2011-istiod-ca-cert\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.399192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.399093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-socket\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.500479 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.500356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66691c21-9fa0-4dc6-9fbd-2224943a2011-istiod-ca-cert\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.500479 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.500442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-socket\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.500710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.500504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-certs\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.500710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.500526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-data\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.500710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.500558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm4w2\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-kube-api-access-jm4w2\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.500710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.500584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-credential-socket\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.500710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.500658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-token\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.500710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.500698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-envoy\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.500986 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.500759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-podinfo\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.503890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.501784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-data\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.503890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.502423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66691c21-9fa0-4dc6-9fbd-2224943a2011-istiod-ca-cert\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.503890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.502663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-socket\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.503890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.502884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-certs\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.503890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.503125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-credential-socket\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.505019 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.504975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-podinfo\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.506001 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.505981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-envoy\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.524789 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.524769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm4w2\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-kube-api-access-jm4w2\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.524891 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.524798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-token\") pod \"e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") " pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.569341 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.569165    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:38.822872 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.822783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v" event={"ID":"2a9f3598-3a65-40d4-b2ed-e9c39dccd391","Type":"ContainerStarted","Data":"1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a"}
Sep 16 13:45:38.823034 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.822903    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:38.842183 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.842129    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v" podStartSLOduration=2.215088176 podStartE2EDuration="3.84211052s" totalImagesPullingTime="1.627022344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:38.841756729 +0000 UTC m=+748.088634552" watchObservedRunningTime="2026-09-16 13:45:38.84211052 +0000 UTC m=+748.088988348"
Sep 16 13:45:38.868607 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.868579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"]
Sep 16 13:45:38.869968 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:45:38.869935    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66691c21_9fa0_4dc6_9fbd_2224943a2011.slice/crio-d65a573895f39686d9a7cb415a7aed4989abc6b0bf9f3ab14222e352be95a12f WatchSource:0}: Error finding container d65a573895f39686d9a7cb415a7aed4989abc6b0bf9f3ab14222e352be95a12f: Status 404 returned error can't find the container with id d65a573895f39686d9a7cb415a7aed4989abc6b0bf9f3ab14222e352be95a12f
Sep 16 13:45:38.872534 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.872503    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:38.872639 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.872572    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:38.872639 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.872603    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:38.969679 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.969643    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"]
Sep 16 13:45:39.013400 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.997567    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"]
Sep 16 13:45:39.013400 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:38.997693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.016704 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.016674    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a2455826-openshift-default-dockercfg-x6ffs\""
Sep 16 13:45:39.128465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.120830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-data\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.128740 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.128713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-certs\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.129226 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.129195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-podinfo\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.129295 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.129243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16f8f407-8e49-491c-9e7b-7661e3e2282d-istiod-ca-cert\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.129295 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.129273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-socket\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.129421 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.129314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkr6x\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-kube-api-access-pkr6x\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.129421 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.129339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-envoy\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.129521 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.129427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-credential-socket\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.129582 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.129521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-token\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.230126 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.230083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-credential-socket\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.231326 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.231305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-token\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.231539 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.231523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-data\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.231649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.231636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-certs\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.231790 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.231777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-podinfo\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.231889 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.231878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16f8f407-8e49-491c-9e7b-7661e3e2282d-istiod-ca-cert\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.231974 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.231963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-socket\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.232068 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.232057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkr6x\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-kube-api-access-pkr6x\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.232148 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.232138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-envoy\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.234249 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.232695    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-certs\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.234249 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.231188    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-credential-socket\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.234249 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.233214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-data\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.234249 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.233889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16f8f407-8e49-491c-9e7b-7661e3e2282d-istiod-ca-cert\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.235160 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.235138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-socket\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.239650 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.239626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-podinfo\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.239974 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.239956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-envoy\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.242760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.242736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkr6x\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-kube-api-access-pkr6x\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.244435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.244414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-token\") pod \"e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") " pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.348765 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.348727    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:39.680879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.680843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"]
Sep 16 13:45:39.706519 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:45:39.706469    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f8f407_8e49_491c_9e7b_7661e3e2282d.slice/crio-168950707bd00317edb0f4b767fcdaf8c47097fa7f4348659b7a70068136bb9c WatchSource:0}: Error finding container 168950707bd00317edb0f4b767fcdaf8c47097fa7f4348659b7a70068136bb9c: Status 404 returned error can't find the container with id 168950707bd00317edb0f4b767fcdaf8c47097fa7f4348659b7a70068136bb9c
Sep 16 13:45:39.711182 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.711140    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:39.711291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.711232    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:39.711391 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.711293    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:39.830680 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.830643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b" event={"ID":"16f8f407-8e49-491c-9e7b-7661e3e2282d","Type":"ContainerStarted","Data":"089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef"}
Sep 16 13:45:39.830841 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.830704    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b" event={"ID":"16f8f407-8e49-491c-9e7b-7661e3e2282d","Type":"ContainerStarted","Data":"168950707bd00317edb0f4b767fcdaf8c47097fa7f4348659b7a70068136bb9c"}
Sep 16 13:45:39.832639 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.832609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" event={"ID":"66691c21-9fa0-4dc6-9fbd-2224943a2011","Type":"ContainerStarted","Data":"dfa57083ef1a93bd1f421a7e1c4563e61c21ef07f7764655c5cc6a65ac41c31f"}
Sep 16 13:45:39.832793 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.832654    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" event={"ID":"66691c21-9fa0-4dc6-9fbd-2224943a2011","Type":"ContainerStarted","Data":"d65a573895f39686d9a7cb415a7aed4989abc6b0bf9f3ab14222e352be95a12f"}
Sep 16 13:45:39.853361 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.853110    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b" podStartSLOduration=1.853089518 podStartE2EDuration="1.853089518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:39.851604606 +0000 UTC m=+749.098482431" watchObservedRunningTime="2026-09-16 13:45:39.853089518 +0000 UTC m=+749.099967343"
Sep 16 13:45:39.872027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:39.871981    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" podStartSLOduration=1.87196085 podStartE2EDuration="1.87196085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:39.870179887 +0000 UTC m=+749.117057722" watchObservedRunningTime="2026-09-16 13:45:39.87196085 +0000 UTC m=+749.118838675"
Sep 16 13:45:40.349821 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:40.349783    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:40.350974 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:40.350942    2563 patch_prober.go:28] interesting pod/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 16 13:45:40.351110 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:40.351001    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b" podUID="16f8f407-8e49-491c-9e7b-7661e3e2282d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 16 13:45:40.570394 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:40.570355    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:40.575561 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:40.575532    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:40.838199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:40.838167    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:40.839052 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:40.839031    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:45:41.354163 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:41.353967    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:41.842946 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:41.842915    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:41.843778 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:41.843760    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:45:46.852236 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:46.851041    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:47018->10.134.0.37:15021: read: connection reset by peer" start-of-body=
Sep 16 13:45:46.852236 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:46.851113    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:47018->10.134.0.37:15021: read: connection reset by peer"
Sep 16 13:45:46.870810 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:46.870785    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbb63975-a64e-4b22-a087-674e20ba3294" containerID="576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962" exitCode=0
Sep 16 13:45:46.870893 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:46.870851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" event={"ID":"fbb63975-a64e-4b22-a087-674e20ba3294","Type":"ContainerDied","Data":"576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962"}
Sep 16 13:45:46.871299 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:46.871283    2563 scope.go:117] "RemoveContainer" containerID="576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962"
Sep 16 13:45:46.872438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:46.872414    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:46.872491 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:46.872476    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:46.872527 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:46.872506    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:47.880235 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:47.880174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" event={"ID":"fbb63975-a64e-4b22-a087-674e20ba3294","Type":"ContainerStarted","Data":"5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d"}
Sep 16 13:45:48.771224 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:48.771145    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:48.771405 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:48.771333    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 13:45:48.771452 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:48.771401    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 13:45:49.771866 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:49.771832    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 13:45:49.772270 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:49.771897    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 13:45:49.834732 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:49.834702    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:45:50.771075 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:50.771036    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 13:45:50.771231 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:50.771103    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 13:45:51.771633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:51.771594    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 13:45:51.772087 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:51.771657    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 13:45:52.771894 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:52.771852    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 13:45:52.772255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:52.771928    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 13:45:53.317048 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.317015    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"]
Sep 16 13:45:53.321498 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.321468    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.323706 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.323678    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6c7792-openshift-default-dockercfg-cklfn\""
Sep 16 13:45:53.339766 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.339736    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"]
Sep 16 13:45:53.398483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.397949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-credential-socket\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.398483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.398008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-socket\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.398483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.398047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-podinfo\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.398483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.398087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-certs\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.398483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.398146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-token\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.398483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.398185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-envoy\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.398483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.398212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlztw\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-kube-api-access-jlztw\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.398483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.398285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3d934f3-cf87-4818-9497-cf8a24adc223-istiod-ca-cert\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.398483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.398344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-data\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-token\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-envoy\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlztw\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-kube-api-access-jlztw\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3d934f3-cf87-4818-9497-cf8a24adc223-istiod-ca-cert\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-data\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-credential-socket\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-socket\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-podinfo\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-certs\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.499964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-certs\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.500910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-data\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.501956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3d934f3-cf87-4818-9497-cf8a24adc223-istiod-ca-cert\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.502212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-socket\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.502875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.502476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-credential-socket\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.506924 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.506878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-envoy\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.508602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.508562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-podinfo\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.515002 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.514973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlztw\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-kube-api-access-jlztw\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.515135 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.515084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-token\") pod \"e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") " pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.639138 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.639097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:53.771918 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.771884    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 13:45:53.772646 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.771940    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 13:45:53.942346 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.942255    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"]
Sep 16 13:45:53.946331 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:45:53.946307    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d934f3_cf87_4818_9497_cf8a24adc223.slice/crio-8586ba741d717b92587ea58a7caef4b2d1515dd468a2cc793b92df2d07fc9e36 WatchSource:0}: Error finding container 8586ba741d717b92587ea58a7caef4b2d1515dd468a2cc793b92df2d07fc9e36: Status 404 returned error can't find the container with id 8586ba741d717b92587ea58a7caef4b2d1515dd468a2cc793b92df2d07fc9e36
Sep 16 13:45:53.949558 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.949522    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:53.949638 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.949612    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:53.949677 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:53.949652    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:54.775261 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:54.775229    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:54.775690 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:54.775602    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:54.776334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:54.776304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:45:54.944530 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:54.944487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" event={"ID":"e3d934f3-cf87-4818-9497-cf8a24adc223","Type":"ContainerStarted","Data":"c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982"}
Sep 16 13:45:54.944530 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:54.944545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" event={"ID":"e3d934f3-cf87-4818-9497-cf8a24adc223","Type":"ContainerStarted","Data":"8586ba741d717b92587ea58a7caef4b2d1515dd468a2cc793b92df2d07fc9e36"}
Sep 16 13:45:54.967308 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:54.967251    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" podStartSLOduration=1.967232851 podStartE2EDuration="1.967232851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:54.964656964 +0000 UTC m=+764.211534790" watchObservedRunningTime="2026-09-16 13:45:54.967232851 +0000 UTC m=+764.214111057"
Sep 16 13:45:55.639760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.639721    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:55.645141 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.645105    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:55.955957 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.955873    2563 generic.go:356] "Generic (PLEG): container finished" podID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerID="8518828058a65b7cc898ec52c9c1bebf8d90f032fd327f8ba2c8ec0c754ddad7" exitCode=0
Sep 16 13:45:55.956344 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.955958    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" event={"ID":"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c","Type":"ContainerDied","Data":"8518828058a65b7cc898ec52c9c1bebf8d90f032fd327f8ba2c8ec0c754ddad7"}
Sep 16 13:45:55.956458 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.956438    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:55.956672 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.956652    2563 scope.go:117] "RemoveContainer" containerID="8518828058a65b7cc898ec52c9c1bebf8d90f032fd327f8ba2c8ec0c754ddad7"
Sep 16 13:45:55.957523 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.957442    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:45:55.957881 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.957849    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:55.957969 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.957928    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:55.958034 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:55.957975    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:45:56.963631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:56.963601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" event={"ID":"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c","Type":"ContainerStarted","Data":"190cb0f1659a865c289fa51f5375da48ec1aaace64fe33d3ff1e3d0c9a97de4d"}
Sep 16 13:45:57.634740 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:57.634709    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:45:57.636016 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:57.635987    2563 patch_prober.go:28] interesting pod/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 13:45:57.636148 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:57.636038    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 13:45:58.634956 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:58.634926    2563 patch_prober.go:28] interesting pod/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 13:45:58.635417 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:58.634992    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 13:45:59.635030 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:59.634997    2563 patch_prober.go:28] interesting pod/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 13:45:59.635559 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:45:59.635070    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 13:46:00.635329 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:00.635295    2563 patch_prober.go:28] interesting pod/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 13:46:00.635772 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:00.635367    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 13:46:01.635438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.635367    2563 patch_prober.go:28] interesting pod/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 13:46:01.635823 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.635458    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 13:46:01.710592 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.710548    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"]
Sep 16 13:46:01.715894 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.715868    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"
Sep 16 13:46:01.718518 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.718490    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmnnx\""
Sep 16 13:46:01.724988 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.718778    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 13:46:01.725512 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.725488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"]
Sep 16 13:46:01.786399 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.785538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:46:01.801054 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.801018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c52246-0c74-4316-b3bd-d11dcf073fcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a2455826-hnhwn\" (UID: \"93c52246-0c74-4316-b3bd-d11dcf073fcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"
Sep 16 13:46:01.902445 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.902315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c52246-0c74-4316-b3bd-d11dcf073fcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a2455826-hnhwn\" (UID: \"93c52246-0c74-4316-b3bd-d11dcf073fcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"
Sep 16 13:46:01.903717 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:01.903684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c52246-0c74-4316-b3bd-d11dcf073fcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a2455826-hnhwn\" (UID: \"93c52246-0c74-4316-b3bd-d11dcf073fcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"
Sep 16 13:46:02.037013 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:02.036971    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"
Sep 16 13:46:02.346091 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:02.346068    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"]
Sep 16 13:46:02.635522 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:02.635491    2563 patch_prober.go:28] interesting pod/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 16 13:46:02.635949 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:02.635545    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 16 13:46:03.014511 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:03.014472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn" event={"ID":"93c52246-0c74-4316-b3bd-d11dcf073fcb","Type":"ContainerStarted","Data":"f26197cdba837bd5f67c873afa66a12ebd4a22da4a8b018f27369f135072526d"}
Sep 16 13:46:03.014697 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:03.014531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn" event={"ID":"93c52246-0c74-4316-b3bd-d11dcf073fcb","Type":"ContainerStarted","Data":"0ecb197337215423aba562910ed9d1def85724528fdcc74fe4f5687420b93a79"}
Sep 16 13:46:03.031252 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:03.031201    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn" podStartSLOduration=2.031184989 podStartE2EDuration="2.031184989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:46:03.028428962 +0000 UTC m=+772.275306798" watchObservedRunningTime="2026-09-16 13:46:03.031184989 +0000 UTC m=+772.278062814"
Sep 16 13:46:03.639077 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:03.638997    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:46:03.640065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:03.640045    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:46:04.023404 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:04.023296    2563 generic.go:356] "Generic (PLEG): container finished" podID="93c52246-0c74-4316-b3bd-d11dcf073fcb" containerID="f26197cdba837bd5f67c873afa66a12ebd4a22da4a8b018f27369f135072526d" exitCode=0
Sep 16 13:46:04.023404 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:04.023367    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn" event={"ID":"93c52246-0c74-4316-b3bd-d11dcf073fcb","Type":"ContainerDied","Data":"f26197cdba837bd5f67c873afa66a12ebd4a22da4a8b018f27369f135072526d"}
Sep 16 13:46:05.251902 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:05.251873    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"
Sep 16 13:46:05.258368 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:05.258347    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c52246-0c74-4316-b3bd-d11dcf073fcb-maas-api-service-ca\") pod \"93c52246-0c74-4316-b3bd-d11dcf073fcb\" (UID: \"93c52246-0c74-4316-b3bd-d11dcf073fcb\") "
Sep 16 13:46:05.258850 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:05.258823    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c52246-0c74-4316-b3bd-d11dcf073fcb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "93c52246-0c74-4316-b3bd-d11dcf073fcb" (UID: "93c52246-0c74-4316-b3bd-d11dcf073fcb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:05.360214 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:05.360131    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c52246-0c74-4316-b3bd-d11dcf073fcb-maas-api-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:06.040084 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:06.040050    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"
Sep 16 13:46:06.040254 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:06.040095    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn" event={"ID":"93c52246-0c74-4316-b3bd-d11dcf073fcb","Type":"ContainerDied","Data":"0ecb197337215423aba562910ed9d1def85724528fdcc74fe4f5687420b93a79"}
Sep 16 13:46:06.040254 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:06.040169    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ecb197337215423aba562910ed9d1def85724528fdcc74fe4f5687420b93a79"
Sep 16 13:46:10.840103 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:10.840073    2563 patch_prober.go:28] interesting pod/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:46:10.840510 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:10.840128    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:46:11.069395 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:11.069335    2563 generic.go:356] "Generic (PLEG): container finished" podID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerID="dfa57083ef1a93bd1f421a7e1c4563e61c21ef07f7764655c5cc6a65ac41c31f" exitCode=0
Sep 16 13:46:11.069395 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:11.069397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" event={"ID":"66691c21-9fa0-4dc6-9fbd-2224943a2011","Type":"ContainerDied","Data":"dfa57083ef1a93bd1f421a7e1c4563e61c21ef07f7764655c5cc6a65ac41c31f"}
Sep 16 13:46:11.069919 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:11.069904    2563 scope.go:117] "RemoveContainer" containerID="dfa57083ef1a93bd1f421a7e1c4563e61c21ef07f7764655c5cc6a65ac41c31f"
Sep 16 13:46:11.071132 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:11.071100    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:11.071195 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:11.071170    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:11.071244 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:11.071204    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:12.078036 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.077987    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" event={"ID":"66691c21-9fa0-4dc6-9fbd-2224943a2011","Type":"ContainerStarted","Data":"66149f5d681762d3ca7116b9da6810c60be2be40e4b23fc17e29977dbf9e17f5"}
Sep 16 13:46:12.425753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.425469    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"]
Sep 16 13:46:12.427865 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.427839    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a2455826-hnhwn"]
Sep 16 13:46:12.569588 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.569559    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"]
Sep 16 13:46:12.569794 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.569770    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:46:12.569891 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.569860    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b" podUID="16f8f407-8e49-491c-9e7b-7661e3e2282d" containerName="istio-proxy" containerID="cri-o://089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef" gracePeriod=30
Sep 16 13:46:12.570366 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.570202    2563 patch_prober.go:28] interesting pod/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:46:12.570366 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.570245    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:46:12.885608 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.885548    2563 patch_prober.go:28] interesting pod/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 13:46:12.885827 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:12.885622    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b" podUID="16f8f407-8e49-491c-9e7b-7661e3e2282d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 13:46:13.217514 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.217432    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c52246-0c74-4316-b3bd-d11dcf073fcb" path="/var/lib/kubelet/pods/93c52246-0c74-4316-b3bd-d11dcf073fcb/volumes"
Sep 16 13:46:13.370090 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.370057    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:46:13.449173 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449077    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-socket\") pod \"16f8f407-8e49-491c-9e7b-7661e3e2282d\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") "
Sep 16 13:46:13.449173 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449130    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-token\") pod \"16f8f407-8e49-491c-9e7b-7661e3e2282d\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") "
Sep 16 13:46:13.449436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449212    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-credential-socket\") pod \"16f8f407-8e49-491c-9e7b-7661e3e2282d\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") "
Sep 16 13:46:13.449436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449235    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-envoy\") pod \"16f8f407-8e49-491c-9e7b-7661e3e2282d\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") "
Sep 16 13:46:13.449436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449279    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-data\") pod \"16f8f407-8e49-491c-9e7b-7661e3e2282d\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") "
Sep 16 13:46:13.449436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449341    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16f8f407-8e49-491c-9e7b-7661e3e2282d-istiod-ca-cert\") pod \"16f8f407-8e49-491c-9e7b-7661e3e2282d\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") "
Sep 16 13:46:13.449436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449362    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkr6x\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-kube-api-access-pkr6x\") pod \"16f8f407-8e49-491c-9e7b-7661e3e2282d\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") "
Sep 16 13:46:13.449436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449357    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16f8f407-8e49-491c-9e7b-7661e3e2282d" (UID: "16f8f407-8e49-491c-9e7b-7661e3e2282d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:13.449436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449418    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-certs\") pod \"16f8f407-8e49-491c-9e7b-7661e3e2282d\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") "
Sep 16 13:46:13.449799 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449481    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-podinfo\") pod \"16f8f407-8e49-491c-9e7b-7661e3e2282d\" (UID: \"16f8f407-8e49-491c-9e7b-7661e3e2282d\") "
Sep 16 13:46:13.449799 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449528    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16f8f407-8e49-491c-9e7b-7661e3e2282d" (UID: "16f8f407-8e49-491c-9e7b-7661e3e2282d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:13.449799 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449673    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16f8f407-8e49-491c-9e7b-7661e3e2282d" (UID: "16f8f407-8e49-491c-9e7b-7661e3e2282d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:13.449914 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449796    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-data" (OuterVolumeSpecName: "istio-data") pod "16f8f407-8e49-491c-9e7b-7661e3e2282d" (UID: "16f8f407-8e49-491c-9e7b-7661e3e2282d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:13.449914 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449816    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.449914 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449834    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.449914 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449847    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.449914 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.449878    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16f8f407-8e49-491c-9e7b-7661e3e2282d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16f8f407-8e49-491c-9e7b-7661e3e2282d" (UID: "16f8f407-8e49-491c-9e7b-7661e3e2282d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:13.451919 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.451886    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16f8f407-8e49-491c-9e7b-7661e3e2282d" (UID: "16f8f407-8e49-491c-9e7b-7661e3e2282d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:13.452033 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.451944    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-token" (OuterVolumeSpecName: "istio-token") pod "16f8f407-8e49-491c-9e7b-7661e3e2282d" (UID: "16f8f407-8e49-491c-9e7b-7661e3e2282d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:46:13.452324 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.452294    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16f8f407-8e49-491c-9e7b-7661e3e2282d" (UID: "16f8f407-8e49-491c-9e7b-7661e3e2282d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:46:13.452445 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.452349    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-kube-api-access-pkr6x" (OuterVolumeSpecName: "kube-api-access-pkr6x") pod "16f8f407-8e49-491c-9e7b-7661e3e2282d" (UID: "16f8f407-8e49-491c-9e7b-7661e3e2282d"). InnerVolumeSpecName "kube-api-access-pkr6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:46:13.551086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.551052    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.551086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.551082    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.551086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.551091    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.551312 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.551098    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16f8f407-8e49-491c-9e7b-7661e3e2282d-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.551312 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.551106    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16f8f407-8e49-491c-9e7b-7661e3e2282d-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.551312 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.551113    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkr6x\" (UniqueName: \"kubernetes.io/projected/16f8f407-8e49-491c-9e7b-7661e3e2282d-kube-api-access-pkr6x\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.570092 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.570058    2563 patch_prober.go:28] interesting pod/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:46:13.570270 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.570129    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:46:13.655496 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.655455    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"]
Sep 16 13:46:13.655927 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.655912    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c52246-0c74-4316-b3bd-d11dcf073fcb" containerName="revoke-keys"
Sep 16 13:46:13.655927 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.655928    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c52246-0c74-4316-b3bd-d11dcf073fcb" containerName="revoke-keys"
Sep 16 13:46:13.656062 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.655948    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16f8f407-8e49-491c-9e7b-7661e3e2282d" containerName="istio-proxy"
Sep 16 13:46:13.656062 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.655956    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="16f8f407-8e49-491c-9e7b-7661e3e2282d" containerName="istio-proxy"
Sep 16 13:46:13.656062 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.656028    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c52246-0c74-4316-b3bd-d11dcf073fcb" containerName="revoke-keys"
Sep 16 13:46:13.656062 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.656041    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="16f8f407-8e49-491c-9e7b-7661e3e2282d" containerName="istio-proxy"
Sep 16 13:46:13.659540 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.659519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.661657 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.661639    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b2821608-gw-openshift-default-dockercfg-rllvk\""
Sep 16 13:46:13.671095 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.671069    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"]
Sep 16 13:46:13.756493 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.756400    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-podinfo\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.756493 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.756451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-credential-socket\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.756695 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.756531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crwg4\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-kube-api-access-crwg4\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.756695 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.756552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-socket\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.756695 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.756569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-token\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.756695 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.756607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-certs\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.756695 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.756651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-data\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.756877 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.756709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-envoy\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.756877 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.756750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istiod-ca-cert\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.857969 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.857929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-certs\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858162 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.857988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-data\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858162 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-envoy\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858162 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istiod-ca-cert\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858162 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-podinfo\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858162 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-credential-socket\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crwg4\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-kube-api-access-crwg4\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-socket\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-token\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-certs\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858677 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858467    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-data\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858677 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-credential-socket\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858799 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istiod-ca-cert\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.858860 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.858804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-socket\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.860646 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.860624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-envoy\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.860786 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.860772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-podinfo\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.866450 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.866431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-token\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.866538 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.866458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crwg4\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-kube-api-access-crwg4\") pod \"e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") " pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:13.971767 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:13.971729    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:14.103713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.103514    2563 generic.go:356] "Generic (PLEG): container finished" podID="16f8f407-8e49-491c-9e7b-7661e3e2282d" containerID="089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef" exitCode=0
Sep 16 13:46:14.103713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.103563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b" event={"ID":"16f8f407-8e49-491c-9e7b-7661e3e2282d","Type":"ContainerDied","Data":"089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef"}
Sep 16 13:46:14.103713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.103604    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"
Sep 16 13:46:14.103713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.103615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b" event={"ID":"16f8f407-8e49-491c-9e7b-7661e3e2282d","Type":"ContainerDied","Data":"168950707bd00317edb0f4b767fcdaf8c47097fa7f4348659b7a70068136bb9c"}
Sep 16 13:46:14.103713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.103639    2563 scope.go:117] "RemoveContainer" containerID="089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef"
Sep 16 13:46:14.114913 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.114895    2563 scope.go:117] "RemoveContainer" containerID="089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef"
Sep 16 13:46:14.115158 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:46:14.115140    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef\": container with ID starting with 089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef not found: ID does not exist" containerID="089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef"
Sep 16 13:46:14.115204 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.115166    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef"} err="failed to get container status \"089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef\": rpc error: code = NotFound desc = could not find container \"089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef\": container with ID starting with 089f6237758bc044414e3d4b7f064a31394372adaeb922856805b356dbca57ef not found: ID does not exist"
Sep 16 13:46:14.131829 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.131793    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"]
Sep 16 13:46:14.138523 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.138498    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a2455826-openshift-default-7bc749cc94-r9w4b"]
Sep 16 13:46:14.263069 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.263046    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"]
Sep 16 13:46:14.265125 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:46:14.265098    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92bbfed4_88fc_4acf_92c6_59fab17cdd23.slice/crio-d2429398d708ad8fe8711b701def882628c23c226d6831cdfccfbb269bea2ff5 WatchSource:0}: Error finding container d2429398d708ad8fe8711b701def882628c23c226d6831cdfccfbb269bea2ff5: Status 404 returned error can't find the container with id d2429398d708ad8fe8711b701def882628c23c226d6831cdfccfbb269bea2ff5
Sep 16 13:46:14.267485 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.267452    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:14.267589 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.267531    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:14.267589 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.267576    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:14.569997 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.569917    2563 patch_prober.go:28] interesting pod/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:46:14.570197 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:14.570173    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:46:15.119787 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:15.119744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" event={"ID":"92bbfed4-88fc-4acf-92c6-59fab17cdd23","Type":"ContainerStarted","Data":"a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb"}
Sep 16 13:46:15.119969 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:15.119844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" event={"ID":"92bbfed4-88fc-4acf-92c6-59fab17cdd23","Type":"ContainerStarted","Data":"d2429398d708ad8fe8711b701def882628c23c226d6831cdfccfbb269bea2ff5"}
Sep 16 13:46:15.141684 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:15.141632    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" podStartSLOduration=2.141615244 podStartE2EDuration="2.141615244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:46:15.139927438 +0000 UTC m=+784.386805263" watchObservedRunningTime="2026-09-16 13:46:15.141615244 +0000 UTC m=+784.388493069"
Sep 16 13:46:15.222391 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:15.222333    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16f8f407-8e49-491c-9e7b-7661e3e2282d" path="/var/lib/kubelet/pods/16f8f407-8e49-491c-9e7b-7661e3e2282d/volumes"
Sep 16 13:46:15.570223 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:15.570192    2563 patch_prober.go:28] interesting pod/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:46:15.570625 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:15.570253    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:46:15.972224 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:15.972190    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:16.001958 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:16.001926    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:16.129879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:16.129850    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:16.131015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:16.130987    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:16.570064 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:16.570027    2563 patch_prober.go:28] interesting pod/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:46:16.570251 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:16.570088    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:46:17.634212 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:17.634177    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:46:17.635242 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:17.635220    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:46:17.637069 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:17.637049    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:46:24.182414 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:24.182357    2563 generic.go:356] "Generic (PLEG): container finished" podID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerID="c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982" exitCode=0
Sep 16 13:46:24.182868 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:24.182433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" event={"ID":"e3d934f3-cf87-4818-9497-cf8a24adc223","Type":"ContainerDied","Data":"c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982"}
Sep 16 13:46:24.182868 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:24.182832    2563 scope.go:117] "RemoveContainer" containerID="c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982"
Sep 16 13:46:24.184053 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:24.184024    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:24.184121 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:24.184092    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:24.184157 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:24.184123    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:25.194105 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:25.194066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" event={"ID":"e3d934f3-cf87-4818-9497-cf8a24adc223","Type":"ContainerStarted","Data":"4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16"}
Sep 16 13:46:25.640058 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:25.640026    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:46:25.641052 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:25.641029    2563 patch_prober.go:28] interesting pod/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 13:46:25.641146 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:25.641088    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 13:46:25.957077 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:25.957000    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:46:26.639707 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:26.639671    2563 patch_prober.go:28] interesting pod/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 13:46:26.640102 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:26.639725    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 13:46:27.640259 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:27.640211    2563 patch_prober.go:28] interesting pod/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 13:46:27.640792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:27.640289    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 13:46:28.639957 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:28.639920    2563 patch_prober.go:28] interesting pod/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 13:46:28.640143 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:28.639990    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 13:46:29.639672 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:29.639632    2563 patch_prober.go:28] interesting pod/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 13:46:29.640188 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:29.639692    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 13:46:30.644141 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:30.644111    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:46:30.645053 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:30.645036    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:46:42.303568 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:42.303535    2563 generic.go:356] "Generic (PLEG): container finished" podID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerID="a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb" exitCode=0
Sep 16 13:46:42.303568 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:42.303573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" event={"ID":"92bbfed4-88fc-4acf-92c6-59fab17cdd23","Type":"ContainerDied","Data":"a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb"}
Sep 16 13:46:42.304032 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:42.303992    2563 scope.go:117] "RemoveContainer" containerID="a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb"
Sep 16 13:46:42.305330 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:42.305302    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:42.305411 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:42.305370    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:42.305453 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:42.305419    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:43.310932 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:43.310897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" event={"ID":"92bbfed4-88fc-4acf-92c6-59fab17cdd23","Type":"ContainerStarted","Data":"a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f"}
Sep 16 13:46:43.972455 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:43.972412    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:43.973716 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:43.973691    2563 patch_prober.go:28] interesting pod/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 13:46:43.973822 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:43.973741    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 13:46:44.972426 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:44.972360    2563 patch_prober.go:28] interesting pod/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 13:46:44.972813 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:44.972447    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 13:46:45.972803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:45.972767    2563 patch_prober.go:28] interesting pod/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 13:46:45.973194 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:45.972825    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 13:46:46.129529 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.129483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:46.763703 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.763668    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"]
Sep 16 13:46:46.767537 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.767519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"
Sep 16 13:46:46.769545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.769527    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 13:46:46.769633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.769611    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmnnx\""
Sep 16 13:46:46.773885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.773774    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"]
Sep 16 13:46:46.841001 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.840960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71ccdd51-9a4a-4454-a245-188f3a38cdd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq\" (UID: \"71ccdd51-9a4a-4454-a245-188f3a38cdd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"
Sep 16 13:46:46.941665 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.941629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71ccdd51-9a4a-4454-a245-188f3a38cdd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq\" (UID: \"71ccdd51-9a4a-4454-a245-188f3a38cdd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"
Sep 16 13:46:46.942298 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.942271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71ccdd51-9a4a-4454-a245-188f3a38cdd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq\" (UID: \"71ccdd51-9a4a-4454-a245-188f3a38cdd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"
Sep 16 13:46:46.972338 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.972302    2563 patch_prober.go:28] interesting pod/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 13:46:46.972517 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:46.972361    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 13:46:47.081948 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:47.081612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"
Sep 16 13:46:47.386249 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:47.386212    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"]
Sep 16 13:46:47.394294 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:46:47.393291    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ccdd51_9a4a_4454_a245_188f3a38cdd2.slice/crio-5a03193913e8526305e2e5028237fba5702302b28f4125f7aeb910459d554780 WatchSource:0}: Error finding container 5a03193913e8526305e2e5028237fba5702302b28f4125f7aeb910459d554780: Status 404 returned error can't find the container with id 5a03193913e8526305e2e5028237fba5702302b28f4125f7aeb910459d554780
Sep 16 13:46:47.972664 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:47.972581    2563 patch_prober.go:28] interesting pod/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 13:46:47.972664 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:47.972630    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 13:46:48.347248 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:48.347149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq" event={"ID":"71ccdd51-9a4a-4454-a245-188f3a38cdd2","Type":"ContainerStarted","Data":"2ba620ab46980a18092bbc5e3cecfaecc5495c8afaaaddb78d55134621d9ea6d"}
Sep 16 13:46:48.347248 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:48.347223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq" event={"ID":"71ccdd51-9a4a-4454-a245-188f3a38cdd2","Type":"ContainerStarted","Data":"5a03193913e8526305e2e5028237fba5702302b28f4125f7aeb910459d554780"}
Sep 16 13:46:48.361149 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:48.361096    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq" podStartSLOduration=2.361080092 podStartE2EDuration="2.361080092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:46:48.360284892 +0000 UTC m=+817.607162710" watchObservedRunningTime="2026-09-16 13:46:48.361080092 +0000 UTC m=+817.607957916"
Sep 16 13:46:48.973126 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:48.973083    2563 patch_prober.go:28] interesting pod/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 13:46:48.973327 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:48.973145    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 13:46:49.356040 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:49.355953    2563 generic.go:356] "Generic (PLEG): container finished" podID="71ccdd51-9a4a-4454-a245-188f3a38cdd2" containerID="2ba620ab46980a18092bbc5e3cecfaecc5495c8afaaaddb78d55134621d9ea6d" exitCode=0
Sep 16 13:46:49.356410 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:49.356039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq" event={"ID":"71ccdd51-9a4a-4454-a245-188f3a38cdd2","Type":"ContainerDied","Data":"2ba620ab46980a18092bbc5e3cecfaecc5495c8afaaaddb78d55134621d9ea6d"}
Sep 16 13:46:49.976973 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:49.976942    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:49.978038 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:49.978010    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:46:50.491471 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:50.491445    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"
Sep 16 13:46:50.585592 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:50.584857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71ccdd51-9a4a-4454-a245-188f3a38cdd2-maas-api-service-ca\") pod \"71ccdd51-9a4a-4454-a245-188f3a38cdd2\" (UID: \"71ccdd51-9a4a-4454-a245-188f3a38cdd2\") "
Sep 16 13:46:50.585592 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:50.585549    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ccdd51-9a4a-4454-a245-188f3a38cdd2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "71ccdd51-9a4a-4454-a245-188f3a38cdd2" (UID: "71ccdd51-9a4a-4454-a245-188f3a38cdd2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:50.685810 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:50.685775    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71ccdd51-9a4a-4454-a245-188f3a38cdd2-maas-api-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:46:51.368446 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:51.368412    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"
Sep 16 13:46:51.368588 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:51.368412    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq" event={"ID":"71ccdd51-9a4a-4454-a245-188f3a38cdd2","Type":"ContainerDied","Data":"5a03193913e8526305e2e5028237fba5702302b28f4125f7aeb910459d554780"}
Sep 16 13:46:51.368588 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:51.368544    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a03193913e8526305e2e5028237fba5702302b28f4125f7aeb910459d554780"
Sep 16 13:46:58.287015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:58.286976    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"]
Sep 16 13:46:58.289589 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:58.289567    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b2821608-9tvkq"]
Sep 16 13:46:58.428646 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:58.428616    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"]
Sep 16 13:46:58.428827 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:58.428808    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy" containerID="cri-o://a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f" gracePeriod=30
Sep 16 13:46:59.218500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.218469    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ccdd51-9a4a-4454-a245-188f3a38cdd2" path="/var/lib/kubelet/pods/71ccdd51-9a4a-4454-a245-188f3a38cdd2/volumes"
Sep 16 13:46:59.258775 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.258742    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"]
Sep 16 13:46:59.259480 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.259456    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ccdd51-9a4a-4454-a245-188f3a38cdd2" containerName="revoke-keys"
Sep 16 13:46:59.259480 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.259480    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ccdd51-9a4a-4454-a245-188f3a38cdd2" containerName="revoke-keys"
Sep 16 13:46:59.259621 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.259587    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ccdd51-9a4a-4454-a245-188f3a38cdd2" containerName="revoke-keys"
Sep 16 13:46:59.263543 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.263525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.265919 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.265899    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-74678972-openshift-default-dockercfg-x9tmx\""
Sep 16 13:46:59.274273 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.274250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"]
Sep 16 13:46:59.373722 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.373687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-socket\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.374434 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.374406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-envoy\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.374603 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.374576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-certs\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.374771 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.374753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-data\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.374893 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.374875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-istio-token\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.375022 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.375004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5z92\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-kube-api-access-l5z92\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.375151 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.375135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1241d4-f4ea-441f-b168-df5dea184278-istiod-ca-cert\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.375270 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.375254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1241d4-f4ea-441f-b168-df5dea184278-istio-podinfo\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.375412 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.375370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-credential-socket\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.476561 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.476466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-envoy\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.476561 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.476510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-certs\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.476783 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.476562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-data\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.476783 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.476590    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-istio-token\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.476783 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.476738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5z92\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-kube-api-access-l5z92\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.476949 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.476804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1241d4-f4ea-441f-b168-df5dea184278-istiod-ca-cert\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.476949 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.476832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1241d4-f4ea-441f-b168-df5dea184278-istio-podinfo\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.476949 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.476864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-credential-socket\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.477130 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.476964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-socket\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.477287 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.477265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-credential-socket\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.477423 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.477397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-certs\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.477546 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.477516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-socket\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.477606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.477522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-data\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.477606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.477588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1241d4-f4ea-441f-b168-df5dea184278-istiod-ca-cert\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.478929 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.478911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-envoy\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.479296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.479277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1241d4-f4ea-441f-b168-df5dea184278-istio-podinfo\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.483972 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.483953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-istio-token\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.484115 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.484098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5z92\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-kube-api-access-l5z92\") pod \"e2e-ait-74678972-openshift-default-95ff995b4-82mmc\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") " pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.573972 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.573949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:46:59.849815 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.849792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"]
Sep 16 13:46:59.851895 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:46:59.851868    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1241d4_f4ea_441f_b168_df5dea184278.slice/crio-c23a2fbb94d7c50ead68e2ac645e732a39bbdfb46a33864cf5ef2332df627091 WatchSource:0}: Error finding container c23a2fbb94d7c50ead68e2ac645e732a39bbdfb46a33864cf5ef2332df627091: Status 404 returned error can't find the container with id c23a2fbb94d7c50ead68e2ac645e732a39bbdfb46a33864cf5ef2332df627091
Sep 16 13:46:59.854832 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.854793    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:59.854909 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.854877    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:46:59.854954 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:46:59.854923    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:47:00.421882 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:00.421843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" event={"ID":"8b1241d4-f4ea-441f-b168-df5dea184278","Type":"ContainerStarted","Data":"20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d"}
Sep 16 13:47:00.422228 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:00.421910    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" event={"ID":"8b1241d4-f4ea-441f-b168-df5dea184278","Type":"ContainerStarted","Data":"c23a2fbb94d7c50ead68e2ac645e732a39bbdfb46a33864cf5ef2332df627091"}
Sep 16 13:47:00.455192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:00.455143    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" podStartSLOduration=1.455129266 podStartE2EDuration="1.455129266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:46:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:47:00.453116611 +0000 UTC m=+829.699994435" watchObservedRunningTime="2026-09-16 13:47:00.455129266 +0000 UTC m=+829.702007150"
Sep 16 13:47:00.574683 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:00.574652    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:00.581444 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:00.581415    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:01.427411 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:01.427366    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:01.428266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:01.428246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:03.698218 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.698150    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:47:03.817215 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817188    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-token\") pod \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") "
Sep 16 13:47:03.817441 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817224    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-data\") pod \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") "
Sep 16 13:47:03.817441 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817245    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-credential-socket\") pod \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") "
Sep 16 13:47:03.817441 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817296    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crwg4\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-kube-api-access-crwg4\") pod \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") "
Sep 16 13:47:03.817441 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817314    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-socket\") pod \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") "
Sep 16 13:47:03.817441 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817340    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-podinfo\") pod \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") "
Sep 16 13:47:03.817441 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817426    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istiod-ca-cert\") pod \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") "
Sep 16 13:47:03.817792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-data" (OuterVolumeSpecName: "istio-data") pod "92bbfed4-88fc-4acf-92c6-59fab17cdd23" (UID: "92bbfed4-88fc-4acf-92c6-59fab17cdd23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:03.817792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817518    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-certs\") pod \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") "
Sep 16 13:47:03.817792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817549    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-envoy\") pod \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\" (UID: \"92bbfed4-88fc-4acf-92c6-59fab17cdd23\") "
Sep 16 13:47:03.817792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817635    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92bbfed4-88fc-4acf-92c6-59fab17cdd23" (UID: "92bbfed4-88fc-4acf-92c6-59fab17cdd23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:03.817792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817649    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92bbfed4-88fc-4acf-92c6-59fab17cdd23" (UID: "92bbfed4-88fc-4acf-92c6-59fab17cdd23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:03.817792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817780    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92bbfed4-88fc-4acf-92c6-59fab17cdd23" (UID: "92bbfed4-88fc-4acf-92c6-59fab17cdd23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:47:03.818260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817799    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92bbfed4-88fc-4acf-92c6-59fab17cdd23" (UID: "92bbfed4-88fc-4acf-92c6-59fab17cdd23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:03.818260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817977    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:03.818260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.817996    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:03.818260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.818008    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:03.818260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.818017    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:03.818260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.818025    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:03.819978 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.819857    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-token" (OuterVolumeSpecName: "istio-token") pod "92bbfed4-88fc-4acf-92c6-59fab17cdd23" (UID: "92bbfed4-88fc-4acf-92c6-59fab17cdd23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:47:03.819978 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.819918    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92bbfed4-88fc-4acf-92c6-59fab17cdd23" (UID: "92bbfed4-88fc-4acf-92c6-59fab17cdd23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:47:03.820268 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.820243    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-kube-api-access-crwg4" (OuterVolumeSpecName: "kube-api-access-crwg4") pod "92bbfed4-88fc-4acf-92c6-59fab17cdd23" (UID: "92bbfed4-88fc-4acf-92c6-59fab17cdd23"). InnerVolumeSpecName "kube-api-access-crwg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:47:03.820420 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.820367    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92bbfed4-88fc-4acf-92c6-59fab17cdd23" (UID: "92bbfed4-88fc-4acf-92c6-59fab17cdd23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:03.919453 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.919424    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:03.919453 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.919453    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:03.919599 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.919462    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crwg4\" (UniqueName: \"kubernetes.io/projected/92bbfed4-88fc-4acf-92c6-59fab17cdd23-kube-api-access-crwg4\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:03.919599 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:03.919470    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92bbfed4-88fc-4acf-92c6-59fab17cdd23-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:04.445537 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.445505    2563 generic.go:356] "Generic (PLEG): container finished" podID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerID="a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f" exitCode=0
Sep 16 13:47:04.445715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.445553    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"
Sep 16 13:47:04.445715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.445589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" event={"ID":"92bbfed4-88fc-4acf-92c6-59fab17cdd23","Type":"ContainerDied","Data":"a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f"}
Sep 16 13:47:04.445715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.445650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg" event={"ID":"92bbfed4-88fc-4acf-92c6-59fab17cdd23","Type":"ContainerDied","Data":"d2429398d708ad8fe8711b701def882628c23c226d6831cdfccfbb269bea2ff5"}
Sep 16 13:47:04.445715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.445680    2563 scope.go:117] "RemoveContainer" containerID="a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f"
Sep 16 13:47:04.455406 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.455363    2563 scope.go:117] "RemoveContainer" containerID="a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb"
Sep 16 13:47:04.464069 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.464052    2563 scope.go:117] "RemoveContainer" containerID="a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f"
Sep 16 13:47:04.464334 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:47:04.464310    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f\": container with ID starting with a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f not found: ID does not exist" containerID="a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f"
Sep 16 13:47:04.464470 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.464343    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f"} err="failed to get container status \"a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f\": rpc error: code = NotFound desc = could not find container \"a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f\": container with ID starting with a1797167c31833dff413a3ed5be1e4e6f0796ceabb863a36f9dd7557cb4d4c1f not found: ID does not exist"
Sep 16 13:47:04.464470 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.464364    2563 scope.go:117] "RemoveContainer" containerID="a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb"
Sep 16 13:47:04.464787 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:47:04.464763    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb\": container with ID starting with a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb not found: ID does not exist" containerID="a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb"
Sep 16 13:47:04.465444 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.465412    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb"} err="failed to get container status \"a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb\": rpc error: code = NotFound desc = could not find container \"a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb\": container with ID starting with a0f28333d765415395675fbdbbd720f1b5352553435e8bdc797f165c034b7bfb not found: ID does not exist"
Sep 16 13:47:04.465444 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.464945    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"]
Sep 16 13:47:04.467615 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:04.467595    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b2821608-gw-openshift-default-64b969f5dd-v6mgg"]
Sep 16 13:47:05.219412 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:05.219362    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" path="/var/lib/kubelet/pods/92bbfed4-88fc-4acf-92c6-59fab17cdd23/volumes"
Sep 16 13:47:23.550847 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:23.550816    2563 generic.go:356] "Generic (PLEG): container finished" podID="8b1241d4-f4ea-441f-b168-df5dea184278" containerID="20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d" exitCode=0
Sep 16 13:47:23.551284 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:23.550859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" event={"ID":"8b1241d4-f4ea-441f-b168-df5dea184278","Type":"ContainerDied","Data":"20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d"}
Sep 16 13:47:23.551284 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:23.551223    2563 scope.go:117] "RemoveContainer" containerID="20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d"
Sep 16 13:47:23.552339 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:23.552307    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:47:23.552473 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:23.552416    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:47:23.552538 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:23.552469    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:47:24.558093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:24.558062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" event={"ID":"8b1241d4-f4ea-441f-b168-df5dea184278","Type":"ContainerStarted","Data":"e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5"}
Sep 16 13:47:24.574890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:24.574863    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:24.575037 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:24.575011    2563 patch_prober.go:28] interesting pod/e2e-ait-74678972-openshift-default-95ff995b4-82mmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 13:47:24.575084 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:24.575048    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 13:47:25.575221 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:25.575190    2563 patch_prober.go:28] interesting pod/e2e-ait-74678972-openshift-default-95ff995b4-82mmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 13:47:25.575649 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:25.575238    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 13:47:26.574997 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:26.574960    2563 patch_prober.go:28] interesting pod/e2e-ait-74678972-openshift-default-95ff995b4-82mmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 13:47:26.575170 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:26.575012    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 13:47:27.575162 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.575133    2563 patch_prober.go:28] interesting pod/e2e-ait-74678972-openshift-default-95ff995b4-82mmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 13:47:27.575598 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.575184    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 13:47:27.674316 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.674284    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"]
Sep 16 13:47:27.674738 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.674724    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy"
Sep 16 13:47:27.674789 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.674740    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy"
Sep 16 13:47:27.674789 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.674751    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy"
Sep 16 13:47:27.674789 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.674758    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy"
Sep 16 13:47:27.674886 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.674830    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy"
Sep 16 13:47:27.674886 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.674837    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="92bbfed4-88fc-4acf-92c6-59fab17cdd23" containerName="istio-proxy"
Sep 16 13:47:27.678472 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.678444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"
Sep 16 13:47:27.681217 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.681192    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 13:47:27.685556 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.685530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"]
Sep 16 13:47:27.685834 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.685817    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmnnx\""
Sep 16 13:47:27.764644 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.764613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f90a74d-7c06-4afa-b73f-a8fc0064a5f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-74678972-jq4sm\" (UID: \"1f90a74d-7c06-4afa-b73f-a8fc0064a5f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"
Sep 16 13:47:27.865938 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.865850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f90a74d-7c06-4afa-b73f-a8fc0064a5f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-74678972-jq4sm\" (UID: \"1f90a74d-7c06-4afa-b73f-a8fc0064a5f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"
Sep 16 13:47:27.866430 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:27.866413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f90a74d-7c06-4afa-b73f-a8fc0064a5f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-74678972-jq4sm\" (UID: \"1f90a74d-7c06-4afa-b73f-a8fc0064a5f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"
Sep 16 13:47:28.004141 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:28.004106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"
Sep 16 13:47:28.277462 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:28.277338    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"]
Sep 16 13:47:28.302527 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:47:28.302480    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f90a74d_7c06_4afa_b73f_a8fc0064a5f4.slice/crio-6691666fe007a390ec708cde04d0e92b0f50dae11e385640f26ad8c6aa7befb9 WatchSource:0}: Error finding container 6691666fe007a390ec708cde04d0e92b0f50dae11e385640f26ad8c6aa7befb9: Status 404 returned error can't find the container with id 6691666fe007a390ec708cde04d0e92b0f50dae11e385640f26ad8c6aa7befb9
Sep 16 13:47:28.574493 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:28.574367    2563 patch_prober.go:28] interesting pod/e2e-ait-74678972-openshift-default-95ff995b4-82mmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 13:47:28.574493 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:28.574437    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 13:47:28.582813 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:28.582733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm" event={"ID":"1f90a74d-7c06-4afa-b73f-a8fc0064a5f4","Type":"ContainerStarted","Data":"6691666fe007a390ec708cde04d0e92b0f50dae11e385640f26ad8c6aa7befb9"}
Sep 16 13:47:29.592259 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:29.592172    2563 generic.go:356] "Generic (PLEG): container finished" podID="1f90a74d-7c06-4afa-b73f-a8fc0064a5f4" containerID="a0bab262a760d832da6861519f7f0bb2a91e377ca4902413a2ea353e108f344c" exitCode=0
Sep 16 13:47:29.593026 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:29.592274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm" event={"ID":"1f90a74d-7c06-4afa-b73f-a8fc0064a5f4","Type":"ContainerDied","Data":"a0bab262a760d832da6861519f7f0bb2a91e377ca4902413a2ea353e108f344c"}
Sep 16 13:47:29.600778 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:29.600739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:29.601124 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:29.601064    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:29.602252 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:29.602228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:30.735460 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:30.735437    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"
Sep 16 13:47:30.801410 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:30.801358    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f90a74d-7c06-4afa-b73f-a8fc0064a5f4-maas-api-service-ca\") pod \"1f90a74d-7c06-4afa-b73f-a8fc0064a5f4\" (UID: \"1f90a74d-7c06-4afa-b73f-a8fc0064a5f4\") "
Sep 16 13:47:30.801675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:30.801651    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f90a74d-7c06-4afa-b73f-a8fc0064a5f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1f90a74d-7c06-4afa-b73f-a8fc0064a5f4" (UID: "1f90a74d-7c06-4afa-b73f-a8fc0064a5f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:47:30.902786 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:30.902751    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f90a74d-7c06-4afa-b73f-a8fc0064a5f4-maas-api-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:31.605426 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:31.605327    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"
Sep 16 13:47:31.605426 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:31.605362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm" event={"ID":"1f90a74d-7c06-4afa-b73f-a8fc0064a5f4","Type":"ContainerDied","Data":"6691666fe007a390ec708cde04d0e92b0f50dae11e385640f26ad8c6aa7befb9"}
Sep 16 13:47:31.605612 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:31.605436    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6691666fe007a390ec708cde04d0e92b0f50dae11e385640f26ad8c6aa7befb9"
Sep 16 13:47:33.929679 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:33.929648    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"]
Sep 16 13:47:33.932813 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:33.932790    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74678972-jq4sm"]
Sep 16 13:47:35.084220 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.084180    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"]
Sep 16 13:47:35.084730 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.084437    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy" containerID="cri-o://e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5" gracePeriod=30
Sep 16 13:47:35.221022 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.220987    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f90a74d-7c06-4afa-b73f-a8fc0064a5f4" path="/var/lib/kubelet/pods/1f90a74d-7c06-4afa-b73f-a8fc0064a5f4/volumes"
Sep 16 13:47:35.796678 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.796643    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"]
Sep 16 13:47:35.797927 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.797902    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f90a74d-7c06-4afa-b73f-a8fc0064a5f4" containerName="revoke-keys"
Sep 16 13:47:35.798113 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.798073    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f90a74d-7c06-4afa-b73f-a8fc0064a5f4" containerName="revoke-keys"
Sep 16 13:47:35.798457 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.798440    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f90a74d-7c06-4afa-b73f-a8fc0064a5f4" containerName="revoke-keys"
Sep 16 13:47:35.804299 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.804269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:35.806725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.806696    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8a426531-openshift-default-dockercfg-fddtc\""
Sep 16 13:47:35.808950 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.808930    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"]
Sep 16 13:47:35.961047 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.961016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-socket\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:35.961047 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.961053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istiod-ca-cert\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:35.961292 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.961091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6trsc\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-kube-api-access-6trsc\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:35.961292 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.961165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-certs\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:35.961292 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.961202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-podinfo\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:35.961433 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.961310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-envoy\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:35.961433 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.961352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-token\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:35.961433 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.961424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-credential-socket\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:35.961544 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:35.961448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-data\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063008 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.062920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-envoy\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063008 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.062969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-token\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063008 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-credential-socket\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-data\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-socket\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istiod-ca-cert\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6trsc\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-kube-api-access-6trsc\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-certs\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-podinfo\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063630 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063492    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-credential-socket\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063630 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063537    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-data\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-socket\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063920 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istiod-ca-cert\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.063986 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.063967    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-certs\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.065441 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.065421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-envoy\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.065696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.065678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-podinfo\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.070331 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.070312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-token\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.070482 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.070349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6trsc\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-kube-api-access-6trsc\") pod \"e2e-derive-8a426531-openshift-default-547d959d88-ltdkl\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") " pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.117331 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.117296    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:36.397468 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.397442    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"]
Sep 16 13:47:36.399527 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:47:36.399500    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e3a410_8c3a_40aa_9076_5cec09e97fe0.slice/crio-a5126aafe5ccec3fa6aa243c83d0d2c50a2ec4f58c30c83eb60189a219bdb8ef WatchSource:0}: Error finding container a5126aafe5ccec3fa6aa243c83d0d2c50a2ec4f58c30c83eb60189a219bdb8ef: Status 404 returned error can't find the container with id a5126aafe5ccec3fa6aa243c83d0d2c50a2ec4f58c30c83eb60189a219bdb8ef
Sep 16 13:47:36.401764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.401734    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:47:36.401848 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.401796    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:47:36.401848 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.401836    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:47:36.639247 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.639206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" event={"ID":"64e3a410-8c3a-40aa-9076-5cec09e97fe0","Type":"ContainerStarted","Data":"af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c"}
Sep 16 13:47:36.639474 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.639265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" event={"ID":"64e3a410-8c3a-40aa-9076-5cec09e97fe0","Type":"ContainerStarted","Data":"a5126aafe5ccec3fa6aa243c83d0d2c50a2ec4f58c30c83eb60189a219bdb8ef"}
Sep 16 13:47:36.662558 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:36.662449    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" podStartSLOduration=1.662433072 podStartE2EDuration="1.662433072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:47:36.65974015 +0000 UTC m=+865.906617975" watchObservedRunningTime="2026-09-16 13:47:36.662433072 +0000 UTC m=+865.909310897"
Sep 16 13:47:37.117984 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:37.117909    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:37.123124 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:37.123103    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:37.644919 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:37.644892    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:37.645728 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:37.645710    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:47:40.337832 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.337808    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:40.513521 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513494    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-data\") pod \"8b1241d4-f4ea-441f-b168-df5dea184278\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") "
Sep 16 13:47:40.513734 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513533    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-certs\") pod \"8b1241d4-f4ea-441f-b168-df5dea184278\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") "
Sep 16 13:47:40.513734 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513572    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-socket\") pod \"8b1241d4-f4ea-441f-b168-df5dea184278\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") "
Sep 16 13:47:40.513734 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513594    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1241d4-f4ea-441f-b168-df5dea184278-istiod-ca-cert\") pod \"8b1241d4-f4ea-441f-b168-df5dea184278\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") "
Sep 16 13:47:40.513734 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513639    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-envoy\") pod \"8b1241d4-f4ea-441f-b168-df5dea184278\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") "
Sep 16 13:47:40.513734 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513690    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-istio-token\") pod \"8b1241d4-f4ea-441f-b168-df5dea184278\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") "
Sep 16 13:47:40.513734 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5z92\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-kube-api-access-l5z92\") pod \"8b1241d4-f4ea-441f-b168-df5dea184278\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") "
Sep 16 13:47:40.514038 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513736    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b1241d4-f4ea-441f-b168-df5dea184278" (UID: "8b1241d4-f4ea-441f-b168-df5dea184278"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:40.514038 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513780    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-credential-socket\") pod \"8b1241d4-f4ea-441f-b168-df5dea184278\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") "
Sep 16 13:47:40.514038 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513850    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1241d4-f4ea-441f-b168-df5dea184278-istio-podinfo\") pod \"8b1241d4-f4ea-441f-b168-df5dea184278\" (UID: \"8b1241d4-f4ea-441f-b168-df5dea184278\") "
Sep 16 13:47:40.514038 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513861    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b1241d4-f4ea-441f-b168-df5dea184278" (UID: "8b1241d4-f4ea-441f-b168-df5dea184278"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:40.514038 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.513965    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b1241d4-f4ea-441f-b168-df5dea184278-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b1241d4-f4ea-441f-b168-df5dea184278" (UID: "8b1241d4-f4ea-441f-b168-df5dea184278"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:47:40.514038 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.514004    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b1241d4-f4ea-441f-b168-df5dea184278" (UID: "8b1241d4-f4ea-441f-b168-df5dea184278"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:40.514316 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.514200    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b1241d4-f4ea-441f-b168-df5dea184278" (UID: "8b1241d4-f4ea-441f-b168-df5dea184278"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:40.514360 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.514346    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:40.514423 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.514364    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:40.514423 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.514399    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:40.514527 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.514465    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b1241d4-f4ea-441f-b168-df5dea184278-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:40.514598 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.514584    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:40.516103 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.516078    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b1241d4-f4ea-441f-b168-df5dea184278" (UID: "8b1241d4-f4ea-441f-b168-df5dea184278"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:47:40.516205 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.516141    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b1241d4-f4ea-441f-b168-df5dea184278" (UID: "8b1241d4-f4ea-441f-b168-df5dea184278"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:47:40.516501 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.516473    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b1241d4-f4ea-441f-b168-df5dea184278-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b1241d4-f4ea-441f-b168-df5dea184278" (UID: "8b1241d4-f4ea-441f-b168-df5dea184278"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:47:40.516501 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.516481    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-kube-api-access-l5z92" (OuterVolumeSpecName: "kube-api-access-l5z92") pod "8b1241d4-f4ea-441f-b168-df5dea184278" (UID: "8b1241d4-f4ea-441f-b168-df5dea184278"). InnerVolumeSpecName "kube-api-access-l5z92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:47:40.615431 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.615403    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:40.615431 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.615430    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5z92\" (UniqueName: \"kubernetes.io/projected/8b1241d4-f4ea-441f-b168-df5dea184278-kube-api-access-l5z92\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:40.615633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.615442    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b1241d4-f4ea-441f-b168-df5dea184278-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:40.615633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.615451    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b1241d4-f4ea-441f-b168-df5dea184278-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:47:40.669985 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.669950    2563 generic.go:356] "Generic (PLEG): container finished" podID="8b1241d4-f4ea-441f-b168-df5dea184278" containerID="e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5" exitCode=0
Sep 16 13:47:40.670144 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.670006    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"
Sep 16 13:47:40.670144 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.670039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" event={"ID":"8b1241d4-f4ea-441f-b168-df5dea184278","Type":"ContainerDied","Data":"e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5"}
Sep 16 13:47:40.670144 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.670126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc" event={"ID":"8b1241d4-f4ea-441f-b168-df5dea184278","Type":"ContainerDied","Data":"c23a2fbb94d7c50ead68e2ac645e732a39bbdfb46a33864cf5ef2332df627091"}
Sep 16 13:47:40.670251 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.670154    2563 scope.go:117] "RemoveContainer" containerID="e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5"
Sep 16 13:47:40.682353 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.682334    2563 scope.go:117] "RemoveContainer" containerID="20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d"
Sep 16 13:47:40.692732 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.692692    2563 scope.go:117] "RemoveContainer" containerID="e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5"
Sep 16 13:47:40.693388 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:47:40.693335    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5\": container with ID starting with e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5 not found: ID does not exist" containerID="e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5"
Sep 16 13:47:40.693498 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.693447    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5"} err="failed to get container status \"e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5\": rpc error: code = NotFound desc = could not find container \"e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5\": container with ID starting with e06e5f55e085ffa7e94dd144c73373161d9d1538528a2ed1277041690e2518c5 not found: ID does not exist"
Sep 16 13:47:40.693498 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.693494    2563 scope.go:117] "RemoveContainer" containerID="20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d"
Sep 16 13:47:40.694012 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.693990    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"]
Sep 16 13:47:40.694436 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:47:40.694360    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d\": container with ID starting with 20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d not found: ID does not exist" containerID="20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d"
Sep 16 13:47:40.694436 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.694409    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d"} err="failed to get container status \"20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d\": rpc error: code = NotFound desc = could not find container \"20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d\": container with ID starting with 20dc8cb837f90c6f59fd2dea0ba8a48667e40ef14353bfe42226de94d48bf46d not found: ID does not exist"
Sep 16 13:47:40.697591 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:40.697568    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-74678972-openshift-default-95ff995b4-82mmc"]
Sep 16 13:47:41.217632 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:41.217594    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" path="/var/lib/kubelet/pods/8b1241d4-f4ea-441f-b168-df5dea184278/volumes"
Sep 16 13:47:42.006779 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.006743    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"]
Sep 16 13:47:42.007167 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.007154    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy"
Sep 16 13:47:42.007206 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.007168    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy"
Sep 16 13:47:42.007206 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.007188    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy"
Sep 16 13:47:42.007206 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.007193    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy"
Sep 16 13:47:42.007304 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.007269    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy"
Sep 16 13:47:42.011659 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.011642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.013686 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.013665    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8a426531-serving-cert\""
Sep 16 13:47:42.014393 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.014352    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9ljkc\""
Sep 16 13:47:42.014393 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.014391    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 13:47:42.014542 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.014391    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 13:47:42.014615 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.014352    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 13:47:42.021110 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.021075    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"]
Sep 16 13:47:42.029511 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.029480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53f9882-8f2a-4843-aac9-aeab1cd630f7-openshift-service-ca\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.029626 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.029602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-metrics-certs\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.029740 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.029707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-maas-api-tls\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.030344 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.029845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lghjm\" (UniqueName: \"kubernetes.io/projected/a53f9882-8f2a-4843-aac9-aeab1cd630f7-kube-api-access-lghjm\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.131454 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.131418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-maas-api-tls\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.131636 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.131464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lghjm\" (UniqueName: \"kubernetes.io/projected/a53f9882-8f2a-4843-aac9-aeab1cd630f7-kube-api-access-lghjm\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.131636 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.131539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53f9882-8f2a-4843-aac9-aeab1cd630f7-openshift-service-ca\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.131636 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:47:42.131574    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-serving-cert: secret "maas-api-e2e-derive-8a426531-serving-cert" not found
Sep 16 13:47:42.131782 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:47:42.131654    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-maas-api-tls podName:a53f9882-8f2a-4843-aac9-aeab1cd630f7 nodeName:}" failed. No retries permitted until 2026-09-16 13:47:42.631631579 +0000 UTC m=+871.878509384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-maas-api-tls") pod "maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq" (UID: "a53f9882-8f2a-4843-aac9-aeab1cd630f7") : secret "maas-api-e2e-derive-8a426531-serving-cert" not found
Sep 16 13:47:42.131782 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.131584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-metrics-certs\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.132271 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.132246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53f9882-8f2a-4843-aac9-aeab1cd630f7-openshift-service-ca\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.136617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.136286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-metrics-certs\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.146719 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.146680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lghjm\" (UniqueName: \"kubernetes.io/projected/a53f9882-8f2a-4843-aac9-aeab1cd630f7-kube-api-access-lghjm\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.637315 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.637282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-maas-api-tls\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.639828 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.639804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-maas-api-tls\") pod \"maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:42.925637 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:42.925557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:43.198389 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:43.198345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"]
Sep 16 13:47:43.200584 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:47:43.200554    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53f9882_8f2a_4843_aac9_aeab1cd630f7.slice/crio-7e1fa73499ca1ec5f92642adfa87cbf641cbaa0432fa7c7279186d7f9aaa0d30 WatchSource:0}: Error finding container 7e1fa73499ca1ec5f92642adfa87cbf641cbaa0432fa7c7279186d7f9aaa0d30: Status 404 returned error can't find the container with id 7e1fa73499ca1ec5f92642adfa87cbf641cbaa0432fa7c7279186d7f9aaa0d30
Sep 16 13:47:43.692890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:43.692858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq" event={"ID":"a53f9882-8f2a-4843-aac9-aeab1cd630f7","Type":"ContainerStarted","Data":"7e1fa73499ca1ec5f92642adfa87cbf641cbaa0432fa7c7279186d7f9aaa0d30"}
Sep 16 13:47:45.707008 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:45.706962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq" event={"ID":"a53f9882-8f2a-4843-aac9-aeab1cd630f7","Type":"ContainerStarted","Data":"f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1"}
Sep 16 13:47:45.707401 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:45.707030    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:47:45.723355 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:45.723306    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq" podStartSLOduration=2.338165563 podStartE2EDuration="4.723291124s" totalImagesPullingTime="2.385125561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:47:45.721057974 +0000 UTC m=+874.967935798" watchObservedRunningTime="2026-09-16 13:47:45.723291124 +0000 UTC m=+874.970168949"
Sep 16 13:47:51.718046 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:47:51.718017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:48:03.815475 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:03.815441    2563 generic.go:356] "Generic (PLEG): container finished" podID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerID="af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c" exitCode=0
Sep 16 13:48:03.815922 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:03.815484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" event={"ID":"64e3a410-8c3a-40aa-9076-5cec09e97fe0","Type":"ContainerDied","Data":"af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c"}
Sep 16 13:48:03.815922 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:03.815902    2563 scope.go:117] "RemoveContainer" containerID="af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c"
Sep 16 13:48:03.817075 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:03.817044    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:48:03.817182 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:03.817127    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:48:03.817182 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:03.817177    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:48:04.823234 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:04.823200    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" event={"ID":"64e3a410-8c3a-40aa-9076-5cec09e97fe0","Type":"ContainerStarted","Data":"8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7"}
Sep 16 13:48:05.118026 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:05.117933    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:48:05.119054 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:05.119021    2563 patch_prober.go:28] interesting pod/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 13:48:05.119188 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:05.119068    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 13:48:06.118720 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:06.118682    2563 patch_prober.go:28] interesting pod/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 13:48:06.119134 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:06.118740    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 13:48:07.118182 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:07.118141    2563 patch_prober.go:28] interesting pod/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 13:48:07.118429 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:07.118204    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 13:48:07.644872 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:07.644837    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:48:07.975790 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:07.975707    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"]
Sep 16 13:48:07.976767 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:07.976742    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b1241d4-f4ea-441f-b168-df5dea184278" containerName="istio-proxy"
Sep 16 13:48:07.980481 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:07.980454    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"
Sep 16 13:48:07.984604 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:07.984574    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmnnx\""
Sep 16 13:48:07.989072 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:07.989047    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"]
Sep 16 13:48:08.022911 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:08.022881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe680d88-ef50-409d-a997-db06e9016fed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8a426531-n5dbt\" (UID: \"fe680d88-ef50-409d-a997-db06e9016fed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"
Sep 16 13:48:08.118743 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:08.118708    2563 patch_prober.go:28] interesting pod/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 13:48:08.118906 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:08.118762    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 13:48:08.124223 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:08.124202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe680d88-ef50-409d-a997-db06e9016fed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8a426531-n5dbt\" (UID: \"fe680d88-ef50-409d-a997-db06e9016fed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"
Sep 16 13:48:08.124821 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:08.124803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe680d88-ef50-409d-a997-db06e9016fed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8a426531-n5dbt\" (UID: \"fe680d88-ef50-409d-a997-db06e9016fed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"
Sep 16 13:48:08.294679 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:08.294594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"
Sep 16 13:48:08.572231 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:08.572209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"]
Sep 16 13:48:08.574435 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:48:08.574407    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe680d88_ef50_409d_a997_db06e9016fed.slice/crio-061cb6a77c528b4f4bddd4fdd348922970ed20bee95b8e38009a0acfa0aebd2e WatchSource:0}: Error finding container 061cb6a77c528b4f4bddd4fdd348922970ed20bee95b8e38009a0acfa0aebd2e: Status 404 returned error can't find the container with id 061cb6a77c528b4f4bddd4fdd348922970ed20bee95b8e38009a0acfa0aebd2e
Sep 16 13:48:08.847496 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:08.847343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt" event={"ID":"fe680d88-ef50-409d-a997-db06e9016fed","Type":"ContainerStarted","Data":"061cb6a77c528b4f4bddd4fdd348922970ed20bee95b8e38009a0acfa0aebd2e"}
Sep 16 13:48:09.118358 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:09.118262    2563 patch_prober.go:28] interesting pod/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 13:48:09.118358 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:09.118322    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 13:48:09.854491 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:09.854403    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe680d88-ef50-409d-a997-db06e9016fed" containerID="7a2bbc4fd668deb77e9bc56dcedf151d3c5ab32aeb08907047384d9cef454788" exitCode=0
Sep 16 13:48:09.854491 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:09.854443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt" event={"ID":"fe680d88-ef50-409d-a997-db06e9016fed","Type":"ContainerDied","Data":"7a2bbc4fd668deb77e9bc56dcedf151d3c5ab32aeb08907047384d9cef454788"}
Sep 16 13:48:10.122439 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:10.122411    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:48:10.123481 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:10.123458    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:48:11.024817 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:11.024795    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"
Sep 16 13:48:11.053660 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:11.053635    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe680d88-ef50-409d-a997-db06e9016fed-maas-api-service-ca\") pod \"fe680d88-ef50-409d-a997-db06e9016fed\" (UID: \"fe680d88-ef50-409d-a997-db06e9016fed\") "
Sep 16 13:48:11.058424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:11.054257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe680d88-ef50-409d-a997-db06e9016fed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe680d88-ef50-409d-a997-db06e9016fed" (UID: "fe680d88-ef50-409d-a997-db06e9016fed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:48:11.058424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:11.054668    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe680d88-ef50-409d-a997-db06e9016fed-maas-api-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:11.169011 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:11.168984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:48:11.170674 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:11.170654    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:48:11.868050 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:11.868019    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"
Sep 16 13:48:11.868050 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:11.868041    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt" event={"ID":"fe680d88-ef50-409d-a997-db06e9016fed","Type":"ContainerDied","Data":"061cb6a77c528b4f4bddd4fdd348922970ed20bee95b8e38009a0acfa0aebd2e"}
Sep 16 13:48:11.868272 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:11.868088    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="061cb6a77c528b4f4bddd4fdd348922970ed20bee95b8e38009a0acfa0aebd2e"
Sep 16 13:48:20.897311 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:20.897275    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"]
Sep 16 13:48:20.897742 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:20.897522    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq" podUID="a53f9882-8f2a-4843-aac9-aeab1cd630f7" containerName="maas-api" containerID="cri-o://f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1" gracePeriod=30
Sep 16 13:48:21.103289 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.103255    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"]
Sep 16 13:48:21.105752 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.105722    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8a426531-n5dbt"]
Sep 16 13:48:21.151499 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.151437    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:48:21.230622 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.230582    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe680d88-ef50-409d-a997-db06e9016fed" path="/var/lib/kubelet/pods/fe680d88-ef50-409d-a997-db06e9016fed/volumes"
Sep 16 13:48:21.261624 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.261586    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53f9882-8f2a-4843-aac9-aeab1cd630f7-openshift-service-ca\") pod \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") "
Sep 16 13:48:21.261624 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.261628    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-maas-api-tls\") pod \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") "
Sep 16 13:48:21.261874 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.261691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lghjm\" (UniqueName: \"kubernetes.io/projected/a53f9882-8f2a-4843-aac9-aeab1cd630f7-kube-api-access-lghjm\") pod \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") "
Sep 16 13:48:21.261874 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.261829    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-metrics-certs\") pod \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\" (UID: \"a53f9882-8f2a-4843-aac9-aeab1cd630f7\") "
Sep 16 13:48:21.262033 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.262001    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53f9882-8f2a-4843-aac9-aeab1cd630f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a53f9882-8f2a-4843-aac9-aeab1cd630f7" (UID: "a53f9882-8f2a-4843-aac9-aeab1cd630f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:48:21.262660 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.262637    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53f9882-8f2a-4843-aac9-aeab1cd630f7-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:21.265110 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.265069    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a53f9882-8f2a-4843-aac9-aeab1cd630f7" (UID: "a53f9882-8f2a-4843-aac9-aeab1cd630f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:48:21.266865 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.266844    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a53f9882-8f2a-4843-aac9-aeab1cd630f7" (UID: "a53f9882-8f2a-4843-aac9-aeab1cd630f7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:48:21.266969 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.266872    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a53f9882-8f2a-4843-aac9-aeab1cd630f7-kube-api-access-lghjm" (OuterVolumeSpecName: "kube-api-access-lghjm") pod "a53f9882-8f2a-4843-aac9-aeab1cd630f7" (UID: "a53f9882-8f2a-4843-aac9-aeab1cd630f7"). InnerVolumeSpecName "kube-api-access-lghjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:48:21.321522 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.321466    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"]
Sep 16 13:48:21.321763 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.321729    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy" containerID="cri-o://8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7" gracePeriod=30
Sep 16 13:48:21.363764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.363725    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lghjm\" (UniqueName: \"kubernetes.io/projected/a53f9882-8f2a-4843-aac9-aeab1cd630f7-kube-api-access-lghjm\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:21.363764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.363758    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:21.363764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.363771    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53f9882-8f2a-4843-aac9-aeab1cd630f7-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:21.936922 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.936890    2563 generic.go:356] "Generic (PLEG): container finished" podID="a53f9882-8f2a-4843-aac9-aeab1cd630f7" containerID="f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1" exitCode=0
Sep 16 13:48:21.937444 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.936949    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"
Sep 16 13:48:21.937444 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.936983    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq" event={"ID":"a53f9882-8f2a-4843-aac9-aeab1cd630f7","Type":"ContainerDied","Data":"f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1"}
Sep 16 13:48:21.937444 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.937049    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq" event={"ID":"a53f9882-8f2a-4843-aac9-aeab1cd630f7","Type":"ContainerDied","Data":"7e1fa73499ca1ec5f92642adfa87cbf641cbaa0432fa7c7279186d7f9aaa0d30"}
Sep 16 13:48:21.937444 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.937083    2563 scope.go:117] "RemoveContainer" containerID="f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1"
Sep 16 13:48:21.947471 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.947451    2563 scope.go:117] "RemoveContainer" containerID="f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1"
Sep 16 13:48:21.947768 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:48:21.947747    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1\": container with ID starting with f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1 not found: ID does not exist" containerID="f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1"
Sep 16 13:48:21.947847 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.947776    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1"} err="failed to get container status \"f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1\": rpc error: code = NotFound desc = could not find container \"f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1\": container with ID starting with f6b9d7400b2982e86f36213df42b8757fd5146a3481ab845b80b52b7c83c11e1 not found: ID does not exist"
Sep 16 13:48:21.960282 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.960254    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"]
Sep 16 13:48:21.963347 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:21.963325    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8a426531-8fbc5dfc4-tzvxq"]
Sep 16 13:48:23.218146 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:23.218107    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a53f9882-8f2a-4843-aac9-aeab1cd630f7" path="/var/lib/kubelet/pods/a53f9882-8f2a-4843-aac9-aeab1cd630f7/volumes"
Sep 16 13:48:25.125300 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:25.125267    2563 patch_prober.go:28] interesting pod/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 13:48:25.125710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:25.125331    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:48:26.590590 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.590556    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:48:26.720201 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720110    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-token\") pod \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") "
Sep 16 13:48:26.720201 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720196    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-certs\") pod \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") "
Sep 16 13:48:26.720438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720219    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istiod-ca-cert\") pod \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") "
Sep 16 13:48:26.720438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720237    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-socket\") pod \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") "
Sep 16 13:48:26.720438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720308    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-envoy\") pod \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") "
Sep 16 13:48:26.720438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720322    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-data\") pod \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") "
Sep 16 13:48:26.720438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720344    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6trsc\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-kube-api-access-6trsc\") pod \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") "
Sep 16 13:48:26.720438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-credential-socket\") pod \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") "
Sep 16 13:48:26.720769 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720464    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-podinfo\") pod \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\" (UID: \"64e3a410-8c3a-40aa-9076-5cec09e97fe0\") "
Sep 16 13:48:26.720769 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720555    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64e3a410-8c3a-40aa-9076-5cec09e97fe0" (UID: "64e3a410-8c3a-40aa-9076-5cec09e97fe0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:26.720769 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720664    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64e3a410-8c3a-40aa-9076-5cec09e97fe0" (UID: "64e3a410-8c3a-40aa-9076-5cec09e97fe0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:48:26.720920 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720781    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64e3a410-8c3a-40aa-9076-5cec09e97fe0" (UID: "64e3a410-8c3a-40aa-9076-5cec09e97fe0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:26.720920 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720863    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64e3a410-8c3a-40aa-9076-5cec09e97fe0" (UID: "64e3a410-8c3a-40aa-9076-5cec09e97fe0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:26.720920 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720868    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:26.720920 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720911    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:26.721300 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720951    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:26.721300 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.720966    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-data" (OuterVolumeSpecName: "istio-data") pod "64e3a410-8c3a-40aa-9076-5cec09e97fe0" (UID: "64e3a410-8c3a-40aa-9076-5cec09e97fe0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:26.722701 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.722676    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-token" (OuterVolumeSpecName: "istio-token") pod "64e3a410-8c3a-40aa-9076-5cec09e97fe0" (UID: "64e3a410-8c3a-40aa-9076-5cec09e97fe0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:48:26.722824 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.722756    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64e3a410-8c3a-40aa-9076-5cec09e97fe0" (UID: "64e3a410-8c3a-40aa-9076-5cec09e97fe0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:48:26.723188 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.723169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64e3a410-8c3a-40aa-9076-5cec09e97fe0" (UID: "64e3a410-8c3a-40aa-9076-5cec09e97fe0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:26.723259 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.723169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-kube-api-access-6trsc" (OuterVolumeSpecName: "kube-api-access-6trsc") pod "64e3a410-8c3a-40aa-9076-5cec09e97fe0" (UID: "64e3a410-8c3a-40aa-9076-5cec09e97fe0"). InnerVolumeSpecName "kube-api-access-6trsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:48:26.821885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.821851    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:26.821885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.821882    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:26.821885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.821894    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6trsc\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-kube-api-access-6trsc\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:26.822136 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.821907    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e3a410-8c3a-40aa-9076-5cec09e97fe0-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:26.822136 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.821919    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:26.822136 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.821929    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e3a410-8c3a-40aa-9076-5cec09e97fe0-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:26.969223 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.969189    2563 generic.go:356] "Generic (PLEG): container finished" podID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerID="8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7" exitCode=0
Sep 16 13:48:26.969415 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.969238    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"
Sep 16 13:48:26.969415 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.969278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" event={"ID":"64e3a410-8c3a-40aa-9076-5cec09e97fe0","Type":"ContainerDied","Data":"8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7"}
Sep 16 13:48:26.969415 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.969337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl" event={"ID":"64e3a410-8c3a-40aa-9076-5cec09e97fe0","Type":"ContainerDied","Data":"a5126aafe5ccec3fa6aa243c83d0d2c50a2ec4f58c30c83eb60189a219bdb8ef"}
Sep 16 13:48:26.969415 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.969362    2563 scope.go:117] "RemoveContainer" containerID="8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7"
Sep 16 13:48:26.980265 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.980249    2563 scope.go:117] "RemoveContainer" containerID="af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c"
Sep 16 13:48:26.989427 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.989356    2563 scope.go:117] "RemoveContainer" containerID="8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7"
Sep 16 13:48:26.989802 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:48:26.989784    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7\": container with ID starting with 8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7 not found: ID does not exist" containerID="8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7"
Sep 16 13:48:26.989884 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.989811    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7"} err="failed to get container status \"8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7\": rpc error: code = NotFound desc = could not find container \"8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7\": container with ID starting with 8998f518bf5f727495cdc5113c751fab8fe11bb1f4819dc21be88c1f40fc63e7 not found: ID does not exist"
Sep 16 13:48:26.989884 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.989828    2563 scope.go:117] "RemoveContainer" containerID="af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c"
Sep 16 13:48:26.990090 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:48:26.990068    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c\": container with ID starting with af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c not found: ID does not exist" containerID="af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c"
Sep 16 13:48:26.990277 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.990096    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c"} err="failed to get container status \"af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c\": rpc error: code = NotFound desc = could not find container \"af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c\": container with ID starting with af2a8dc1bb95f468341def60e51cccc6224b331964119c13623ae27c250c876c not found: ID does not exist"
Sep 16 13:48:26.990965 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.990934    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"]
Sep 16 13:48:26.993553 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:26.993533    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8a426531-openshift-default-547d959d88-ltdkl"]
Sep 16 13:48:27.217523 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:27.217492    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" path="/var/lib/kubelet/pods/64e3a410-8c3a-40aa-9076-5cec09e97fe0/volumes"
Sep 16 13:48:27.855818 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:27.855784    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"]
Sep 16 13:48:27.856259 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:27.856052    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy" containerID="cri-o://66149f5d681762d3ca7116b9da6810c60be2be40e4b23fc17e29977dbf9e17f5" gracePeriod=30
Sep 16 13:48:28.545068 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545026    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"]
Sep 16 13:48:28.545481 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545447    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a53f9882-8f2a-4843-aac9-aeab1cd630f7" containerName="maas-api"
Sep 16 13:48:28.545481 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545482    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a53f9882-8f2a-4843-aac9-aeab1cd630f7" containerName="maas-api"
Sep 16 13:48:28.545631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545496    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy"
Sep 16 13:48:28.545631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545501    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy"
Sep 16 13:48:28.545631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545512    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy"
Sep 16 13:48:28.545631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545518    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy"
Sep 16 13:48:28.545631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545533    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe680d88-ef50-409d-a997-db06e9016fed" containerName="revoke-keys"
Sep 16 13:48:28.545631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545538    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe680d88-ef50-409d-a997-db06e9016fed" containerName="revoke-keys"
Sep 16 13:48:28.545631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545622    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a53f9882-8f2a-4843-aac9-aeab1cd630f7" containerName="maas-api"
Sep 16 13:48:28.545631 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545633    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy"
Sep 16 13:48:28.546064 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545640    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe680d88-ef50-409d-a997-db06e9016fed" containerName="revoke-keys"
Sep 16 13:48:28.546064 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.545645    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="64e3a410-8c3a-40aa-9076-5cec09e97fe0" containerName="istio-proxy"
Sep 16 13:48:28.550464 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.550441    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.552668 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.552653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-101425-openshift-default-dockercfg-x9sb5\""
Sep 16 13:48:28.558944 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.558923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"]
Sep 16 13:48:28.642905 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.642873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-envoy\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.643107 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.642914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-socket\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.643107 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.642961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pblvp\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-kube-api-access-pblvp\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.643107 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.642986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-podinfo\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.643107 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.643033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-token\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.643107 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.643063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e355cef-0ad1-48de-9eca-f73702e7a048-istiod-ca-cert\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.643418 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.643143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-certs\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.643418 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.643187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-credential-socket\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.643418 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.643214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-data\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744351 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-credential-socket\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744351 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-data\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-envoy\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-socket\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pblvp\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-kube-api-access-pblvp\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-podinfo\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-token\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e355cef-0ad1-48de-9eca-f73702e7a048-istiod-ca-cert\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-certs\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.744601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-credential-socket\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.745492 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-data\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.745492 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744890    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-socket\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.745492 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.744959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-certs\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.745492 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.745364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e355cef-0ad1-48de-9eca-f73702e7a048-istiod-ca-cert\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.746969 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.746945    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-envoy\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.747155 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.747125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-podinfo\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.752392 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.752353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-token\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.752843 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.752822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pblvp\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-kube-api-access-pblvp\") pod \"e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") " pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:28.862971 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:28.862886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:29.146673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:29.146648    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"]
Sep 16 13:48:29.148330 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:48:29.148301    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e355cef_0ad1_48de_9eca_f73702e7a048.slice/crio-cdcbdc5daead47e59b5c0eee9c592843c3d983b02b9c4f635c28ddc3c21707a0 WatchSource:0}: Error finding container cdcbdc5daead47e59b5c0eee9c592843c3d983b02b9c4f635c28ddc3c21707a0: Status 404 returned error can't find the container with id cdcbdc5daead47e59b5c0eee9c592843c3d983b02b9c4f635c28ddc3c21707a0
Sep 16 13:48:29.150712 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:29.150680    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:48:29.150885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:29.150756    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:48:29.150885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:29.150800    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:48:30.012524 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:30.012485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" event={"ID":"4e355cef-0ad1-48de-9eca-f73702e7a048","Type":"ContainerStarted","Data":"f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533"}
Sep 16 13:48:30.012961 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:30.012571    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" event={"ID":"4e355cef-0ad1-48de-9eca-f73702e7a048","Type":"ContainerStarted","Data":"cdcbdc5daead47e59b5c0eee9c592843c3d983b02b9c4f635c28ddc3c21707a0"}
Sep 16 13:48:30.035089 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:30.035043    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" podStartSLOduration=2.035030249 podStartE2EDuration="2.035030249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:48:30.033232797 +0000 UTC m=+919.280110626" watchObservedRunningTime="2026-09-16 13:48:30.035030249 +0000 UTC m=+919.281908073"
Sep 16 13:48:30.863550 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:30.863519    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:30.868446 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:30.868423    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:31.018955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:31.018930    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:31.020272 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:31.020249    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:32.637003 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:32.636969    2563 patch_prober.go:28] interesting pod/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 13:48:32.637457 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:32.637027    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:48:33.034024 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.033997    2563 generic.go:356] "Generic (PLEG): container finished" podID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerID="66149f5d681762d3ca7116b9da6810c60be2be40e4b23fc17e29977dbf9e17f5" exitCode=0
Sep 16 13:48:33.034167 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.034069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" event={"ID":"66691c21-9fa0-4dc6-9fbd-2224943a2011","Type":"ContainerDied","Data":"66149f5d681762d3ca7116b9da6810c60be2be40e4b23fc17e29977dbf9e17f5"}
Sep 16 13:48:33.034167 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.034130    2563 scope.go:117] "RemoveContainer" containerID="dfa57083ef1a93bd1f421a7e1c4563e61c21ef07f7764655c5cc6a65ac41c31f"
Sep 16 13:48:33.112293 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.112270    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:48:33.191655 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191626    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-socket\") pod \"66691c21-9fa0-4dc6-9fbd-2224943a2011\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") "
Sep 16 13:48:33.191655 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191655    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-certs\") pod \"66691c21-9fa0-4dc6-9fbd-2224943a2011\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") "
Sep 16 13:48:33.191854 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191692    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm4w2\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-kube-api-access-jm4w2\") pod \"66691c21-9fa0-4dc6-9fbd-2224943a2011\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") "
Sep 16 13:48:33.191854 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191741    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-envoy\") pod \"66691c21-9fa0-4dc6-9fbd-2224943a2011\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") "
Sep 16 13:48:33.191854 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191761    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-data\") pod \"66691c21-9fa0-4dc6-9fbd-2224943a2011\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") "
Sep 16 13:48:33.191854 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191792    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66691c21-9fa0-4dc6-9fbd-2224943a2011-istiod-ca-cert\") pod \"66691c21-9fa0-4dc6-9fbd-2224943a2011\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") "
Sep 16 13:48:33.191854 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191809    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-token\") pod \"66691c21-9fa0-4dc6-9fbd-2224943a2011\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") "
Sep 16 13:48:33.192104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191912    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-credential-socket\") pod \"66691c21-9fa0-4dc6-9fbd-2224943a2011\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") "
Sep 16 13:48:33.192104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191907    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66691c21-9fa0-4dc6-9fbd-2224943a2011" (UID: "66691c21-9fa0-4dc6-9fbd-2224943a2011"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:33.192104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.191979    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-podinfo\") pod \"66691c21-9fa0-4dc6-9fbd-2224943a2011\" (UID: \"66691c21-9fa0-4dc6-9fbd-2224943a2011\") "
Sep 16 13:48:33.192255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.192162    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66691c21-9fa0-4dc6-9fbd-2224943a2011" (UID: "66691c21-9fa0-4dc6-9fbd-2224943a2011"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:33.192255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.192185    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-data" (OuterVolumeSpecName: "istio-data") pod "66691c21-9fa0-4dc6-9fbd-2224943a2011" (UID: "66691c21-9fa0-4dc6-9fbd-2224943a2011"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:33.192255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.192192    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66691c21-9fa0-4dc6-9fbd-2224943a2011-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66691c21-9fa0-4dc6-9fbd-2224943a2011" (UID: "66691c21-9fa0-4dc6-9fbd-2224943a2011"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:48:33.192429 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.192406    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66691c21-9fa0-4dc6-9fbd-2224943a2011" (UID: "66691c21-9fa0-4dc6-9fbd-2224943a2011"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:33.192921 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.192826    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:33.192921 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.192853    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:33.192921 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.192870    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:33.192921 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.192884    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:33.192921 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.192898    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66691c21-9fa0-4dc6-9fbd-2224943a2011-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:33.194266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.194241    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-kube-api-access-jm4w2" (OuterVolumeSpecName: "kube-api-access-jm4w2") pod "66691c21-9fa0-4dc6-9fbd-2224943a2011" (UID: "66691c21-9fa0-4dc6-9fbd-2224943a2011"). InnerVolumeSpecName "kube-api-access-jm4w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:48:33.194266 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.194248    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66691c21-9fa0-4dc6-9fbd-2224943a2011" (UID: "66691c21-9fa0-4dc6-9fbd-2224943a2011"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:48:33.194554 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.194528    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-token" (OuterVolumeSpecName: "istio-token") pod "66691c21-9fa0-4dc6-9fbd-2224943a2011" (UID: "66691c21-9fa0-4dc6-9fbd-2224943a2011"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:48:33.194607 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.194595    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66691c21-9fa0-4dc6-9fbd-2224943a2011" (UID: "66691c21-9fa0-4dc6-9fbd-2224943a2011"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:48:33.293678 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.293577    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm4w2\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-kube-api-access-jm4w2\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:33.293678 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.293614    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:33.293678 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.293629    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:33.293678 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:33.293643    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66691c21-9fa0-4dc6-9fbd-2224943a2011-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:48:34.041132 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.041105    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"
Sep 16 13:48:34.041604 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.041139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj" event={"ID":"66691c21-9fa0-4dc6-9fbd-2224943a2011","Type":"ContainerDied","Data":"d65a573895f39686d9a7cb415a7aed4989abc6b0bf9f3ab14222e352be95a12f"}
Sep 16 13:48:34.041604 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.041190    2563 scope.go:117] "RemoveContainer" containerID="66149f5d681762d3ca7116b9da6810c60be2be40e4b23fc17e29977dbf9e17f5"
Sep 16 13:48:34.060731 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.060696    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"]
Sep 16 13:48:34.064808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.064783    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-d94fd9-openshift-default-598ddfbcdb-5x9bj"]
Sep 16 13:48:34.784988 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.784954    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"]
Sep 16 13:48:34.785690 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.785668    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy"
Sep 16 13:48:34.785807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.785693    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy"
Sep 16 13:48:34.785807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.785708    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy"
Sep 16 13:48:34.785807 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.785717    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy"
Sep 16 13:48:34.785958 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.785816    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy"
Sep 16 13:48:34.785958 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.785828    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" containerName="istio-proxy"
Sep 16 13:48:34.790795 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.790767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:34.793853 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.793829    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-101425-serving-cert\""
Sep 16 13:48:34.794368 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.794192    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 13:48:34.794368 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.794210    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 13:48:34.794591 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.794491    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9ljkc\""
Sep 16 13:48:34.794764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.794749    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 13:48:34.795993 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.795957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"]
Sep 16 13:48:34.910761 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.910721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-metrics-certs\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:34.910912 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.910769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-maas-api-tls\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:34.910912 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.910785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe58a97a-d4a0-4ceb-946e-09a9725c0520-openshift-service-ca\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:34.910912 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:34.910885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lqvj\" (UniqueName: \"kubernetes.io/projected/fe58a97a-d4a0-4ceb-946e-09a9725c0520-kube-api-access-8lqvj\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.011613 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.011570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-metrics-certs\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.011613 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.011619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-maas-api-tls\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.011842 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.011645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe58a97a-d4a0-4ceb-946e-09a9725c0520-openshift-service-ca\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.011842 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.011712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lqvj\" (UniqueName: \"kubernetes.io/projected/fe58a97a-d4a0-4ceb-946e-09a9725c0520-kube-api-access-8lqvj\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.012402 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.012348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe58a97a-d4a0-4ceb-946e-09a9725c0520-openshift-service-ca\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.014139 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.014116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-maas-api-tls\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.014237 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.014145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-metrics-certs\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.018935 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.018911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lqvj\" (UniqueName: \"kubernetes.io/projected/fe58a97a-d4a0-4ceb-946e-09a9725c0520-kube-api-access-8lqvj\") pod \"maas-api-e2e-explicit-101425-59494648fd-bn96f\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.104599 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.104516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:35.219081 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.219045    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66691c21-9fa0-4dc6-9fbd-2224943a2011" path="/var/lib/kubelet/pods/66691c21-9fa0-4dc6-9fbd-2224943a2011/volumes"
Sep 16 13:48:35.386016 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:48:35.385957    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe58a97a_d4a0_4ceb_946e_09a9725c0520.slice/crio-151e6bc30573dbfbd1927e7249931db0178d288187ecb24a8735b68954722f3e WatchSource:0}: Error finding container 151e6bc30573dbfbd1927e7249931db0178d288187ecb24a8735b68954722f3e: Status 404 returned error can't find the container with id 151e6bc30573dbfbd1927e7249931db0178d288187ecb24a8735b68954722f3e
Sep 16 13:48:35.386016 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.385977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"]
Sep 16 13:48:35.387665 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:35.387644    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:48:36.054597 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:36.054563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f" event={"ID":"fe58a97a-d4a0-4ceb-946e-09a9725c0520","Type":"ContainerStarted","Data":"6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757"}
Sep 16 13:48:36.054762 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:36.054612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f" event={"ID":"fe58a97a-d4a0-4ceb-946e-09a9725c0520","Type":"ContainerStarted","Data":"151e6bc30573dbfbd1927e7249931db0178d288187ecb24a8735b68954722f3e"}
Sep 16 13:48:36.054762 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:36.054665    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:36.088447 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:36.088369    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f" podStartSLOduration=1.62331157 podStartE2EDuration="2.088352679s" totalImagesPullingTime="465.041109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:48:36.085678921 +0000 UTC m=+925.332556752" watchObservedRunningTime="2026-09-16 13:48:36.088352679 +0000 UTC m=+925.335230503"
Sep 16 13:48:42.065797 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:42.065770    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:48:50.151507 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:50.151472    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerID="f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533" exitCode=0
Sep 16 13:48:50.152040 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:50.151522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" event={"ID":"4e355cef-0ad1-48de-9eca-f73702e7a048","Type":"ContainerDied","Data":"f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533"}
Sep 16 13:48:50.152040 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:50.151923    2563 scope.go:117] "RemoveContainer" containerID="f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533"
Sep 16 13:48:50.153045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:50.153015    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:48:50.153125 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:50.153085    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:48:50.153125 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:50.153117    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:48:51.158749 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:51.158710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" event={"ID":"4e355cef-0ad1-48de-9eca-f73702e7a048","Type":"ContainerStarted","Data":"f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b"}
Sep 16 13:48:51.863590 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:51.863553    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:51.863812 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:51.863786    2563 patch_prober.go:28] interesting pod/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 13:48:51.863894 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:51.863861    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 13:48:52.863611 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:52.863574    2563 patch_prober.go:28] interesting pod/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 13:48:52.864090 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:52.863636    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 13:48:53.863774 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:53.863735    2563 patch_prober.go:28] interesting pod/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 13:48:53.864271 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:53.863798    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 13:48:54.864128 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:54.864090    2563 patch_prober.go:28] interesting pod/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 13:48:54.864560 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:54.864143    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 13:48:55.863344 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:55.863307    2563 patch_prober.go:28] interesting pod/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 13:48:55.863557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:55.863399    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 13:48:56.867672 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:56.867640    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:56.868066 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:56.867898    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:48:56.868645 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:48:56.868627    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:49:57.157243 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.157210    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"]
Sep 16 13:49:57.162176 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.162154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.165169 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.165127    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-51b5e7aa-openshift-default-dockercfg-hrhsq\""
Sep 16 13:49:57.172666 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.172638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"]
Sep 16 13:49:57.258847 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.258783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-token\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.259042 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.258911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwkpc\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-kube-api-access-zwkpc\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.259042 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.258999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-credential-socket\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.259172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.259093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istiod-ca-cert\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.259172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.259169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-podinfo\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.259288 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.259205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-data\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.259288 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.259226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-socket\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.259288 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.259241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-envoy\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.259288 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.259268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-certs\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.360675 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.360634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-token\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.360882 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.360702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkpc\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-kube-api-access-zwkpc\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.360882 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.360757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-credential-socket\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.360882 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.360822    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istiod-ca-cert\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.360882 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.360862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-podinfo\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.361117 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.360902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-data\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.361117 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.360935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-socket\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.361117 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.360959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-envoy\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.361117 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.360990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-certs\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.361334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.361252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-credential-socket\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.361334 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.361273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-data\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.361498 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.361347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-socket\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.361498 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.361452    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-certs\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.361747 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.361726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istiod-ca-cert\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.363303 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.363284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-envoy\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.363886 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.363869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-podinfo\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.371586 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.371557    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-token\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.372549 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.372524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwkpc\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-kube-api-access-zwkpc\") pod \"e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") " pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.474578 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.474470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:57.788896 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.788867    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"]
Sep 16 13:49:57.791276 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:49:57.791251    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067207ea_39e3_48c8_bce8_d6b51e4b14e3.slice/crio-f7845c457b7662606829b295a4a2e9cf29e6bc8ff303556a44936bd106429d6a WatchSource:0}: Error finding container f7845c457b7662606829b295a4a2e9cf29e6bc8ff303556a44936bd106429d6a: Status 404 returned error can't find the container with id f7845c457b7662606829b295a4a2e9cf29e6bc8ff303556a44936bd106429d6a
Sep 16 13:49:57.793555 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.793521    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:49:57.793655 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.793591    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:49:57.793655 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:57.793617    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:49:58.535711 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:58.535674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" event={"ID":"067207ea-39e3-48c8-bce8-d6b51e4b14e3","Type":"ContainerStarted","Data":"48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea"}
Sep 16 13:49:58.536113 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:58.535734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" event={"ID":"067207ea-39e3-48c8-bce8-d6b51e4b14e3","Type":"ContainerStarted","Data":"f7845c457b7662606829b295a4a2e9cf29e6bc8ff303556a44936bd106429d6a"}
Sep 16 13:49:58.559673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:58.559623    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" podStartSLOduration=1.559608109 podStartE2EDuration="1.559608109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:49:58.557604974 +0000 UTC m=+1007.804482800" watchObservedRunningTime="2026-09-16 13:49:58.559608109 +0000 UTC m=+1007.806485934"
Sep 16 13:49:59.475480 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:59.475446    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:59.480697 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:59.480666    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:59.541866 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:59.541823    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:49:59.542755 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:49:59.542735    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:50:06.697704 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.697667    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"]
Sep 16 13:50:06.701988 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.701965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.704216 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.704197    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-51b5e7aa-serving-cert\""
Sep 16 13:50:06.712936 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.712913    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"]
Sep 16 13:50:06.760880 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.760847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c616e88c-c907-4c53-a559-de674cebb784-openshift-service-ca\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.761045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.760992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-metrics-certs\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.761045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.761011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j79tj\" (UniqueName: \"kubernetes.io/projected/c616e88c-c907-4c53-a559-de674cebb784-kube-api-access-j79tj\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.761045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.761032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-maas-api-tls\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.861646 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.861615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-metrics-certs\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.861646 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.861648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j79tj\" (UniqueName: \"kubernetes.io/projected/c616e88c-c907-4c53-a559-de674cebb784-kube-api-access-j79tj\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.861927 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.861675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-maas-api-tls\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.861927 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:50:06.861776    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-serving-cert: secret "maas-api-e2e-mt-51b5e7aa-serving-cert" not found
Sep 16 13:50:06.861927 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.861805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c616e88c-c907-4c53-a559-de674cebb784-openshift-service-ca\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.861927 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:50:06.861828    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-maas-api-tls podName:c616e88c-c907-4c53-a559-de674cebb784 nodeName:}" failed. No retries permitted until 2026-09-16 13:50:07.361810275 +0000 UTC m=+1016.608688079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-maas-api-tls") pod "maas-api-e2e-mt-51b5e7aa-774b69644c-fn727" (UID: "c616e88c-c907-4c53-a559-de674cebb784") : secret "maas-api-e2e-mt-51b5e7aa-serving-cert" not found
Sep 16 13:50:06.862496 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.862473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c616e88c-c907-4c53-a559-de674cebb784-openshift-service-ca\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.864234 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.864213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-metrics-certs\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:06.871386 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:06.871351    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j79tj\" (UniqueName: \"kubernetes.io/projected/c616e88c-c907-4c53-a559-de674cebb784-kube-api-access-j79tj\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:07.368244 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.368209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-maas-api-tls\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:07.370979 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.370955    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-maas-api-tls\") pod \"maas-api-e2e-mt-51b5e7aa-774b69644c-fn727\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:07.426659 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.426625    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"]
Sep 16 13:50:07.430385 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.430357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:07.432758 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.432727    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-51b5e7aa-dockercfg-xjxnb\""
Sep 16 13:50:07.432895 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.432757    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-51b5e7aa\""
Sep 16 13:50:07.440054 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.440029    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"]
Sep 16 13:50:07.469592 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.469554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l265\" (UniqueName: \"kubernetes.io/projected/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-kube-api-access-8l265\") pod \"payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj\" (UID: \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\") " pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:07.469771 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.469607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-plugins-config-volume\") pod \"payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj\" (UID: \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\") " pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:07.570494 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.570456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l265\" (UniqueName: \"kubernetes.io/projected/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-kube-api-access-8l265\") pod \"payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj\" (UID: \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\") " pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:07.570673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.570510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-plugins-config-volume\") pod \"payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj\" (UID: \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\") " pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:07.571282 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.571264    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-plugins-config-volume\") pod \"payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj\" (UID: \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\") " pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:07.584272 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.584237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l265\" (UniqueName: \"kubernetes.io/projected/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-kube-api-access-8l265\") pod \"payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj\" (UID: \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\") " pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:07.616633 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.616590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:07.742874 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.742842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:07.896097 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:07.896073    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"]
Sep 16 13:50:07.898163 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:50:07.898135    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc616e88c_c907_4c53_a559_de674cebb784.slice/crio-229b115f68c1759b1380479a84c1ead8fc58ad4a899fcd7e1d7ed0690829cb28 WatchSource:0}: Error finding container 229b115f68c1759b1380479a84c1ead8fc58ad4a899fcd7e1d7ed0690829cb28: Status 404 returned error can't find the container with id 229b115f68c1759b1380479a84c1ead8fc58ad4a899fcd7e1d7ed0690829cb28
Sep 16 13:50:08.019786 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:08.019758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"]
Sep 16 13:50:08.021952 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:50:08.021929    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903bc706_df89_4f30_aa7c_c0d2d4e3d1c8.slice/crio-47744515ff36a6228cc5b6938b347edf8c5443667e886e250b200322c395cda7 WatchSource:0}: Error finding container 47744515ff36a6228cc5b6938b347edf8c5443667e886e250b200322c395cda7: Status 404 returned error can't find the container with id 47744515ff36a6228cc5b6938b347edf8c5443667e886e250b200322c395cda7
Sep 16 13:50:08.612036 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:08.611990    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727" event={"ID":"c616e88c-c907-4c53-a559-de674cebb784","Type":"ContainerStarted","Data":"5fae1c631d8e592ad87202ee6cbecba77983bd76e6a1a209f51b401690a171fd"}
Sep 16 13:50:08.612261 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:08.612056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727" event={"ID":"c616e88c-c907-4c53-a559-de674cebb784","Type":"ContainerStarted","Data":"229b115f68c1759b1380479a84c1ead8fc58ad4a899fcd7e1d7ed0690829cb28"}
Sep 16 13:50:08.612261 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:08.612085    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:08.613606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:08.613580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj" event={"ID":"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8","Type":"ContainerStarted","Data":"9a61c91df1d5a8495e93d66c701c217436f4f29c763024e2caa8ebe6781f3b0c"}
Sep 16 13:50:08.613713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:08.613632    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:08.613713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:08.613651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj" event={"ID":"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8","Type":"ContainerStarted","Data":"47744515ff36a6228cc5b6938b347edf8c5443667e886e250b200322c395cda7"}
Sep 16 13:50:08.628641 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:08.628592    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727" podStartSLOduration=2.097927539 podStartE2EDuration="2.628577742s" totalImagesPullingTime="530.650203ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:50:08.627416283 +0000 UTC m=+1017.874294109" watchObservedRunningTime="2026-09-16 13:50:08.628577742 +0000 UTC m=+1017.875455566"
Sep 16 13:50:08.643707 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:08.643653    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj" podStartSLOduration=1.643638129 podStartE2EDuration="1.643638129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:50:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:50:08.641440029 +0000 UTC m=+1017.888317850" watchObservedRunningTime="2026-09-16 13:50:08.643638129 +0000 UTC m=+1017.890515954"
Sep 16 13:50:14.624753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:14.624723    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:19.622567 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:19.622537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:24.710265 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:24.710176    2563 generic.go:356] "Generic (PLEG): container finished" podID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerID="48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea" exitCode=0
Sep 16 13:50:24.710265 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:24.710249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" event={"ID":"067207ea-39e3-48c8-bce8-d6b51e4b14e3","Type":"ContainerDied","Data":"48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea"}
Sep 16 13:50:24.710797 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:24.710729    2563 scope.go:117] "RemoveContainer" containerID="48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea"
Sep 16 13:50:24.711987 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:24.711955    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:50:24.712113 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:24.712043    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:50:24.712113 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:24.712091    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:50:25.718114 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:25.718075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" event={"ID":"067207ea-39e3-48c8-bce8-d6b51e4b14e3","Type":"ContainerStarted","Data":"beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f"}
Sep 16 13:50:26.474954 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:26.474922    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:50:26.476319 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:26.476289    2563 patch_prober.go:28] interesting pod/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 13:50:26.476595 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:26.476567    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 13:50:27.474917 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:27.474876    2563 patch_prober.go:28] interesting pod/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 13:50:27.475437 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:27.474940    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 13:50:28.475871 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:28.475826    2563 patch_prober.go:28] interesting pod/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 13:50:28.476555 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:28.476518    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 13:50:29.475197 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:29.475165    2563 patch_prober.go:28] interesting pod/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 13:50:29.475431 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:29.475216    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 13:50:29.542755 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:29.542719    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:50:30.479407 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:30.475358    2563 patch_prober.go:28] interesting pod/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 16 13:50:30.479407 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:30.475457    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 16 13:50:31.480858 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:31.480828    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:50:31.482072 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:31.482053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:50:50.596682 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.596646    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"]
Sep 16 13:50:50.597173 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.596916    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727" podUID="c616e88c-c907-4c53-a559-de674cebb784" containerName="maas-api" containerID="cri-o://5fae1c631d8e592ad87202ee6cbecba77983bd76e6a1a209f51b401690a171fd" gracePeriod=30
Sep 16 13:50:50.651940 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.651903    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"]
Sep 16 13:50:50.652197 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.652171    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj" podUID="903bc706-df89-4f30-aa7c-c0d2d4e3d1c8" containerName="payload-processing" containerID="cri-o://9a61c91df1d5a8495e93d66c701c217436f4f29c763024e2caa8ebe6781f3b0c" gracePeriod=30
Sep 16 13:50:50.868866 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.868696    2563 generic.go:356] "Generic (PLEG): container finished" podID="c616e88c-c907-4c53-a559-de674cebb784" containerID="5fae1c631d8e592ad87202ee6cbecba77983bd76e6a1a209f51b401690a171fd" exitCode=0
Sep 16 13:50:50.868866 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.868756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727" event={"ID":"c616e88c-c907-4c53-a559-de674cebb784","Type":"ContainerDied","Data":"5fae1c631d8e592ad87202ee6cbecba77983bd76e6a1a209f51b401690a171fd"}
Sep 16 13:50:50.870863 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.870835    2563 generic.go:356] "Generic (PLEG): container finished" podID="903bc706-df89-4f30-aa7c-c0d2d4e3d1c8" containerID="9a61c91df1d5a8495e93d66c701c217436f4f29c763024e2caa8ebe6781f3b0c" exitCode=0
Sep 16 13:50:50.871020 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.870902    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj" event={"ID":"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8","Type":"ContainerDied","Data":"9a61c91df1d5a8495e93d66c701c217436f4f29c763024e2caa8ebe6781f3b0c"}
Sep 16 13:50:50.948325 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.948291    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:50.961017 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.960989    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:50.965028 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.964142    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c616e88c-c907-4c53-a559-de674cebb784-openshift-service-ca\") pod \"c616e88c-c907-4c53-a559-de674cebb784\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") "
Sep 16 13:50:50.965028 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.965020    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c616e88c-c907-4c53-a559-de674cebb784-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c616e88c-c907-4c53-a559-de674cebb784" (UID: "c616e88c-c907-4c53-a559-de674cebb784"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:50:50.965281 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.965031    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j79tj\" (UniqueName: \"kubernetes.io/projected/c616e88c-c907-4c53-a559-de674cebb784-kube-api-access-j79tj\") pod \"c616e88c-c907-4c53-a559-de674cebb784\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") "
Sep 16 13:50:50.966151 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.965466    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-plugins-config-volume\") pod \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\" (UID: \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\") "
Sep 16 13:50:50.966151 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.965507    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-maas-api-tls\") pod \"c616e88c-c907-4c53-a559-de674cebb784\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") "
Sep 16 13:50:50.966151 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.965563    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l265\" (UniqueName: \"kubernetes.io/projected/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-kube-api-access-8l265\") pod \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\" (UID: \"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8\") "
Sep 16 13:50:50.966151 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.965606    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-metrics-certs\") pod \"c616e88c-c907-4c53-a559-de674cebb784\" (UID: \"c616e88c-c907-4c53-a559-de674cebb784\") "
Sep 16 13:50:50.966151 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.966043    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c616e88c-c907-4c53-a559-de674cebb784-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:50:50.967320 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.967278    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "903bc706-df89-4f30-aa7c-c0d2d4e3d1c8" (UID: "903bc706-df89-4f30-aa7c-c0d2d4e3d1c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:50:50.968765 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.968737    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c616e88c-c907-4c53-a559-de674cebb784" (UID: "c616e88c-c907-4c53-a559-de674cebb784"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:50:50.970606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.970566    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c616e88c-c907-4c53-a559-de674cebb784" (UID: "c616e88c-c907-4c53-a559-de674cebb784"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:50:50.970730 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.970681    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-kube-api-access-8l265" (OuterVolumeSpecName: "kube-api-access-8l265") pod "903bc706-df89-4f30-aa7c-c0d2d4e3d1c8" (UID: "903bc706-df89-4f30-aa7c-c0d2d4e3d1c8"). InnerVolumeSpecName "kube-api-access-8l265". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:50:50.971042 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:50.971017    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c616e88c-c907-4c53-a559-de674cebb784-kube-api-access-j79tj" (OuterVolumeSpecName: "kube-api-access-j79tj") pod "c616e88c-c907-4c53-a559-de674cebb784" (UID: "c616e88c-c907-4c53-a559-de674cebb784"). InnerVolumeSpecName "kube-api-access-j79tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:50:51.066579 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.066540    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j79tj\" (UniqueName: \"kubernetes.io/projected/c616e88c-c907-4c53-a559-de674cebb784-kube-api-access-j79tj\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:50:51.066579 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.066572    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-plugins-config-volume\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:50:51.066579 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.066586    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:50:51.066828 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.066598    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l265\" (UniqueName: \"kubernetes.io/projected/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8-kube-api-access-8l265\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:50:51.066828 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.066609    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c616e88c-c907-4c53-a559-de674cebb784-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:50:51.878049 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.878017    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"
Sep 16 13:50:51.878585 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.878019    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727" event={"ID":"c616e88c-c907-4c53-a559-de674cebb784","Type":"ContainerDied","Data":"229b115f68c1759b1380479a84c1ead8fc58ad4a899fcd7e1d7ed0690829cb28"}
Sep 16 13:50:51.878792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.878224    2563 scope.go:117] "RemoveContainer" containerID="5fae1c631d8e592ad87202ee6cbecba77983bd76e6a1a209f51b401690a171fd"
Sep 16 13:50:51.879767 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.879740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj" event={"ID":"903bc706-df89-4f30-aa7c-c0d2d4e3d1c8","Type":"ContainerDied","Data":"47744515ff36a6228cc5b6938b347edf8c5443667e886e250b200322c395cda7"}
Sep 16 13:50:51.879879 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.879771    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"
Sep 16 13:50:51.890015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.889997    2563 scope.go:117] "RemoveContainer" containerID="9a61c91df1d5a8495e93d66c701c217436f4f29c763024e2caa8ebe6781f3b0c"
Sep 16 13:50:51.896428 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.896404    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"]
Sep 16 13:50:51.902444 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.902421    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-51b5e7aa-5cccf55c8f-rxchj"]
Sep 16 13:50:51.913612 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.913573    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"]
Sep 16 13:50:51.917695 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:51.917669    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-51b5e7aa-774b69644c-fn727"]
Sep 16 13:50:53.218271 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:53.218232    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="903bc706-df89-4f30-aa7c-c0d2d4e3d1c8" path="/var/lib/kubelet/pods/903bc706-df89-4f30-aa7c-c0d2d4e3d1c8/volumes"
Sep 16 13:50:53.218766 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:53.218690    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c616e88c-c907-4c53-a559-de674cebb784" path="/var/lib/kubelet/pods/c616e88c-c907-4c53-a559-de674cebb784/volumes"
Sep 16 13:50:57.534150 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:57.534111    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"]
Sep 16 13:50:57.534696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:50:57.534485    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy" containerID="cri-o://beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f" gracePeriod=30
Sep 16 13:51:01.483894 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:01.483860    2563 patch_prober.go:28] interesting pod/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 13:51:01.484365 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:01.483938    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:51:02.803369 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.803304    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:51:02.897546 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897514    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwkpc\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-kube-api-access-zwkpc\") pod \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") "
Sep 16 13:51:02.897746 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897555    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-token\") pod \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") "
Sep 16 13:51:02.897746 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897585    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-envoy\") pod \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") "
Sep 16 13:51:02.897746 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897628    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-credential-socket\") pod \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") "
Sep 16 13:51:02.897746 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897648    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-certs\") pod \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") "
Sep 16 13:51:02.897746 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897730    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-data\") pod \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") "
Sep 16 13:51:02.898027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897772    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-podinfo\") pod \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") "
Sep 16 13:51:02.898027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-socket\") pod \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") "
Sep 16 13:51:02.898027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897890    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istiod-ca-cert\") pod \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\" (UID: \"067207ea-39e3-48c8-bce8-d6b51e4b14e3\") "
Sep 16 13:51:02.898027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897981    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "067207ea-39e3-48c8-bce8-d6b51e4b14e3" (UID: "067207ea-39e3-48c8-bce8-d6b51e4b14e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:02.898027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.897970    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "067207ea-39e3-48c8-bce8-d6b51e4b14e3" (UID: "067207ea-39e3-48c8-bce8-d6b51e4b14e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:02.898316 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.898037    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "067207ea-39e3-48c8-bce8-d6b51e4b14e3" (UID: "067207ea-39e3-48c8-bce8-d6b51e4b14e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:02.898316 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.898178    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "067207ea-39e3-48c8-bce8-d6b51e4b14e3" (UID: "067207ea-39e3-48c8-bce8-d6b51e4b14e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:02.898316 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.898297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "067207ea-39e3-48c8-bce8-d6b51e4b14e3" (UID: "067207ea-39e3-48c8-bce8-d6b51e4b14e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:51:02.898647 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.898425    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:02.898647 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.898447    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:02.898647 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.898461    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:02.898647 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.898482    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:02.899987 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.899958    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "067207ea-39e3-48c8-bce8-d6b51e4b14e3" (UID: "067207ea-39e3-48c8-bce8-d6b51e4b14e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:02.900109 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.900068    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "067207ea-39e3-48c8-bce8-d6b51e4b14e3" (UID: "067207ea-39e3-48c8-bce8-d6b51e4b14e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:51:02.900109 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.900099    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-kube-api-access-zwkpc" (OuterVolumeSpecName: "kube-api-access-zwkpc") pod "067207ea-39e3-48c8-bce8-d6b51e4b14e3" (UID: "067207ea-39e3-48c8-bce8-d6b51e4b14e3"). InnerVolumeSpecName "kube-api-access-zwkpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:51:02.900203 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.900111    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "067207ea-39e3-48c8-bce8-d6b51e4b14e3" (UID: "067207ea-39e3-48c8-bce8-d6b51e4b14e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:51:02.951575 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.951538    2563 generic.go:356] "Generic (PLEG): container finished" podID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerID="beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f" exitCode=0
Sep 16 13:51:02.951754 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.951588    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"
Sep 16 13:51:02.951754 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.951615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" event={"ID":"067207ea-39e3-48c8-bce8-d6b51e4b14e3","Type":"ContainerDied","Data":"beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f"}
Sep 16 13:51:02.951754 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.951666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr" event={"ID":"067207ea-39e3-48c8-bce8-d6b51e4b14e3","Type":"ContainerDied","Data":"f7845c457b7662606829b295a4a2e9cf29e6bc8ff303556a44936bd106429d6a"}
Sep 16 13:51:02.951754 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.951693    2563 scope.go:117] "RemoveContainer" containerID="beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f"
Sep 16 13:51:02.962060 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.962040    2563 scope.go:117] "RemoveContainer" containerID="48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea"
Sep 16 13:51:02.971825 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.971805    2563 scope.go:117] "RemoveContainer" containerID="beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f"
Sep 16 13:51:02.972108 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:51:02.972084    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f\": container with ID starting with beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f not found: ID does not exist" containerID="beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f"
Sep 16 13:51:02.972205 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.972115    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f"} err="failed to get container status \"beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f\": rpc error: code = NotFound desc = could not find container \"beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f\": container with ID starting with beb35dd0462a97ddb92301776932f5013620f2aa021f657ae384c843e44d485f not found: ID does not exist"
Sep 16 13:51:02.972205 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.972134    2563 scope.go:117] "RemoveContainer" containerID="48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea"
Sep 16 13:51:02.972441 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:51:02.972424    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea\": container with ID starting with 48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea not found: ID does not exist" containerID="48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea"
Sep 16 13:51:02.972494 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.972448    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea"} err="failed to get container status \"48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea\": rpc error: code = NotFound desc = could not find container \"48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea\": container with ID starting with 48f110625a3b925f90dfa8d72d95a804412badce4bd6259aba71e66aa0285dea not found: ID does not exist"
Sep 16 13:51:02.973280 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.973262    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"]
Sep 16 13:51:02.980452 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.979849    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-51b5e7aa-openshift-default-5d9b586bb8-424tr"]
Sep 16 13:51:02.999071 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.999043    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:02.999071 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.999071    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:02.999254 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.999080    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwkpc\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-kube-api-access-zwkpc\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:02.999254 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.999090    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:02.999254 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:02.999098    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/067207ea-39e3-48c8-bce8-d6b51e4b14e3-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:03.217648 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:03.217612    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" path="/var/lib/kubelet/pods/067207ea-39e3-48c8-bce8-d6b51e4b14e3/volumes"
Sep 16 13:51:05.954661 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:05.954626    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"]
Sep 16 13:51:05.955450 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:05.955412    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f" podUID="fe58a97a-d4a0-4ceb-946e-09a9725c0520" containerName="maas-api" containerID="cri-o://6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757" gracePeriod=30
Sep 16 13:51:06.228305 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.228276    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:51:06.333602 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.333564    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe58a97a-d4a0-4ceb-946e-09a9725c0520-openshift-service-ca\") pod \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") "
Sep 16 13:51:06.333777 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.333619    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-maas-api-tls\") pod \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") "
Sep 16 13:51:06.333777 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.333712    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-metrics-certs\") pod \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") "
Sep 16 13:51:06.333777 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.333752    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lqvj\" (UniqueName: \"kubernetes.io/projected/fe58a97a-d4a0-4ceb-946e-09a9725c0520-kube-api-access-8lqvj\") pod \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\" (UID: \"fe58a97a-d4a0-4ceb-946e-09a9725c0520\") "
Sep 16 13:51:06.334677 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.334589    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe58a97a-d4a0-4ceb-946e-09a9725c0520-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe58a97a-d4a0-4ceb-946e-09a9725c0520" (UID: "fe58a97a-d4a0-4ceb-946e-09a9725c0520"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:51:06.334957 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.334908    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe58a97a-d4a0-4ceb-946e-09a9725c0520-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:06.336739 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.336711    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fe58a97a-d4a0-4ceb-946e-09a9725c0520" (UID: "fe58a97a-d4a0-4ceb-946e-09a9725c0520"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:51:06.336870 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.336776    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe58a97a-d4a0-4ceb-946e-09a9725c0520" (UID: "fe58a97a-d4a0-4ceb-946e-09a9725c0520"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:51:06.337003 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.336986    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe58a97a-d4a0-4ceb-946e-09a9725c0520-kube-api-access-8lqvj" (OuterVolumeSpecName: "kube-api-access-8lqvj") pod "fe58a97a-d4a0-4ceb-946e-09a9725c0520" (UID: "fe58a97a-d4a0-4ceb-946e-09a9725c0520"). InnerVolumeSpecName "kube-api-access-8lqvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:51:06.435973 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.435930    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:06.435973 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.435964    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe58a97a-d4a0-4ceb-946e-09a9725c0520-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:06.435973 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.435977    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lqvj\" (UniqueName: \"kubernetes.io/projected/fe58a97a-d4a0-4ceb-946e-09a9725c0520-kube-api-access-8lqvj\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:06.982911 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.982878    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe58a97a-d4a0-4ceb-946e-09a9725c0520" containerID="6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757" exitCode=0
Sep 16 13:51:06.983366 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.982925    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"
Sep 16 13:51:06.983366 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.982962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f" event={"ID":"fe58a97a-d4a0-4ceb-946e-09a9725c0520","Type":"ContainerDied","Data":"6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757"}
Sep 16 13:51:06.983366 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.983016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f" event={"ID":"fe58a97a-d4a0-4ceb-946e-09a9725c0520","Type":"ContainerDied","Data":"151e6bc30573dbfbd1927e7249931db0178d288187ecb24a8735b68954722f3e"}
Sep 16 13:51:06.983366 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.983038    2563 scope.go:117] "RemoveContainer" containerID="6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757"
Sep 16 13:51:06.993124 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.993106    2563 scope.go:117] "RemoveContainer" containerID="6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757"
Sep 16 13:51:06.993435 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:51:06.993415    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757\": container with ID starting with 6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757 not found: ID does not exist" containerID="6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757"
Sep 16 13:51:06.993488 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:06.993444    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757"} err="failed to get container status \"6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757\": rpc error: code = NotFound desc = could not find container \"6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757\": container with ID starting with 6d8cc537881ec112f3aa3ab7fb20d0ff4fcab16605f106be1edd591148b19757 not found: ID does not exist"
Sep 16 13:51:07.019189 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:07.019157    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"]
Sep 16 13:51:07.023483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:07.023457    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-101425-59494648fd-bn96f"]
Sep 16 13:51:07.217858 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:07.217824    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe58a97a-d4a0-4ceb-946e-09a9725c0520" path="/var/lib/kubelet/pods/fe58a97a-d4a0-4ceb-946e-09a9725c0520/volumes"
Sep 16 13:51:11.452139 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452106    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"]
Sep 16 13:51:11.452634 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452593    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe58a97a-d4a0-4ceb-946e-09a9725c0520" containerName="maas-api"
Sep 16 13:51:11.452634 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452606    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe58a97a-d4a0-4ceb-946e-09a9725c0520" containerName="maas-api"
Sep 16 13:51:11.452634 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452631    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903bc706-df89-4f30-aa7c-c0d2d4e3d1c8" containerName="payload-processing"
Sep 16 13:51:11.452741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452639    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="903bc706-df89-4f30-aa7c-c0d2d4e3d1c8" containerName="payload-processing"
Sep 16 13:51:11.452741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452644    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c616e88c-c907-4c53-a559-de674cebb784" containerName="maas-api"
Sep 16 13:51:11.452741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452650    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c616e88c-c907-4c53-a559-de674cebb784" containerName="maas-api"
Sep 16 13:51:11.452741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452661    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy"
Sep 16 13:51:11.452741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452666    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy"
Sep 16 13:51:11.452741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452673    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy"
Sep 16 13:51:11.452741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452678    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy"
Sep 16 13:51:11.452741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452741    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy"
Sep 16 13:51:11.452973 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452752    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe58a97a-d4a0-4ceb-946e-09a9725c0520" containerName="maas-api"
Sep 16 13:51:11.452973 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452760    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="903bc706-df89-4f30-aa7c-c0d2d4e3d1c8" containerName="payload-processing"
Sep 16 13:51:11.452973 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.452766    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c616e88c-c907-4c53-a559-de674cebb784" containerName="maas-api"
Sep 16 13:51:11.457290 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.457272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.459644 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.459620    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-4fa336-openshift-default-dockercfg-mrhxv\""
Sep 16 13:51:11.467246 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.467127    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"]
Sep 16 13:51:11.588909 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.588815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-socket\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.588909 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.588870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-credential-socket\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.589111 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.588927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90cc2539-6199-4d42-93ed-d580eeb72236-istio-podinfo\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.589111 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.588969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-envoy\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.589111 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.589022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4t9q\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-kube-api-access-v4t9q\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.589227 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.589127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90cc2539-6199-4d42-93ed-d580eeb72236-istiod-ca-cert\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.589227 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.589186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-istio-token\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.589292 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.589224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-data\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.589292 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.589268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-certs\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.690661 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.690619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90cc2539-6199-4d42-93ed-d580eeb72236-istiod-ca-cert\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.690661 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.690670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-istio-token\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.690938 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.690790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-data\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.690938 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.690826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-certs\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.690938 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.690909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-socket\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.691113 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.690942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-credential-socket\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.691113 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.690968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90cc2539-6199-4d42-93ed-d580eeb72236-istio-podinfo\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.691113 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.691020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-envoy\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.691113 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.691086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4t9q\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-kube-api-access-v4t9q\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.691329 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.691187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-data\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.691329 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.691254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-certs\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.691503 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.691479    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90cc2539-6199-4d42-93ed-d580eeb72236-istiod-ca-cert\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.691690 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.691666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-credential-socket\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.691690 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.691685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-socket\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.693672 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.693647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-envoy\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.693774 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.693752    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90cc2539-6199-4d42-93ed-d580eeb72236-istio-podinfo\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.699302 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.699283    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-istio-token\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.699668 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.699647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4t9q\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-kube-api-access-v4t9q\") pod \"e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") " pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:11.771873 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:11.771839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:12.055833 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:12.055634    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"]
Sep 16 13:51:12.059006 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:51:12.058980    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cc2539_6199_4d42_93ed_d580eeb72236.slice/crio-a85e8317f2e88ff6b5a10a2785b24761b6fb9d0a315aafb89e67bd5e32d02426 WatchSource:0}: Error finding container a85e8317f2e88ff6b5a10a2785b24761b6fb9d0a315aafb89e67bd5e32d02426: Status 404 returned error can't find the container with id a85e8317f2e88ff6b5a10a2785b24761b6fb9d0a315aafb89e67bd5e32d02426
Sep 16 13:51:12.061757 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:12.061729    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:51:12.061820 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:12.061795    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:51:12.061862 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:12.061823    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:51:13.021544 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:13.021506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" event={"ID":"90cc2539-6199-4d42-93ed-d580eeb72236","Type":"ContainerStarted","Data":"8e0feb510cc121b9e6187fb987e23c0028b5386f661578f11fc2cbe4c6cd2015"}
Sep 16 13:51:13.021928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:13.021587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" event={"ID":"90cc2539-6199-4d42-93ed-d580eeb72236","Type":"ContainerStarted","Data":"a85e8317f2e88ff6b5a10a2785b24761b6fb9d0a315aafb89e67bd5e32d02426"}
Sep 16 13:51:13.039877 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:13.039827    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" podStartSLOduration=2.039811817 podStartE2EDuration="2.039811817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:51:13.037959369 +0000 UTC m=+1082.284837194" watchObservedRunningTime="2026-09-16 13:51:13.039811817 +0000 UTC m=+1082.286689643"
Sep 16 13:51:13.772106 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:13.772069    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:13.777715 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:13.777690    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:14.027098 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:14.027000    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:14.027919 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:14.027901    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:17.912067 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:17.912028    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"]
Sep 16 13:51:17.912606 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:17.912590    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="067207ea-39e3-48c8-bce8-d6b51e4b14e3" containerName="istio-proxy"
Sep 16 13:51:17.926230 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:17.926201    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:17.928967 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:17.928930    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"]
Sep 16 13:51:17.929346 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:17.929327    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-4fa336-serving-cert\""
Sep 16 13:51:17.929778 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:17.929758    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9ljkc\""
Sep 16 13:51:17.930041 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:17.929813    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 13:51:17.930748 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:17.930728    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 13:51:17.931875 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:17.930788    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 13:51:18.062246 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.062204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.062493 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.062307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-622nf\" (UniqueName: \"kubernetes.io/projected/768c6065-5e7b-4435-bacc-e38e80a33219-kube-api-access-622nf\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.062493 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.062334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/768c6065-5e7b-4435-bacc-e38e80a33219-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.062493 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.062441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.164035 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.163930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-622nf\" (UniqueName: \"kubernetes.io/projected/768c6065-5e7b-4435-bacc-e38e80a33219-kube-api-access-622nf\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.164035 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.163978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/768c6065-5e7b-4435-bacc-e38e80a33219-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.164268 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.164048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.164268 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.164155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.164783 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.164764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/768c6065-5e7b-4435-bacc-e38e80a33219-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.166677 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.166650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.166784 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.166700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.171878 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.171853    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-622nf\" (UniqueName: \"kubernetes.io/projected/768c6065-5e7b-4435-bacc-e38e80a33219-kube-api-access-622nf\") pod \"maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.240680 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.240642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:18.516854 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.516767    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"]
Sep 16 13:51:18.521632 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.521608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:18.523589 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.523568    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-4fa336-dockercfg-t5wn2\""
Sep 16 13:51:18.523730 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.523573    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-4fa336\""
Sep 16 13:51:18.527476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.527244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"]
Sep 16 13:51:18.530885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.530862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"]
Sep 16 13:51:18.532990 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:51:18.532966    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768c6065_5e7b_4435_bacc_e38e80a33219.slice/crio-68e98b2df3a7bcce6f7d4b757477fab23011dfe834b5b07581c6f19f9558134f WatchSource:0}: Error finding container 68e98b2df3a7bcce6f7d4b757477fab23011dfe834b5b07581c6f19f9558134f: Status 404 returned error can't find the container with id 68e98b2df3a7bcce6f7d4b757477fab23011dfe834b5b07581c6f19f9558134f
Sep 16 13:51:18.669996 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.669957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b28t\" (UniqueName: \"kubernetes.io/projected/da85ece8-18fc-4e38-8a10-7432c05bbbca-kube-api-access-7b28t\") pod \"payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s\" (UID: \"da85ece8-18fc-4e38-8a10-7432c05bbbca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:18.669996 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.670001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da85ece8-18fc-4e38-8a10-7432c05bbbca-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s\" (UID: \"da85ece8-18fc-4e38-8a10-7432c05bbbca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:18.771342 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.771260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b28t\" (UniqueName: \"kubernetes.io/projected/da85ece8-18fc-4e38-8a10-7432c05bbbca-kube-api-access-7b28t\") pod \"payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s\" (UID: \"da85ece8-18fc-4e38-8a10-7432c05bbbca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:18.771342 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.771299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da85ece8-18fc-4e38-8a10-7432c05bbbca-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s\" (UID: \"da85ece8-18fc-4e38-8a10-7432c05bbbca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:18.772143 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.772125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da85ece8-18fc-4e38-8a10-7432c05bbbca-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s\" (UID: \"da85ece8-18fc-4e38-8a10-7432c05bbbca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:18.778578 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.778551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b28t\" (UniqueName: \"kubernetes.io/projected/da85ece8-18fc-4e38-8a10-7432c05bbbca-kube-api-access-7b28t\") pod \"payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s\" (UID: \"da85ece8-18fc-4e38-8a10-7432c05bbbca\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:18.845543 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:18.845512    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:19.059574 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:19.059492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg" event={"ID":"768c6065-5e7b-4435-bacc-e38e80a33219","Type":"ContainerStarted","Data":"68e98b2df3a7bcce6f7d4b757477fab23011dfe834b5b07581c6f19f9558134f"}
Sep 16 13:51:19.118584 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:19.118555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"]
Sep 16 13:51:19.120541 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:51:19.120512    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda85ece8_18fc_4e38_8a10_7432c05bbbca.slice/crio-ffe2acefd5236f4bb36af41dfe4e3145a883142afc6c921c28fe5de5eadf7a75 WatchSource:0}: Error finding container ffe2acefd5236f4bb36af41dfe4e3145a883142afc6c921c28fe5de5eadf7a75: Status 404 returned error can't find the container with id ffe2acefd5236f4bb36af41dfe4e3145a883142afc6c921c28fe5de5eadf7a75
Sep 16 13:51:20.066871 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:20.066834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg" event={"ID":"768c6065-5e7b-4435-bacc-e38e80a33219","Type":"ContainerStarted","Data":"a4f08447964c328ffa5defde8dd635aff49674e0fc06d34c089b142defde96c3"}
Sep 16 13:51:20.067360 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:20.067020    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:20.068585 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:20.068560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s" event={"ID":"da85ece8-18fc-4e38-8a10-7432c05bbbca","Type":"ContainerStarted","Data":"b1a88d025eba8eee4c9498f6a23455a83c96e3a70a574dbe9058a5094842256d"}
Sep 16 13:51:20.068698 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:20.068596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s" event={"ID":"da85ece8-18fc-4e38-8a10-7432c05bbbca","Type":"ContainerStarted","Data":"ffe2acefd5236f4bb36af41dfe4e3145a883142afc6c921c28fe5de5eadf7a75"}
Sep 16 13:51:20.068698 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:20.068652    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:20.085333 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:20.085268    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg" podStartSLOduration=2.239323948 podStartE2EDuration="3.085253223s" totalImagesPullingTime="845.929275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:51:20.082637593 +0000 UTC m=+1089.329515419" watchObservedRunningTime="2026-09-16 13:51:20.085253223 +0000 UTC m=+1089.332131053"
Sep 16 13:51:20.098516 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:20.098466    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s" podStartSLOduration=2.098453204 podStartE2EDuration="2.098453204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:51:20.097365912 +0000 UTC m=+1089.344243738" watchObservedRunningTime="2026-09-16 13:51:20.098453204 +0000 UTC m=+1089.345331029"
Sep 16 13:51:26.079231 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:26.079202    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:51:31.076574 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:31.076546    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:51:43.215991 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:43.215956    2563 generic.go:356] "Generic (PLEG): container finished" podID="90cc2539-6199-4d42-93ed-d580eeb72236" containerID="8e0feb510cc121b9e6187fb987e23c0028b5386f661578f11fc2cbe4c6cd2015" exitCode=0
Sep 16 13:51:43.218494 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:43.218467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" event={"ID":"90cc2539-6199-4d42-93ed-d580eeb72236","Type":"ContainerDied","Data":"8e0feb510cc121b9e6187fb987e23c0028b5386f661578f11fc2cbe4c6cd2015"}
Sep 16 13:51:43.218909 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:43.218894    2563 scope.go:117] "RemoveContainer" containerID="8e0feb510cc121b9e6187fb987e23c0028b5386f661578f11fc2cbe4c6cd2015"
Sep 16 13:51:43.220148 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:43.220124    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:51:43.220216 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:43.220203    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:51:43.220253 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:43.220237    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:51:44.027752 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:44.027711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:44.224863 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:44.224823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" event={"ID":"90cc2539-6199-4d42-93ed-d580eeb72236","Type":"ContainerStarted","Data":"a93c5973bfd92cd938b6d34dbda42fdd35b9e4a488f3d1e6e3f63295d4bf5a2e"}
Sep 16 13:51:44.772438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:44.772401    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:44.773630 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:44.773601    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 13:51:44.773772 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:44.773656    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 13:51:45.562187 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.562157    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"]
Sep 16 13:51:45.566066 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.566038    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.568489 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.568454    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-284b60-serving-cert\""
Sep 16 13:51:45.574320 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.574295    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"]
Sep 16 13:51:45.669390 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.669338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9t9h\" (UniqueName: \"kubernetes.io/projected/9b97e72e-3139-4adb-bac6-6861167bf197-kube-api-access-j9t9h\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.669575 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.669434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.669575 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.669509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.669667 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.669570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b97e72e-3139-4adb-bac6-6861167bf197-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.770574 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.770535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.770760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.770608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b97e72e-3139-4adb-bac6-6861167bf197-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.770760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.770672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9t9h\" (UniqueName: \"kubernetes.io/projected/9b97e72e-3139-4adb-bac6-6861167bf197-kube-api-access-j9t9h\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.770760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.770698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.771478 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.771416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b97e72e-3139-4adb-bac6-6861167bf197-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.772399 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.772358    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 13:51:45.772496 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.772420    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 13:51:45.773541 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.773522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.773834 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.773818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.785159 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.785100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9t9h\" (UniqueName: \"kubernetes.io/projected/9b97e72e-3139-4adb-bac6-6861167bf197-kube-api-access-j9t9h\") pod \"maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:45.919303 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:45.919263    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:46.215843 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.215746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"]
Sep 16 13:51:46.221251 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:51:46.221220    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b97e72e_3139_4adb_bac6_6861167bf197.slice/crio-7f82ee63a52d25fa7cab56bffe8b19ef666fe011878fdac2f5cb84ddd7a347b1 WatchSource:0}: Error finding container 7f82ee63a52d25fa7cab56bffe8b19ef666fe011878fdac2f5cb84ddd7a347b1: Status 404 returned error can't find the container with id 7f82ee63a52d25fa7cab56bffe8b19ef666fe011878fdac2f5cb84ddd7a347b1
Sep 16 13:51:46.238741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.238710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg" event={"ID":"9b97e72e-3139-4adb-bac6-6861167bf197","Type":"ContainerStarted","Data":"7f82ee63a52d25fa7cab56bffe8b19ef666fe011878fdac2f5cb84ddd7a347b1"}
Sep 16 13:51:46.508452 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.504878    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"]
Sep 16 13:51:46.508452 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.505122    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v" podUID="2a9f3598-3a65-40d4-b2ed-e9c39dccd391" containerName="payload-processing" containerID="cri-o://1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a" gracePeriod=30
Sep 16 13:51:46.772320 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.772235    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 13:51:46.772320 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.772288    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 13:51:46.820159 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.820123    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:51:46.906115 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.903726    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-plugins-config-volume\") pod \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\" (UID: \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\") "
Sep 16 13:51:46.906115 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.903851    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb8tc\" (UniqueName: \"kubernetes.io/projected/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-kube-api-access-pb8tc\") pod \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\" (UID: \"2a9f3598-3a65-40d4-b2ed-e9c39dccd391\") "
Sep 16 13:51:46.906763 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.906730    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2a9f3598-3a65-40d4-b2ed-e9c39dccd391" (UID: "2a9f3598-3a65-40d4-b2ed-e9c39dccd391"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:51:46.924908 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:46.924856    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-kube-api-access-pb8tc" (OuterVolumeSpecName: "kube-api-access-pb8tc") pod "2a9f3598-3a65-40d4-b2ed-e9c39dccd391" (UID: "2a9f3598-3a65-40d4-b2ed-e9c39dccd391"). InnerVolumeSpecName "kube-api-access-pb8tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:51:47.005965 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.005930    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-plugins-config-volume\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:47.005965 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.005960    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb8tc\" (UniqueName: \"kubernetes.io/projected/2a9f3598-3a65-40d4-b2ed-e9c39dccd391-kube-api-access-pb8tc\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:47.246809 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.246771    2563 generic.go:356] "Generic (PLEG): container finished" podID="2a9f3598-3a65-40d4-b2ed-e9c39dccd391" containerID="1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a" exitCode=0
Sep 16 13:51:47.246990 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.246838    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"
Sep 16 13:51:47.247074 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.246996    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v" event={"ID":"2a9f3598-3a65-40d4-b2ed-e9c39dccd391","Type":"ContainerDied","Data":"1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a"}
Sep 16 13:51:47.247074 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.247056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v" event={"ID":"2a9f3598-3a65-40d4-b2ed-e9c39dccd391","Type":"ContainerDied","Data":"5deeb75a58ffdfe8ad04185936a705245d61b09d4930b848ba5241b88173cdf7"}
Sep 16 13:51:47.247229 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.247084    2563 scope.go:117] "RemoveContainer" containerID="1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a"
Sep 16 13:51:47.250241 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.250211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg" event={"ID":"9b97e72e-3139-4adb-bac6-6861167bf197","Type":"ContainerStarted","Data":"e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330"}
Sep 16 13:51:47.250414 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.250398    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:47.259014 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.258980    2563 scope.go:117] "RemoveContainer" containerID="1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a"
Sep 16 13:51:47.259362 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:51:47.259335    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a\": container with ID starting with 1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a not found: ID does not exist" containerID="1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a"
Sep 16 13:51:47.259456 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.259397    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a"} err="failed to get container status \"1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a\": rpc error: code = NotFound desc = could not find container \"1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a\": container with ID starting with 1d920181b3053099cd87d64e3dbbd785ce2273cff274ef35db17c0cb439db27a not found: ID does not exist"
Sep 16 13:51:47.265076 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.265045    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"]
Sep 16 13:51:47.268463 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.268438    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-401a67-d88b56699-7fw2v"]
Sep 16 13:51:47.283848 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.283782    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg" podStartSLOduration=1.959182195 podStartE2EDuration="2.283760063s" totalImagesPullingTime="324.577868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:51:47.279689748 +0000 UTC m=+1116.526567575" watchObservedRunningTime="2026-09-16 13:51:47.283760063 +0000 UTC m=+1116.530637891"
Sep 16 13:51:47.772354 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.772311    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 13:51:47.772861 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:47.772396    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 13:51:48.772317 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:48.772280    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 13:51:48.772527 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:48.772333    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 13:51:48.966920 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:48.966881    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"]
Sep 16 13:51:48.967423 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:48.967304    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy" containerID="cri-o://f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b" gracePeriod=30
Sep 16 13:51:49.223888 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.223838    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a9f3598-3a65-40d4-b2ed-e9c39dccd391" path="/var/lib/kubelet/pods/2a9f3598-3a65-40d4-b2ed-e9c39dccd391/volumes"
Sep 16 13:51:49.754926 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.754893    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"]
Sep 16 13:51:49.755652 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.755629    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9f3598-3a65-40d4-b2ed-e9c39dccd391" containerName="payload-processing"
Sep 16 13:51:49.755652 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.755653    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9f3598-3a65-40d4-b2ed-e9c39dccd391" containerName="payload-processing"
Sep 16 13:51:49.755800 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.755789    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a9f3598-3a65-40d4-b2ed-e9c39dccd391" containerName="payload-processing"
Sep 16 13:51:49.761027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.761001    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:49.764074 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.764053    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-dffccf-openshift-default-dockercfg-5zcjg\""
Sep 16 13:51:49.776339 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.776314    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:49.776796 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.776742    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:49.777698 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.777677    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:51:49.783420 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.783357    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"]
Sep 16 13:51:49.939192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.939159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-envoy\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:49.939361 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.939222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffl9d\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-kube-api-access-ffl9d\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:49.939361 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.939275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-credential-socket\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:49.939491 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.939464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b2243f-7028-4784-90b9-6ee9d6220680-istiod-ca-cert\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:49.939594 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.939573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-socket\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:49.939693 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.939612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-data\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:49.939693 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.939631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-certs\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:49.939693 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.939648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b2243f-7028-4784-90b9-6ee9d6220680-istio-podinfo\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:49.939693 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:49.939674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-istio-token\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.042637 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.042534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-socket\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.043312 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-data\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.043500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-certs\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.043500 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-socket\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.043708 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-data\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.043708 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043697    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-certs\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.043708 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b2243f-7028-4784-90b9-6ee9d6220680-istio-podinfo\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.043898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-istio-token\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.043898 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-envoy\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.044003 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffl9d\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-kube-api-access-ffl9d\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.044003 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.043942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-credential-socket\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.044123 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.044022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b2243f-7028-4784-90b9-6ee9d6220680-istiod-ca-cert\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.044732 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.044706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b2243f-7028-4784-90b9-6ee9d6220680-istiod-ca-cert\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.044943 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.044919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-credential-socket\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.046493 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.046468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-envoy\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.046698 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.046681    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b2243f-7028-4784-90b9-6ee9d6220680-istio-podinfo\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.052096 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.052068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-istio-token\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.052278 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.052261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffl9d\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-kube-api-access-ffl9d\") pod \"e2e-noten-dffccf-openshift-default-958f899b8-rzz7r\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") " pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.072333 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.072309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:50.354862 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.354835    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"]
Sep 16 13:51:50.357098 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:51:50.357075    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b2243f_7028_4784_90b9_6ee9d6220680.slice/crio-c3f6a6c918ad0b13c6bcbdc527d31dd2a050d17f00eba0ee7f1c5f85f8d3c2c1 WatchSource:0}: Error finding container c3f6a6c918ad0b13c6bcbdc527d31dd2a050d17f00eba0ee7f1c5f85f8d3c2c1: Status 404 returned error can't find the container with id c3f6a6c918ad0b13c6bcbdc527d31dd2a050d17f00eba0ee7f1c5f85f8d3c2c1
Sep 16 13:51:50.359455 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.359423    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:51:50.359538 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.359492    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:51:50.359577 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:50.359545    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:51:51.276992 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:51.276949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r" event={"ID":"95b2243f-7028-4784-90b9-6ee9d6220680","Type":"ContainerStarted","Data":"8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0"}
Sep 16 13:51:51.277491 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:51.277006    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r" event={"ID":"95b2243f-7028-4784-90b9-6ee9d6220680","Type":"ContainerStarted","Data":"c3f6a6c918ad0b13c6bcbdc527d31dd2a050d17f00eba0ee7f1c5f85f8d3c2c1"}
Sep 16 13:51:51.297601 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:51.297549    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r" podStartSLOduration=2.297533403 podStartE2EDuration="2.297533403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:51:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:51:51.29551076 +0000 UTC m=+1120.542388621" watchObservedRunningTime="2026-09-16 13:51:51.297533403 +0000 UTC m=+1120.544411228"
Sep 16 13:51:52.072531 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:52.072493    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:52.077827 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:52.077801    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:52.284604 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:52.284571    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:52.285489 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:52.285469    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:51:53.194781 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:53.194750    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"]
Sep 16 13:51:53.194994 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:53.194957    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy" containerID="cri-o://190cb0f1659a865c289fa51f5375da48ec1aaace64fe33d3ff1e3d0c9a97de4d" gracePeriod=30
Sep 16 13:51:53.262843 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:53.262819    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:51:54.232753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.232682    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:51:54.291638 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.291585    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-certs\") pod \"4e355cef-0ad1-48de-9eca-f73702e7a048\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") "
Sep 16 13:51:54.291853 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.291649    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-token\") pod \"4e355cef-0ad1-48de-9eca-f73702e7a048\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") "
Sep 16 13:51:54.291853 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.291676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e355cef-0ad1-48de-9eca-f73702e7a048-istiod-ca-cert\") pod \"4e355cef-0ad1-48de-9eca-f73702e7a048\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") "
Sep 16 13:51:54.291853 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.291770    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pblvp\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-kube-api-access-pblvp\") pod \"4e355cef-0ad1-48de-9eca-f73702e7a048\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") "
Sep 16 13:51:54.291853 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.291824    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-data\") pod \"4e355cef-0ad1-48de-9eca-f73702e7a048\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") "
Sep 16 13:51:54.292135 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.291879    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-credential-socket\") pod \"4e355cef-0ad1-48de-9eca-f73702e7a048\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") "
Sep 16 13:51:54.292135 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.291907    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-envoy\") pod \"4e355cef-0ad1-48de-9eca-f73702e7a048\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") "
Sep 16 13:51:54.292135 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.291930    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-podinfo\") pod \"4e355cef-0ad1-48de-9eca-f73702e7a048\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") "
Sep 16 13:51:54.292135 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.292001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-socket\") pod \"4e355cef-0ad1-48de-9eca-f73702e7a048\" (UID: \"4e355cef-0ad1-48de-9eca-f73702e7a048\") "
Sep 16 13:51:54.292355 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.292162    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e355cef-0ad1-48de-9eca-f73702e7a048" (UID: "4e355cef-0ad1-48de-9eca-f73702e7a048"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:54.292355 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.292214    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e355cef-0ad1-48de-9eca-f73702e7a048-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e355cef-0ad1-48de-9eca-f73702e7a048" (UID: "4e355cef-0ad1-48de-9eca-f73702e7a048"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:51:54.292517 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.292435    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e355cef-0ad1-48de-9eca-f73702e7a048" (UID: "4e355cef-0ad1-48de-9eca-f73702e7a048"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:54.292517 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.292480    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e355cef-0ad1-48de-9eca-f73702e7a048" (UID: "4e355cef-0ad1-48de-9eca-f73702e7a048"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:54.292628 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.292603    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:54.292685 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.292625    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:54.292685 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.292639    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:54.292685 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.292653    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e355cef-0ad1-48de-9eca-f73702e7a048-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:54.294727 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.294700    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e355cef-0ad1-48de-9eca-f73702e7a048" (UID: "4e355cef-0ad1-48de-9eca-f73702e7a048"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:54.295004 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.294982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e355cef-0ad1-48de-9eca-f73702e7a048" (UID: "4e355cef-0ad1-48de-9eca-f73702e7a048"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:51:54.295337 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.295310    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-kube-api-access-pblvp" (OuterVolumeSpecName: "kube-api-access-pblvp") pod "4e355cef-0ad1-48de-9eca-f73702e7a048" (UID: "4e355cef-0ad1-48de-9eca-f73702e7a048"). InnerVolumeSpecName "kube-api-access-pblvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:51:54.295464 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.295391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e355cef-0ad1-48de-9eca-f73702e7a048" (UID: "4e355cef-0ad1-48de-9eca-f73702e7a048"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:51:54.295637 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.295606    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e355cef-0ad1-48de-9eca-f73702e7a048" (UID: "4e355cef-0ad1-48de-9eca-f73702e7a048"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:54.302358 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.302332    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerID="f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b" exitCode=0
Sep 16 13:51:54.302478 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.302410    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"
Sep 16 13:51:54.302478 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.302410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" event={"ID":"4e355cef-0ad1-48de-9eca-f73702e7a048","Type":"ContainerDied","Data":"f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b"}
Sep 16 13:51:54.302563 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.302514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v" event={"ID":"4e355cef-0ad1-48de-9eca-f73702e7a048","Type":"ContainerDied","Data":"cdcbdc5daead47e59b5c0eee9c592843c3d983b02b9c4f635c28ddc3c21707a0"}
Sep 16 13:51:54.302563 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.302546    2563 scope.go:117] "RemoveContainer" containerID="f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b"
Sep 16 13:51:54.318824 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.318803    2563 scope.go:117] "RemoveContainer" containerID="f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533"
Sep 16 13:51:54.328313 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.328296    2563 scope.go:117] "RemoveContainer" containerID="f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b"
Sep 16 13:51:54.328697 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:51:54.328670    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b\": container with ID starting with f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b not found: ID does not exist" containerID="f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b"
Sep 16 13:51:54.328786 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.328708    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b"} err="failed to get container status \"f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b\": rpc error: code = NotFound desc = could not find container \"f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b\": container with ID starting with f38e661d4d77c8c0502049e12525a521a14e29dd06d8efa19e3f6c2ab1797c4b not found: ID does not exist"
Sep 16 13:51:54.328786 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.328733    2563 scope.go:117] "RemoveContainer" containerID="f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533"
Sep 16 13:51:54.329006 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:51:54.328992    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533\": container with ID starting with f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533 not found: ID does not exist" containerID="f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533"
Sep 16 13:51:54.329051 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.329010    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533"} err="failed to get container status \"f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533\": rpc error: code = NotFound desc = could not find container \"f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533\": container with ID starting with f91e3ebab60118445ea816f2333b94b04e4ffc42c01caf23cf6df1de4d227533 not found: ID does not exist"
Sep 16 13:51:54.330047 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.330028    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"]
Sep 16 13:51:54.335296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.335271    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-101425-openshift-default-569fcb69d8-kzp6v"]
Sep 16 13:51:54.393808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.393779    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:54.393808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.393802    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:54.393808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.393811    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e355cef-0ad1-48de-9eca-f73702e7a048-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:54.393808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.393818    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:54.394107 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:54.393826    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pblvp\" (UniqueName: \"kubernetes.io/projected/4e355cef-0ad1-48de-9eca-f73702e7a048-kube-api-access-pblvp\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:55.218517 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:55.218485    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" path="/var/lib/kubelet/pods/4e355cef-0ad1-48de-9eca-f73702e7a048/volumes"
Sep 16 13:51:58.330119 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.330082    2563 generic.go:356] "Generic (PLEG): container finished" podID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerID="190cb0f1659a865c289fa51f5375da48ec1aaace64fe33d3ff1e3d0c9a97de4d" exitCode=0
Sep 16 13:51:58.330544 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.330164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" event={"ID":"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c","Type":"ContainerDied","Data":"190cb0f1659a865c289fa51f5375da48ec1aaace64fe33d3ff1e3d0c9a97de4d"}
Sep 16 13:51:58.330544 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.330226    2563 scope.go:117] "RemoveContainer" containerID="8518828058a65b7cc898ec52c9c1bebf8d90f032fd327f8ba2c8ec0c754ddad7"
Sep 16 13:51:58.448150 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.448123    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:51:58.539710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.539624    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-envoy\") pod \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") "
Sep 16 13:51:58.539710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.539658    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-credential-socket\") pod \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") "
Sep 16 13:51:58.539710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.539693    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-token\") pod \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") "
Sep 16 13:51:58.539993 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.539717    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-data\") pod \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") "
Sep 16 13:51:58.539993 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.539747    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8klv9\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-kube-api-access-8klv9\") pod \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") "
Sep 16 13:51:58.539993 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.539774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-socket\") pod \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") "
Sep 16 13:51:58.540158 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.539997    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-certs\") pod \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") "
Sep 16 13:51:58.540158 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540027    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" (UID: "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:58.540158 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540109    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-podinfo\") pod \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") "
Sep 16 13:51:58.540158 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540110    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" (UID: "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:58.540158 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540153    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istiod-ca-cert\") pod \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\" (UID: \"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c\") "
Sep 16 13:51:58.540462 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540175    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" (UID: "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:58.540711 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" (UID: "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:58.540711 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540603    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" (UID: "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:51:58.540711 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540702    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:58.540907 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540719    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:58.540907 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540745    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:58.540907 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540758    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:58.540907 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.540771    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:58.542687 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.542665    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" (UID: "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:51:58.542781 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.542727    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" (UID: "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:51:58.542848 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.542834    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" (UID: "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:51:58.542887 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.542850    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-kube-api-access-8klv9" (OuterVolumeSpecName: "kube-api-access-8klv9") pod "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" (UID: "3a8e0b1e-c90a-4a4b-b0c4-097326055f0c"). InnerVolumeSpecName "kube-api-access-8klv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:51:58.641793 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.641759    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:58.641793 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.641788    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:58.641975 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.641800    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8klv9\" (UniqueName: \"kubernetes.io/projected/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-kube-api-access-8klv9\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:58.641975 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:58.641814    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:51:59.337356 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:59.337320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq" event={"ID":"3a8e0b1e-c90a-4a4b-b0c4-097326055f0c","Type":"ContainerDied","Data":"f733b7f363d9e0ef511dea7bfa2cc83847f7d396b8e30269a9ca89ea7657ba08"}
Sep 16 13:51:59.337356 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:59.337352    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"
Sep 16 13:51:59.337923 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:59.337401    2563 scope.go:117] "RemoveContainer" containerID="190cb0f1659a865c289fa51f5375da48ec1aaace64fe33d3ff1e3d0c9a97de4d"
Sep 16 13:51:59.353705 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:59.353681    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"]
Sep 16 13:51:59.368206 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:51:59.368173    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-401a67-openshift-default-57fd984fb8-b6htq"]
Sep 16 13:52:01.217492 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:01.217455    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" path="/var/lib/kubelet/pods/3a8e0b1e-c90a-4a4b-b0c4-097326055f0c/volumes"
Sep 16 13:52:10.904785 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:10.904753    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"]
Sep 16 13:52:10.905353 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:10.904991    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy" containerID="cri-o://4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16" gracePeriod=30
Sep 16 13:52:11.257740 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.257675    2563 scope.go:117] "RemoveContainer" containerID="f26197cdba837bd5f67c873afa66a12ebd4a22da4a8b018f27369f135072526d"
Sep 16 13:52:11.781177 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781138    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"]
Sep 16 13:52:11.781664 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781649    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy"
Sep 16 13:52:11.781664 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781664    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy"
Sep 16 13:52:11.781808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781678    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy"
Sep 16 13:52:11.781808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781684    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy"
Sep 16 13:52:11.781808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781691    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy"
Sep 16 13:52:11.781808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781699    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy"
Sep 16 13:52:11.781808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781723    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy"
Sep 16 13:52:11.781808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781730    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy"
Sep 16 13:52:11.781808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781794    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy"
Sep 16 13:52:11.781808 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781806    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy"
Sep 16 13:52:11.782224 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.781814    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a8e0b1e-c90a-4a4b-b0c4-097326055f0c" containerName="istio-proxy"
Sep 16 13:52:11.798710 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.798675    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.802015 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.801910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-2284bd-openshift-default-dockercfg-ntx97\""
Sep 16 13:52:11.802615 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.802584    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"]
Sep 16 13:52:11.877390 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.877324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-token\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.877584 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.877414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6mm5\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-kube-api-access-r6mm5\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.877584 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.877442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-podinfo\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.877584 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.877532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-envoy\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.877584 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.877572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-data\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.877732 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.877627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-certs\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.877732 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.877718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istiod-ca-cert\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.877802 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.877758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-socket\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.877850 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.877835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-credential-socket\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.979608 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.979569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istiod-ca-cert\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.980199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.980177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-socket\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.980696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.980674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-credential-socket\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.980793 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.980780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-token\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.980864 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.980854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6mm5\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-kube-api-access-r6mm5\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.980917 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.980885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-podinfo\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.980976 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.980949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-envoy\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.981031 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.980973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-data\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.981031 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.981019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-certs\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.981341 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.981314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-certs\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.981805 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.980596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-socket\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.981937 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.980481    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istiod-ca-cert\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.982323 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.982304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-data\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.982861 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.982809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-credential-socket\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.985086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.985065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-envoy\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.985725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.985691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-podinfo\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.992751 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.992719    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-token\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:11.993455 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:11.993364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6mm5\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-kube-api-access-r6mm5\") pod \"e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") " pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:12.112220 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:12.112109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:12.390639 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:12.390612    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"]
Sep 16 13:52:12.393020 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:52:12.392988    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0c5c5e_e938_46e4_ba0a_4bfb6baa0f9a.slice/crio-6b6869d2fc931be62fba8e71715fa047e01c2a72e9fc46e488456967b986246f WatchSource:0}: Error finding container 6b6869d2fc931be62fba8e71715fa047e01c2a72e9fc46e488456967b986246f: Status 404 returned error can't find the container with id 6b6869d2fc931be62fba8e71715fa047e01c2a72e9fc46e488456967b986246f
Sep 16 13:52:12.395483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:12.395453    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:52:12.395571 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:12.395520    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:52:12.395571 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:12.395546    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:52:12.423547 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:12.423519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" event={"ID":"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a","Type":"ContainerStarted","Data":"6b6869d2fc931be62fba8e71715fa047e01c2a72e9fc46e488456967b986246f"}
Sep 16 13:52:13.430109 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:13.430067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" event={"ID":"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a","Type":"ContainerStarted","Data":"a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260"}
Sep 16 13:52:13.449460 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:13.449404    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" podStartSLOduration=2.449365337 podStartE2EDuration="2.449365337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:52:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:52:13.448349723 +0000 UTC m=+1142.695227547" watchObservedRunningTime="2026-09-16 13:52:13.449365337 +0000 UTC m=+1142.696243163"
Sep 16 13:52:14.112707 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:14.112670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:14.117783 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:14.117757    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:14.435805 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:14.435776    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:14.436712 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:14.436689    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:15.647305 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:15.647270    2563 patch_prober.go:28] interesting pod/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 13:52:15.647708 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:15.647325    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:52:16.163512 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.163488    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:52:16.327590 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327494    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-data\") pod \"e3d934f3-cf87-4818-9497-cf8a24adc223\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") "
Sep 16 13:52:16.327590 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-token\") pod \"e3d934f3-cf87-4818-9497-cf8a24adc223\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") "
Sep 16 13:52:16.327590 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327587    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-socket\") pod \"e3d934f3-cf87-4818-9497-cf8a24adc223\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") "
Sep 16 13:52:16.327890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327614    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3d934f3-cf87-4818-9497-cf8a24adc223-istiod-ca-cert\") pod \"e3d934f3-cf87-4818-9497-cf8a24adc223\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") "
Sep 16 13:52:16.327890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327641    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-podinfo\") pod \"e3d934f3-cf87-4818-9497-cf8a24adc223\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") "
Sep 16 13:52:16.327890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327713    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlztw\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-kube-api-access-jlztw\") pod \"e3d934f3-cf87-4818-9497-cf8a24adc223\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") "
Sep 16 13:52:16.327890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327743    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-data" (OuterVolumeSpecName: "istio-data") pod "e3d934f3-cf87-4818-9497-cf8a24adc223" (UID: "e3d934f3-cf87-4818-9497-cf8a24adc223"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:52:16.327890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327748    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-envoy\") pod \"e3d934f3-cf87-4818-9497-cf8a24adc223\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") "
Sep 16 13:52:16.327890 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327821    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-credential-socket\") pod \"e3d934f3-cf87-4818-9497-cf8a24adc223\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") "
Sep 16 13:52:16.328198 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327901    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-certs\") pod \"e3d934f3-cf87-4818-9497-cf8a24adc223\" (UID: \"e3d934f3-cf87-4818-9497-cf8a24adc223\") "
Sep 16 13:52:16.328198 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.327935    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e3d934f3-cf87-4818-9497-cf8a24adc223" (UID: "e3d934f3-cf87-4818-9497-cf8a24adc223"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:52:16.328198 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.328038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d934f3-cf87-4818-9497-cf8a24adc223-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e3d934f3-cf87-4818-9497-cf8a24adc223" (UID: "e3d934f3-cf87-4818-9497-cf8a24adc223"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:52:16.328198 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.328165    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e3d934f3-cf87-4818-9497-cf8a24adc223" (UID: "e3d934f3-cf87-4818-9497-cf8a24adc223"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:52:16.328435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.328313    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e3d934f3-cf87-4818-9497-cf8a24adc223" (UID: "e3d934f3-cf87-4818-9497-cf8a24adc223"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:52:16.328435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.328432    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:52:16.328435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.328452    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3d934f3-cf87-4818-9497-cf8a24adc223-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:52:16.328435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.328466    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:52:16.328435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.328481    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:52:16.328435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.328494    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:52:16.330201 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.330172    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e3d934f3-cf87-4818-9497-cf8a24adc223" (UID: "e3d934f3-cf87-4818-9497-cf8a24adc223"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:52:16.330201 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.330194    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-kube-api-access-jlztw" (OuterVolumeSpecName: "kube-api-access-jlztw") pod "e3d934f3-cf87-4818-9497-cf8a24adc223" (UID: "e3d934f3-cf87-4818-9497-cf8a24adc223"). InnerVolumeSpecName "kube-api-access-jlztw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:52:16.330477 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.330460    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e3d934f3-cf87-4818-9497-cf8a24adc223" (UID: "e3d934f3-cf87-4818-9497-cf8a24adc223"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:52:16.330535 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.330508    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-token" (OuterVolumeSpecName: "istio-token") pod "e3d934f3-cf87-4818-9497-cf8a24adc223" (UID: "e3d934f3-cf87-4818-9497-cf8a24adc223"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:52:16.429851 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.429818    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlztw\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-kube-api-access-jlztw\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:52:16.429851 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.429848    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:52:16.429851 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.429858    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:52:16.430092 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.429869    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3d934f3-cf87-4818-9497-cf8a24adc223-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:52:16.446943 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.446915    2563 generic.go:356] "Generic (PLEG): container finished" podID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerID="4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16" exitCode=0
Sep 16 13:52:16.447110 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.446978    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"
Sep 16 13:52:16.447110 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.446997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" event={"ID":"e3d934f3-cf87-4818-9497-cf8a24adc223","Type":"ContainerDied","Data":"4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16"}
Sep 16 13:52:16.447110 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.447049    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9" event={"ID":"e3d934f3-cf87-4818-9497-cf8a24adc223","Type":"ContainerDied","Data":"8586ba741d717b92587ea58a7caef4b2d1515dd468a2cc793b92df2d07fc9e36"}
Sep 16 13:52:16.447110 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.447070    2563 scope.go:117] "RemoveContainer" containerID="4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16"
Sep 16 13:52:16.457465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.457447    2563 scope.go:117] "RemoveContainer" containerID="c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982"
Sep 16 13:52:16.466956 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.466939    2563 scope.go:117] "RemoveContainer" containerID="4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16"
Sep 16 13:52:16.467243 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:52:16.467223    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16\": container with ID starting with 4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16 not found: ID does not exist" containerID="4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16"
Sep 16 13:52:16.467291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.467253    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16"} err="failed to get container status \"4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16\": rpc error: code = NotFound desc = could not find container \"4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16\": container with ID starting with 4bdeb07678097e95cf55ea96981768afe9fd54aaff1b5cf45b39a8e4b2da1b16 not found: ID does not exist"
Sep 16 13:52:16.467291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.467270    2563 scope.go:117] "RemoveContainer" containerID="c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982"
Sep 16 13:52:16.467548 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:52:16.467530    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982\": container with ID starting with c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982 not found: ID does not exist" containerID="c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982"
Sep 16 13:52:16.467600 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.467554    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982"} err="failed to get container status \"c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982\": rpc error: code = NotFound desc = could not find container \"c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982\": container with ID starting with c0b6f18dd649ac295d858fe3e01f5acb8139c765d5705a8a75233d8be9815982 not found: ID does not exist"
Sep 16 13:52:16.471099 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.471073    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"]
Sep 16 13:52:16.478609 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:16.478583    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6c7792-openshift-default-858f4b58b4-dvzx9"]
Sep 16 13:52:17.217773 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:17.217737    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" path="/var/lib/kubelet/pods/e3d934f3-cf87-4818-9497-cf8a24adc223/volumes"
Sep 16 13:52:18.757442 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.757404    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"]
Sep 16 13:52:18.757955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.757932    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy"
Sep 16 13:52:18.758104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.758034    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy"
Sep 16 13:52:18.758104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.758086    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy"
Sep 16 13:52:18.758104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.758096    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy"
Sep 16 13:52:18.758274 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.758256    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy"
Sep 16 13:52:18.758274 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.758273    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d934f3-cf87-4818-9497-cf8a24adc223" containerName="istio-proxy"
Sep 16 13:52:18.758399 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.758283    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e355cef-0ad1-48de-9eca-f73702e7a048" containerName="istio-proxy"
Sep 16 13:52:18.763246 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.763223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:18.765605 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.765584    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-2284bd-serving-cert\""
Sep 16 13:52:18.772244 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.772219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"]
Sep 16 13:52:18.955562 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.955530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:18.955731 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.955572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ece990f3-8022-43ab-97c9-89615145eaa8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:18.955731 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.955628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-525lq\" (UniqueName: \"kubernetes.io/projected/ece990f3-8022-43ab-97c9-89615145eaa8-kube-api-access-525lq\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:18.955731 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:18.955679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.056596 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.056496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.056596 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.056543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ece990f3-8022-43ab-97c9-89615145eaa8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.056596 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.056592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-525lq\" (UniqueName: \"kubernetes.io/projected/ece990f3-8022-43ab-97c9-89615145eaa8-kube-api-access-525lq\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.056828 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.056626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.057414 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.057300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ece990f3-8022-43ab-97c9-89615145eaa8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.059327 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.059302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.059450 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.059340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.064803 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.064777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-525lq\" (UniqueName: \"kubernetes.io/projected/ece990f3-8022-43ab-97c9-89615145eaa8-kube-api-access-525lq\") pod \"maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.076706 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.076660    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:19.362907 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.362882    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"]
Sep 16 13:52:19.364979 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:52:19.364941    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece990f3_8022_43ab_97c9_89615145eaa8.slice/crio-be9ccb489e3a6be834111fae61c6f4f0e282da42f2909ae467a6f90b6427b951 WatchSource:0}: Error finding container be9ccb489e3a6be834111fae61c6f4f0e282da42f2909ae467a6f90b6427b951: Status 404 returned error can't find the container with id be9ccb489e3a6be834111fae61c6f4f0e282da42f2909ae467a6f90b6427b951
Sep 16 13:52:19.467742 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:19.467673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt" event={"ID":"ece990f3-8022-43ab-97c9-89615145eaa8","Type":"ContainerStarted","Data":"be9ccb489e3a6be834111fae61c6f4f0e282da42f2909ae467a6f90b6427b951"}
Sep 16 13:52:20.474873 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:20.474840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt" event={"ID":"ece990f3-8022-43ab-97c9-89615145eaa8","Type":"ContainerStarted","Data":"0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153"}
Sep 16 13:52:20.475354 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:20.474901    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:20.491979 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:20.491915    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt" podStartSLOduration=2.115950662 podStartE2EDuration="2.491892597s" totalImagesPullingTime="375.941935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:52:20.491545681 +0000 UTC m=+1149.738423509" watchObservedRunningTime="2026-09-16 13:52:20.491892597 +0000 UTC m=+1149.738770427"
Sep 16 13:52:26.488243 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:26.488214    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 13:52:27.150071 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.150039    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"]
Sep 16 13:52:27.154487 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.154459    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.156791 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.156551    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3be042d3-serving-cert\""
Sep 16 13:52:27.163093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.163070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"]
Sep 16 13:52:27.245019 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.244982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-metrics-certs\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.245183 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.245020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f58ch\" (UniqueName: \"kubernetes.io/projected/44183882-f4d1-4cc7-8757-3dc18fe3280c-kube-api-access-f58ch\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.245183 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.245108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44183882-f4d1-4cc7-8757-3dc18fe3280c-openshift-service-ca\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.245183 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.245148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-maas-api-tls\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.345963 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.345926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44183882-f4d1-4cc7-8757-3dc18fe3280c-openshift-service-ca\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.345963 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.345980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-maas-api-tls\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.346242 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.346058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-metrics-certs\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.346242 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.346080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f58ch\" (UniqueName: \"kubernetes.io/projected/44183882-f4d1-4cc7-8757-3dc18fe3280c-kube-api-access-f58ch\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.346712 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.346691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44183882-f4d1-4cc7-8757-3dc18fe3280c-openshift-service-ca\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.348742 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.348724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-metrics-certs\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.348815 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.348726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-maas-api-tls\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.353738 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.353717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f58ch\" (UniqueName: \"kubernetes.io/projected/44183882-f4d1-4cc7-8757-3dc18fe3280c-kube-api-access-f58ch\") pod \"maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.470144 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.470026    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:27.754464 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.753636    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"]
Sep 16 13:52:27.759488 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.759433    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"]
Sep 16 13:52:27.764877 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.764858    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:27.767163 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.767142    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3be042d3\""
Sep 16 13:52:27.767445 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.767424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3be042d3-dockercfg-6nvn4\""
Sep 16 13:52:27.770618 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.770589    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"]
Sep 16 13:52:27.855139 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.854242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d56tb\" (UniqueName: \"kubernetes.io/projected/93ff0dfc-edd5-4ac1-84fe-39efef75374a-kube-api-access-d56tb\") pod \"payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56\" (UID: \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:27.855139 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.854431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93ff0dfc-edd5-4ac1-84fe-39efef75374a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56\" (UID: \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:27.955361 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.955317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93ff0dfc-edd5-4ac1-84fe-39efef75374a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56\" (UID: \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:27.955600 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.955465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d56tb\" (UniqueName: \"kubernetes.io/projected/93ff0dfc-edd5-4ac1-84fe-39efef75374a-kube-api-access-d56tb\") pod \"payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56\" (UID: \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:27.956031 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.956013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93ff0dfc-edd5-4ac1-84fe-39efef75374a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56\" (UID: \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:27.962880 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:27.962850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d56tb\" (UniqueName: \"kubernetes.io/projected/93ff0dfc-edd5-4ac1-84fe-39efef75374a-kube-api-access-d56tb\") pod \"payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56\" (UID: \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:28.078768 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.078736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:28.365045 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.364956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"]
Sep 16 13:52:28.367854 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:52:28.367826    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ff0dfc_edd5_4ac1_84fe_39efef75374a.slice/crio-f746528d2612651e94b88b8057de332577ff6f4d72d556c9f3afb04b3ca12cb6 WatchSource:0}: Error finding container f746528d2612651e94b88b8057de332577ff6f4d72d556c9f3afb04b3ca12cb6: Status 404 returned error can't find the container with id f746528d2612651e94b88b8057de332577ff6f4d72d556c9f3afb04b3ca12cb6
Sep 16 13:52:28.526842 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.526806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7" event={"ID":"44183882-f4d1-4cc7-8757-3dc18fe3280c","Type":"ContainerStarted","Data":"d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3"}
Sep 16 13:52:28.527011 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.526871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7" event={"ID":"44183882-f4d1-4cc7-8757-3dc18fe3280c","Type":"ContainerStarted","Data":"70ea59606241a0652d7fde8c27e6978d67aad504703eb9f822688e642a9e131f"}
Sep 16 13:52:28.527091 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.527031    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:28.528521 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.528499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56" event={"ID":"93ff0dfc-edd5-4ac1-84fe-39efef75374a","Type":"ContainerStarted","Data":"6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884"}
Sep 16 13:52:28.528643 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.528536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56" event={"ID":"93ff0dfc-edd5-4ac1-84fe-39efef75374a","Type":"ContainerStarted","Data":"f746528d2612651e94b88b8057de332577ff6f4d72d556c9f3afb04b3ca12cb6"}
Sep 16 13:52:28.528643 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.528633    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:28.548019 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.547967    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7" podStartSLOduration=1.266674209 podStartE2EDuration="1.547951828s" totalImagesPullingTime="281.277619ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:52:28.546284975 +0000 UTC m=+1157.793162800" watchObservedRunningTime="2026-09-16 13:52:28.547951828 +0000 UTC m=+1157.794829653"
Sep 16 13:52:28.563223 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:28.563177    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56" podStartSLOduration=1.56316223 podStartE2EDuration="1.56316223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:52:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:52:28.562182804 +0000 UTC m=+1157.809060631" watchObservedRunningTime="2026-09-16 13:52:28.56316223 +0000 UTC m=+1157.810040106"
Sep 16 13:52:34.540531 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:34.540459    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:52:38.664708 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.664678    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"]
Sep 16 13:52:38.668562 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.668542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.671353 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.671333    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-ac8045-serving-cert\""
Sep 16 13:52:38.700849 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.700820    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"]
Sep 16 13:52:38.771676 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.771639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/622c1ac0-0b11-4526-9808-e75c37600c00-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.771893 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.771723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.771893 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.771776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kmhk\" (UniqueName: \"kubernetes.io/projected/622c1ac0-0b11-4526-9808-e75c37600c00-kube-api-access-2kmhk\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.771893 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.771860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.873351 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.873300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kmhk\" (UniqueName: \"kubernetes.io/projected/622c1ac0-0b11-4526-9808-e75c37600c00-kube-api-access-2kmhk\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.873558 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.873388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.873638 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.873621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/622c1ac0-0b11-4526-9808-e75c37600c00-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.873729 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.873696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.875259 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.875231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/622c1ac0-0b11-4526-9808-e75c37600c00-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.878260 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.878236    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.886449 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.886421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kmhk\" (UniqueName: \"kubernetes.io/projected/622c1ac0-0b11-4526-9808-e75c37600c00-kube-api-access-2kmhk\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:38.891401 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:38.888254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:39.008713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:39.008601    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:39.312550 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:39.312516    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"]
Sep 16 13:52:39.312767 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:52:39.312742    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622c1ac0_0b11_4526_9808_e75c37600c00.slice/crio-acf31d386fb84a72c8ccc570d4d60c53d2c5d79c1d86a6703371c583566becb1 WatchSource:0}: Error finding container acf31d386fb84a72c8ccc570d4d60c53d2c5d79c1d86a6703371c583566becb1: Status 404 returned error can't find the container with id acf31d386fb84a72c8ccc570d4d60c53d2c5d79c1d86a6703371c583566becb1
Sep 16 13:52:39.535744 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:39.535707    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:52:39.608136 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:39.608029    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v" event={"ID":"622c1ac0-0b11-4526-9808-e75c37600c00","Type":"ContainerStarted","Data":"acf31d386fb84a72c8ccc570d4d60c53d2c5d79c1d86a6703371c583566becb1"}
Sep 16 13:52:40.615465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:40.615423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v" event={"ID":"622c1ac0-0b11-4526-9808-e75c37600c00","Type":"ContainerStarted","Data":"4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51"}
Sep 16 13:52:40.615858 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:40.615507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:40.634184 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:40.634130    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v" podStartSLOduration=2.312613848 podStartE2EDuration="2.634114845s" totalImagesPullingTime="321.500997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:52:40.631597185 +0000 UTC m=+1169.878475044" watchObservedRunningTime="2026-09-16 13:52:40.634114845 +0000 UTC m=+1169.880992703"
Sep 16 13:52:45.259309 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:45.258110    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:60750->10.134.0.60:15021: read: connection reset by peer" start-of-body=
Sep 16 13:52:45.259309 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:45.258181    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:60750->10.134.0.60:15021: read: connection reset by peer"
Sep 16 13:52:45.645966 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:45.645934    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerID="a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260" exitCode=0
Sep 16 13:52:45.646143 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:45.646016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" event={"ID":"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a","Type":"ContainerDied","Data":"a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260"}
Sep 16 13:52:45.646522 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:45.646505    2563 scope.go:117] "RemoveContainer" containerID="a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260"
Sep 16 13:52:45.649301 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:45.648359    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:52:45.649301 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:45.648546    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:52:45.649301 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:45.648612    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 16 13:52:46.630732 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:46.630689    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 13:52:46.655011 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:46.654979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" event={"ID":"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a","Type":"ContainerStarted","Data":"3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8"}
Sep 16 13:52:47.113176 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:47.113078    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:47.113483 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:47.113463    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:52:47.113553 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:47.113507    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:52:48.113468 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:48.113432    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:52:48.113891 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:48.113497    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:52:49.112769 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:49.112724    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:52:49.113004 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:49.112806    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:52:50.113473 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:50.113437    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:52:50.113946 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:50.113495    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:52:51.112577 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:51.112534    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:52:51.112798 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:51.112599    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:52:52.113028 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:52.112984    2563 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:52:52.113628 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:52.113045    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:52:53.116296 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:53.116261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:53.116749 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:53.116685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:52:53.117359 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:52:53.117341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 13:53:11.207713 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:53:11.207672    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:53:11.210726 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:53:11.210702    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:53:11.289402 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:53:11.289348    2563 scope.go:117] "RemoveContainer" containerID="2ba620ab46980a18092bbc5e3cecfaecc5495c8afaaaddb78d55134621d9ea6d"
Sep 16 13:54:00.572000 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:00.571962    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"]
Sep 16 13:54:00.572486 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:00.572245    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r" podUID="95b2243f-7028-4784-90b9-6ee9d6220680" containerName="istio-proxy" containerID="cri-o://8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0" gracePeriod=30
Sep 16 13:54:05.830563 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.830533    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:54:05.942953 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.942925    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-socket\") pod \"95b2243f-7028-4784-90b9-6ee9d6220680\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") "
Sep 16 13:54:05.943172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.942975    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-data\") pod \"95b2243f-7028-4784-90b9-6ee9d6220680\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") "
Sep 16 13:54:05.943172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943023    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-credential-socket\") pod \"95b2243f-7028-4784-90b9-6ee9d6220680\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") "
Sep 16 13:54:05.943172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943079    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b2243f-7028-4784-90b9-6ee9d6220680-istiod-ca-cert\") pod \"95b2243f-7028-4784-90b9-6ee9d6220680\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") "
Sep 16 13:54:05.943172 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943124    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-istio-token\") pod \"95b2243f-7028-4784-90b9-6ee9d6220680\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") "
Sep 16 13:54:05.943424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943200    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-envoy\") pod \"95b2243f-7028-4784-90b9-6ee9d6220680\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") "
Sep 16 13:54:05.943424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943243    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95b2243f-7028-4784-90b9-6ee9d6220680" (UID: "95b2243f-7028-4784-90b9-6ee9d6220680"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:54:05.943424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-data" (OuterVolumeSpecName: "istio-data") pod "95b2243f-7028-4784-90b9-6ee9d6220680" (UID: "95b2243f-7028-4784-90b9-6ee9d6220680"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:54:05.943424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943276    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-certs\") pod \"95b2243f-7028-4784-90b9-6ee9d6220680\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") "
Sep 16 13:54:05.943424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943360    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95b2243f-7028-4784-90b9-6ee9d6220680" (UID: "95b2243f-7028-4784-90b9-6ee9d6220680"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:54:05.943424 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943400    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b2243f-7028-4784-90b9-6ee9d6220680-istio-podinfo\") pod \"95b2243f-7028-4784-90b9-6ee9d6220680\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") "
Sep 16 13:54:05.943737 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943469    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffl9d\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-kube-api-access-ffl9d\") pod \"95b2243f-7028-4784-90b9-6ee9d6220680\" (UID: \"95b2243f-7028-4784-90b9-6ee9d6220680\") "
Sep 16 13:54:05.943737 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943537    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95b2243f-7028-4784-90b9-6ee9d6220680" (UID: "95b2243f-7028-4784-90b9-6ee9d6220680"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:54:05.943737 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.943606    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b2243f-7028-4784-90b9-6ee9d6220680-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95b2243f-7028-4784-90b9-6ee9d6220680" (UID: "95b2243f-7028-4784-90b9-6ee9d6220680"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:54:05.944109 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.944024    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:54:05.944167 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.944114    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:54:05.944167 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.944128    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:54:05.944167 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.944144    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:54:05.944167 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.944160    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b2243f-7028-4784-90b9-6ee9d6220680-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:54:05.945673 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.945646    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-kube-api-access-ffl9d" (OuterVolumeSpecName: "kube-api-access-ffl9d") pod "95b2243f-7028-4784-90b9-6ee9d6220680" (UID: "95b2243f-7028-4784-90b9-6ee9d6220680"). InnerVolumeSpecName "kube-api-access-ffl9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:54:05.945784 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.945670    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95b2243f-7028-4784-90b9-6ee9d6220680" (UID: "95b2243f-7028-4784-90b9-6ee9d6220680"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:54:05.945992 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.945967    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-istio-token" (OuterVolumeSpecName: "istio-token") pod "95b2243f-7028-4784-90b9-6ee9d6220680" (UID: "95b2243f-7028-4784-90b9-6ee9d6220680"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:54:05.946093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:05.945995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95b2243f-7028-4784-90b9-6ee9d6220680-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95b2243f-7028-4784-90b9-6ee9d6220680" (UID: "95b2243f-7028-4784-90b9-6ee9d6220680"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:54:06.045174 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.045141    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b2243f-7028-4784-90b9-6ee9d6220680-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:54:06.045174 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.045174    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b2243f-7028-4784-90b9-6ee9d6220680-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:54:06.045454 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.045187    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffl9d\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-kube-api-access-ffl9d\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:54:06.045454 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.045195    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b2243f-7028-4784-90b9-6ee9d6220680-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:54:06.138588 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.138553    2563 generic.go:356] "Generic (PLEG): container finished" podID="95b2243f-7028-4784-90b9-6ee9d6220680" containerID="8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0" exitCode=0
Sep 16 13:54:06.138753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.138603    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"
Sep 16 13:54:06.138753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.138646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r" event={"ID":"95b2243f-7028-4784-90b9-6ee9d6220680","Type":"ContainerDied","Data":"8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0"}
Sep 16 13:54:06.138753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.138706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r" event={"ID":"95b2243f-7028-4784-90b9-6ee9d6220680","Type":"ContainerDied","Data":"c3f6a6c918ad0b13c6bcbdc527d31dd2a050d17f00eba0ee7f1c5f85f8d3c2c1"}
Sep 16 13:54:06.138753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.138736    2563 scope.go:117] "RemoveContainer" containerID="8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0"
Sep 16 13:54:06.149543 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.149525    2563 scope.go:117] "RemoveContainer" containerID="8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0"
Sep 16 13:54:06.149863 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:54:06.149842    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0\": container with ID starting with 8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0 not found: ID does not exist" containerID="8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0"
Sep 16 13:54:06.149922 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.149871    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0"} err="failed to get container status \"8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0\": rpc error: code = NotFound desc = could not find container \"8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0\": container with ID starting with 8a5c3bcb438d90f9b989051fbb69f570f1f11f01302ec69d9cc738f4b8f255c0 not found: ID does not exist"
Sep 16 13:54:06.161328 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.161297    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"]
Sep 16 13:54:06.163417 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:06.163396    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-dffccf-openshift-default-958f899b8-rzz7r"]
Sep 16 13:54:07.217528 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:07.217497    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b2243f-7028-4784-90b9-6ee9d6220680" path="/var/lib/kubelet/pods/95b2243f-7028-4784-90b9-6ee9d6220680/volumes"
Sep 16 13:54:11.316474 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:11.316442    2563 scope.go:117] "RemoveContainer" containerID="7a2bbc4fd668deb77e9bc56dcedf151d3c5ab32aeb08907047384d9cef454788"
Sep 16 13:54:11.325142 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:54:11.325118    2563 scope.go:117] "RemoveContainer" containerID="a0bab262a760d832da6861519f7f0bb2a91e377ca4902413a2ea353e108f344c"
Sep 16 13:55:05.634395 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:05.634340    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"]
Sep 16 13:55:05.634944 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:05.634608    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7" podUID="44183882-f4d1-4cc7-8757-3dc18fe3280c" containerName="maas-api" containerID="cri-o://d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3" gracePeriod=30
Sep 16 13:55:05.693092 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:05.693060    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"]
Sep 16 13:55:05.693435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:05.693396    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56" podUID="93ff0dfc-edd5-4ac1-84fe-39efef75374a" containerName="payload-pre-processing" containerID="cri-o://6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884" gracePeriod=30
Sep 16 13:55:05.960780 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:05.960726    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:55:05.996745 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:05.996717    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:55:06.047549 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.047520    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f58ch\" (UniqueName: \"kubernetes.io/projected/44183882-f4d1-4cc7-8757-3dc18fe3280c-kube-api-access-f58ch\") pod \"44183882-f4d1-4cc7-8757-3dc18fe3280c\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") "
Sep 16 13:55:06.047688 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.047567    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93ff0dfc-edd5-4ac1-84fe-39efef75374a-plugins-config-volume\") pod \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\" (UID: \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\") "
Sep 16 13:55:06.047688 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.047617    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d56tb\" (UniqueName: \"kubernetes.io/projected/93ff0dfc-edd5-4ac1-84fe-39efef75374a-kube-api-access-d56tb\") pod \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\" (UID: \"93ff0dfc-edd5-4ac1-84fe-39efef75374a\") "
Sep 16 13:55:06.047688 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.047654    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44183882-f4d1-4cc7-8757-3dc18fe3280c-openshift-service-ca\") pod \"44183882-f4d1-4cc7-8757-3dc18fe3280c\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") "
Sep 16 13:55:06.047688 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.047670    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-metrics-certs\") pod \"44183882-f4d1-4cc7-8757-3dc18fe3280c\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") "
Sep 16 13:55:06.047912 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.047700    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-maas-api-tls\") pod \"44183882-f4d1-4cc7-8757-3dc18fe3280c\" (UID: \"44183882-f4d1-4cc7-8757-3dc18fe3280c\") "
Sep 16 13:55:06.048013 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.047977    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93ff0dfc-edd5-4ac1-84fe-39efef75374a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93ff0dfc-edd5-4ac1-84fe-39efef75374a" (UID: "93ff0dfc-edd5-4ac1-84fe-39efef75374a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:55:06.048082 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.048030    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44183882-f4d1-4cc7-8757-3dc18fe3280c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "44183882-f4d1-4cc7-8757-3dc18fe3280c" (UID: "44183882-f4d1-4cc7-8757-3dc18fe3280c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:55:06.048151 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.048129    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44183882-f4d1-4cc7-8757-3dc18fe3280c-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:55:06.048284 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.048155    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93ff0dfc-edd5-4ac1-84fe-39efef75374a-plugins-config-volume\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:55:06.049873 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.049846    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "44183882-f4d1-4cc7-8757-3dc18fe3280c" (UID: "44183882-f4d1-4cc7-8757-3dc18fe3280c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:55:06.049955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.049845    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ff0dfc-edd5-4ac1-84fe-39efef75374a-kube-api-access-d56tb" (OuterVolumeSpecName: "kube-api-access-d56tb") pod "93ff0dfc-edd5-4ac1-84fe-39efef75374a" (UID: "93ff0dfc-edd5-4ac1-84fe-39efef75374a"). InnerVolumeSpecName "kube-api-access-d56tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:55:06.049955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.049883    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "44183882-f4d1-4cc7-8757-3dc18fe3280c" (UID: "44183882-f4d1-4cc7-8757-3dc18fe3280c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:55:06.049955 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.049932    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44183882-f4d1-4cc7-8757-3dc18fe3280c-kube-api-access-f58ch" (OuterVolumeSpecName: "kube-api-access-f58ch") pod "44183882-f4d1-4cc7-8757-3dc18fe3280c" (UID: "44183882-f4d1-4cc7-8757-3dc18fe3280c"). InnerVolumeSpecName "kube-api-access-f58ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:55:06.148811 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.148783    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d56tb\" (UniqueName: \"kubernetes.io/projected/93ff0dfc-edd5-4ac1-84fe-39efef75374a-kube-api-access-d56tb\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:55:06.148811 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.148808    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:55:06.148811 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.148817    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44183882-f4d1-4cc7-8757-3dc18fe3280c-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:55:06.149031 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.148825    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f58ch\" (UniqueName: \"kubernetes.io/projected/44183882-f4d1-4cc7-8757-3dc18fe3280c-kube-api-access-f58ch\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:55:06.486194 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.486156    2563 generic.go:356] "Generic (PLEG): container finished" podID="44183882-f4d1-4cc7-8757-3dc18fe3280c" containerID="d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3" exitCode=0
Sep 16 13:55:06.486413 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.486224    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"
Sep 16 13:55:06.486413 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.486244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7" event={"ID":"44183882-f4d1-4cc7-8757-3dc18fe3280c","Type":"ContainerDied","Data":"d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3"}
Sep 16 13:55:06.486413 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.486332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7" event={"ID":"44183882-f4d1-4cc7-8757-3dc18fe3280c","Type":"ContainerDied","Data":"70ea59606241a0652d7fde8c27e6978d67aad504703eb9f822688e642a9e131f"}
Sep 16 13:55:06.486413 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.486360    2563 scope.go:117] "RemoveContainer" containerID="d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3"
Sep 16 13:55:06.488336 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.488299    2563 generic.go:356] "Generic (PLEG): container finished" podID="93ff0dfc-edd5-4ac1-84fe-39efef75374a" containerID="6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884" exitCode=0
Sep 16 13:55:06.488464 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.488352    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"
Sep 16 13:55:06.488464 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.488392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56" event={"ID":"93ff0dfc-edd5-4ac1-84fe-39efef75374a","Type":"ContainerDied","Data":"6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884"}
Sep 16 13:55:06.488464 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.488435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56" event={"ID":"93ff0dfc-edd5-4ac1-84fe-39efef75374a","Type":"ContainerDied","Data":"f746528d2612651e94b88b8057de332577ff6f4d72d556c9f3afb04b3ca12cb6"}
Sep 16 13:55:06.497255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.497230    2563 scope.go:117] "RemoveContainer" containerID="d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3"
Sep 16 13:55:06.497545 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:55:06.497526    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3\": container with ID starting with d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3 not found: ID does not exist" containerID="d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3"
Sep 16 13:55:06.497614 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.497551    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3"} err="failed to get container status \"d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3\": rpc error: code = NotFound desc = could not find container \"d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3\": container with ID starting with d9884cc4ba80c8648b5d90d3b6814ba2f1c0908c44b452464ab3565c676f89c3 not found: ID does not exist"
Sep 16 13:55:06.497614 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.497568    2563 scope.go:117] "RemoveContainer" containerID="6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884"
Sep 16 13:55:06.506091 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.506075    2563 scope.go:117] "RemoveContainer" containerID="6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884"
Sep 16 13:55:06.506337 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:55:06.506318    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884\": container with ID starting with 6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884 not found: ID does not exist" containerID="6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884"
Sep 16 13:55:06.506408 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.506345    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884"} err="failed to get container status \"6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884\": rpc error: code = NotFound desc = could not find container \"6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884\": container with ID starting with 6442cdf41e14ce14e9f75eb12168b83529c4fa9dbe5d05ecdbce0590172a8884 not found: ID does not exist"
Sep 16 13:55:06.510952 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.510932    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"]
Sep 16 13:55:06.514507 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.514479    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3be042d3-6494b4cc8b-j4j56"]
Sep 16 13:55:06.523929 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.523908    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"]
Sep 16 13:55:06.527386 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:06.527354    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3be042d3-b9c97cf6f-xqxc7"]
Sep 16 13:55:07.217537 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:07.217506    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44183882-f4d1-4cc7-8757-3dc18fe3280c" path="/var/lib/kubelet/pods/44183882-f4d1-4cc7-8757-3dc18fe3280c/volumes"
Sep 16 13:55:07.218069 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:07.218049    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93ff0dfc-edd5-4ac1-84fe-39efef75374a" path="/var/lib/kubelet/pods/93ff0dfc-edd5-4ac1-84fe-39efef75374a/volumes"
Sep 16 13:55:26.240541 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.240505    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"]
Sep 16 13:55:26.241169 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.241150    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44183882-f4d1-4cc7-8757-3dc18fe3280c" containerName="maas-api"
Sep 16 13:55:26.241252 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.241173    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="44183882-f4d1-4cc7-8757-3dc18fe3280c" containerName="maas-api"
Sep 16 13:55:26.241252 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.241214    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b2243f-7028-4784-90b9-6ee9d6220680" containerName="istio-proxy"
Sep 16 13:55:26.241252 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.241223    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b2243f-7028-4784-90b9-6ee9d6220680" containerName="istio-proxy"
Sep 16 13:55:26.241437 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.241251    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93ff0dfc-edd5-4ac1-84fe-39efef75374a" containerName="payload-pre-processing"
Sep 16 13:55:26.241437 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.241261    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ff0dfc-edd5-4ac1-84fe-39efef75374a" containerName="payload-pre-processing"
Sep 16 13:55:26.241437 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.241367    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b2243f-7028-4784-90b9-6ee9d6220680" containerName="istio-proxy"
Sep 16 13:55:26.241437 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.241398    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="93ff0dfc-edd5-4ac1-84fe-39efef75374a" containerName="payload-pre-processing"
Sep 16 13:55:26.241437 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.241408    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="44183882-f4d1-4cc7-8757-3dc18fe3280c" containerName="maas-api"
Sep 16 13:55:26.246174 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.246153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.248406 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.248368    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ac8045\"/\"kube-root-ca.crt\""
Sep 16 13:55:26.249034 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.249011    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ac8045\"/\"default-dockercfg-tbm2p\""
Sep 16 13:55:26.249034 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.249036    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ac8045\"/\"openshift-service-ca.crt\""
Sep 16 13:55:26.249174 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.249037    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ac8045\"/\"auth-test-model-ac8045-kserve-self-signed-certs\""
Sep 16 13:55:26.254830 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.254806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"]
Sep 16 13:55:26.340556 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.340523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-tmp-dir\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.340709 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.340572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-dshm\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.340709 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.340602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-model-cache\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.340709 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.340671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hmx\" (UniqueName: \"kubernetes.io/projected/33637950-a44f-4062-9044-920904b37c3a-kube-api-access-42hmx\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.340882 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.340729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-home\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.340882 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.340754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33637950-a44f-4062-9044-920904b37c3a-tls-certs\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.442004 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.441967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hmx\" (UniqueName: \"kubernetes.io/projected/33637950-a44f-4062-9044-920904b37c3a-kube-api-access-42hmx\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.442181 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.442034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-home\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.442181 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.442070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33637950-a44f-4062-9044-920904b37c3a-tls-certs\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.442181 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.442151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-tmp-dir\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.442323 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.442204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-dshm\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.442323 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.442262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-model-cache\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.442495 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.442476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-home\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.442544 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.442523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-tmp-dir\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.442596 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.442581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-model-cache\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.444586 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.444567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-dshm\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.444735 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.444720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33637950-a44f-4062-9044-920904b37c3a-tls-certs\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.449600 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.449582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hmx\" (UniqueName: \"kubernetes.io/projected/33637950-a44f-4062-9044-920904b37c3a-kube-api-access-42hmx\") pod \"auth-test-model-ac8045-kserve-96f886fc9-d2gr2\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") " pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.556775 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.556700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:26.829166 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:26.829135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"]
Sep 16 13:55:26.831319 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:55:26.831294    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33637950_a44f_4062_9044_920904b37c3a.slice/crio-5574efef78646a07e440ac9b938cdc7a9242a6512e683955b5dbaeefd370fab4 WatchSource:0}: Error finding container 5574efef78646a07e440ac9b938cdc7a9242a6512e683955b5dbaeefd370fab4: Status 404 returned error can't find the container with id 5574efef78646a07e440ac9b938cdc7a9242a6512e683955b5dbaeefd370fab4
Sep 16 13:55:27.607066 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:27.607030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2" event={"ID":"33637950-a44f-4062-9044-920904b37c3a","Type":"ContainerStarted","Data":"497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4"}
Sep 16 13:55:27.607540 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:27.607077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2" event={"ID":"33637950-a44f-4062-9044-920904b37c3a","Type":"ContainerStarted","Data":"5574efef78646a07e440ac9b938cdc7a9242a6512e683955b5dbaeefd370fab4"}
Sep 16 13:55:27.627763 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:27.627707    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2" podStartSLOduration=1.6276908749999999 podStartE2EDuration="1.627690875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:55:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:55:27.625190402 +0000 UTC m=+1336.872068230" watchObservedRunningTime="2026-09-16 13:55:27.627690875 +0000 UTC m=+1336.874568700"
Sep 16 13:55:36.557534 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:36.557430    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:36.557534 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:36.557494    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:36.570268 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:36.570245    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:55:36.671545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:55:36.671518    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:56:03.727753 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.727721    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"]
Sep 16 13:56:03.732811 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.732788    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.736223 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.736193    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-fc8c65\"/\"kube-root-ca.crt\""
Sep 16 13:56:03.736223 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.736218    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-fc8c65\"/\"distinct-2-w4-fc8c65-kserve-self-signed-certs\""
Sep 16 13:56:03.736517 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.736500    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-fc8c65\"/\"openshift-service-ca.crt\""
Sep 16 13:56:03.736667 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.736651    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-fc8c65\"/\"default-dockercfg-8j9lj\""
Sep 16 13:56:03.738192 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.738169    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"]
Sep 16 13:56:03.832102 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.832078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74df5598-030c-4e43-908f-d1b97346dc4e-tls-certs\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.832301 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.832116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-tmp-dir\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.832301 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.832174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-dshm\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.832301 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.832206    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-model-cache\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.832463 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.832316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-home\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.832463 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.832349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pg2r\" (UniqueName: \"kubernetes.io/projected/74df5598-030c-4e43-908f-d1b97346dc4e-kube-api-access-6pg2r\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.933793 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.933765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-home\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.933969 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.933813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pg2r\" (UniqueName: \"kubernetes.io/projected/74df5598-030c-4e43-908f-d1b97346dc4e-kube-api-access-6pg2r\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.933969 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.933846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74df5598-030c-4e43-908f-d1b97346dc4e-tls-certs\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.933969 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.933880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-tmp-dir\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.933969 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.933945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-dshm\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.934194 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.933997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-model-cache\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.934254 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.934209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-home\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.934312 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.934292    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-tmp-dir\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.934368 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.934322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-model-cache\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.936277 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.936253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-dshm\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.936557 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.936541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74df5598-030c-4e43-908f-d1b97346dc4e-tls-certs\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:03.941884 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:03.941867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pg2r\" (UniqueName: \"kubernetes.io/projected/74df5598-030c-4e43-908f-d1b97346dc4e-kube-api-access-6pg2r\") pod \"distinct-2-w4-fc8c65-kserve-bc879bc47-psclg\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") " pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:04.045450 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:04.045346    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:04.319891 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:04.319799    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"]
Sep 16 13:56:04.323006 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:56:04.322970    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74df5598_030c_4e43_908f_d1b97346dc4e.slice/crio-933e1ee1d3238f70b9aaf8047dc9caf506177f3388cb0cb302e184d9205822b2 WatchSource:0}: Error finding container 933e1ee1d3238f70b9aaf8047dc9caf506177f3388cb0cb302e184d9205822b2: Status 404 returned error can't find the container with id 933e1ee1d3238f70b9aaf8047dc9caf506177f3388cb0cb302e184d9205822b2
Sep 16 13:56:04.824975 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:04.824940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg" event={"ID":"74df5598-030c-4e43-908f-d1b97346dc4e","Type":"ContainerStarted","Data":"82c72927cf441e792f41a580f8ecc4cdb6a757beae0bf12af8c1e58160c7599d"}
Sep 16 13:56:04.825362 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:04.824986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg" event={"ID":"74df5598-030c-4e43-908f-d1b97346dc4e","Type":"ContainerStarted","Data":"933e1ee1d3238f70b9aaf8047dc9caf506177f3388cb0cb302e184d9205822b2"}
Sep 16 13:56:04.840696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:04.840652    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg" podStartSLOduration=1.840636167 podStartE2EDuration="1.840636167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:56:04.839904597 +0000 UTC m=+1374.086782423" watchObservedRunningTime="2026-09-16 13:56:04.840636167 +0000 UTC m=+1374.087514135"
Sep 16 13:56:14.046282 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:14.046241    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:14.047051 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:14.046300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:14.059075 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:14.059044    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:56:14.890698 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:56:14.890665    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:57:13.261159 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.261129    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"]
Sep 16 13:57:13.265199 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.265176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.267323 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.267298    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-44f000-serving-cert\""
Sep 16 13:57:13.275246 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.275222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"]
Sep 16 13:57:13.367897 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.367860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46195fb2-2559-496f-93b3-f396ad84afb7-openshift-service-ca\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.368271 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.368245    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcsm9\" (UniqueName: \"kubernetes.io/projected/46195fb2-2559-496f-93b3-f396ad84afb7-kube-api-access-vcsm9\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.368442 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.368423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-maas-api-tls\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.368635 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.368614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-metrics-certs\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.470001 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.469968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46195fb2-2559-496f-93b3-f396ad84afb7-openshift-service-ca\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.470214 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.470083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcsm9\" (UniqueName: \"kubernetes.io/projected/46195fb2-2559-496f-93b3-f396ad84afb7-kube-api-access-vcsm9\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.470214 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.470115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-maas-api-tls\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.470214 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.470175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-metrics-certs\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.470428 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:57:13.470304    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-serving-cert: secret "maas-api-e2e-api-a-44f000-serving-cert" not found
Sep 16 13:57:13.470428 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:57:13.470402    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-maas-api-tls podName:46195fb2-2559-496f-93b3-f396ad84afb7 nodeName:}" failed. No retries permitted until 2026-09-16 13:57:13.97035536 +0000 UTC m=+1443.217233177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-maas-api-tls") pod "maas-api-e2e-api-a-44f000-78d8ccb965-5544n" (UID: "46195fb2-2559-496f-93b3-f396ad84afb7") : secret "maas-api-e2e-api-a-44f000-serving-cert" not found
Sep 16 13:57:13.470670 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.470649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46195fb2-2559-496f-93b3-f396ad84afb7-openshift-service-ca\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.472811 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.472790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-metrics-certs\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.478923 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.478898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcsm9\" (UniqueName: \"kubernetes.io/projected/46195fb2-2559-496f-93b3-f396ad84afb7-kube-api-access-vcsm9\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.889017 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.888987    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"]
Sep 16 13:57:13.893214 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.893194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:13.898563 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.898540    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-44f000-dockercfg-wwnv9\""
Sep 16 13:57:13.899021 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.899003    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-44f000\""
Sep 16 13:57:13.910764 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.910737    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"]
Sep 16 13:57:13.974435 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.974405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxqqz\" (UniqueName: \"kubernetes.io/projected/98d31c4d-0c99-4c26-ba7d-5db751b4e972-kube-api-access-sxqqz\") pod \"payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg\" (UID: \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\") " pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:13.974686 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.974452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d31c4d-0c99-4c26-ba7d-5db751b4e972-plugins-config-volume\") pod \"payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg\" (UID: \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\") " pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:13.974686 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.974627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-maas-api-tls\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:13.978678 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:13.977825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-maas-api-tls\") pod \"maas-api-e2e-api-a-44f000-78d8ccb965-5544n\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:14.075910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:14.075871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxqqz\" (UniqueName: \"kubernetes.io/projected/98d31c4d-0c99-4c26-ba7d-5db751b4e972-kube-api-access-sxqqz\") pod \"payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg\" (UID: \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\") " pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:14.076111 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:14.075927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d31c4d-0c99-4c26-ba7d-5db751b4e972-plugins-config-volume\") pod \"payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg\" (UID: \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\") " pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:14.076672 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:14.076647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d31c4d-0c99-4c26-ba7d-5db751b4e972-plugins-config-volume\") pod \"payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg\" (UID: \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\") " pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:14.084106 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:14.084078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxqqz\" (UniqueName: \"kubernetes.io/projected/98d31c4d-0c99-4c26-ba7d-5db751b4e972-kube-api-access-sxqqz\") pod \"payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg\" (UID: \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\") " pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:14.177538 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:14.177435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:14.203909 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:14.203870    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:14.455759 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:14.455731    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"]
Sep 16 13:57:14.458542 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:57:14.458515    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46195fb2_2559_496f_93b3_f396ad84afb7.slice/crio-e34b2d8fc6666c40c106bf5035b8dd2663e5253502514c9d713cd0c84f122ac7 WatchSource:0}: Error finding container e34b2d8fc6666c40c106bf5035b8dd2663e5253502514c9d713cd0c84f122ac7: Status 404 returned error can't find the container with id e34b2d8fc6666c40c106bf5035b8dd2663e5253502514c9d713cd0c84f122ac7
Sep 16 13:57:14.459842 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:14.459824    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:57:14.489537 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:14.489513    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"]
Sep 16 13:57:14.491991 ip-10-0-131-28 kubenswrapper[2563]: W0916 13:57:14.491959    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d31c4d_0c99_4c26_ba7d_5db751b4e972.slice/crio-46957b2b12e360673226466a1eee01c85dc87dbe46cf5c9874c82ce50a7303ee WatchSource:0}: Error finding container 46957b2b12e360673226466a1eee01c85dc87dbe46cf5c9874c82ce50a7303ee: Status 404 returned error can't find the container with id 46957b2b12e360673226466a1eee01c85dc87dbe46cf5c9874c82ce50a7303ee
Sep 16 13:57:15.232305 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:15.232267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n" event={"ID":"46195fb2-2559-496f-93b3-f396ad84afb7","Type":"ContainerStarted","Data":"862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433"}
Sep 16 13:57:15.232537 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:15.232336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n" event={"ID":"46195fb2-2559-496f-93b3-f396ad84afb7","Type":"ContainerStarted","Data":"e34b2d8fc6666c40c106bf5035b8dd2663e5253502514c9d713cd0c84f122ac7"}
Sep 16 13:57:15.232537 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:15.232483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:15.234095 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:15.234062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg" event={"ID":"98d31c4d-0c99-4c26-ba7d-5db751b4e972","Type":"ContainerStarted","Data":"27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706"}
Sep 16 13:57:15.234222 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:15.234118    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:15.234222 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:15.234142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg" event={"ID":"98d31c4d-0c99-4c26-ba7d-5db751b4e972","Type":"ContainerStarted","Data":"46957b2b12e360673226466a1eee01c85dc87dbe46cf5c9874c82ce50a7303ee"}
Sep 16 13:57:15.250939 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:15.250834    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n" podStartSLOduration=1.713831245 podStartE2EDuration="2.25081197s" totalImagesPullingTime="536.980725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:57:15.247885907 +0000 UTC m=+1444.494763734" watchObservedRunningTime="2026-09-16 13:57:15.25081197 +0000 UTC m=+1444.497689798"
Sep 16 13:57:15.264988 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:15.264933    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg" podStartSLOduration=2.264917851 podStartE2EDuration="2.264917851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:57:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:57:15.263242572 +0000 UTC m=+1444.510120410" watchObservedRunningTime="2026-09-16 13:57:15.264917851 +0000 UTC m=+1444.511795676"
Sep 16 13:57:21.244834 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:21.244804    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:57:26.242020 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:26.241983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:57:30.318567 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:30.318533    2563 generic.go:356] "Generic (PLEG): container finished" podID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" containerID="ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7" exitCode=137
Sep 16 13:57:30.319152 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:30.318589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9" event={"ID":"e3c61cef-8fa3-41fb-a2f7-e6e240432171","Type":"ContainerDied","Data":"ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7"}
Sep 16 13:57:30.319152 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:30.318879    2563 scope.go:117] "RemoveContainer" containerID="ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7"
Sep 16 13:57:31.325591 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:31.325559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9" event={"ID":"e3c61cef-8fa3-41fb-a2f7-e6e240432171","Type":"ContainerStarted","Data":"1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb"}
Sep 16 13:57:31.325993 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:31.325756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:57:42.333985 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:57:42.333953    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 13:58:11.258905 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:11.258869    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:58:11.261872 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:11.261850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 13:58:31.816200 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:31.816163    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"]
Sep 16 13:58:31.816775 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:31.816431    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n" podUID="46195fb2-2559-496f-93b3-f396ad84afb7" containerName="maas-api" containerID="cri-o://862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433" gracePeriod=30
Sep 16 13:58:31.873684 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:31.873651    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"]
Sep 16 13:58:31.873910 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:31.873886    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg" podUID="98d31c4d-0c99-4c26-ba7d-5db751b4e972" containerName="payload-processing" containerID="cri-o://27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706" gracePeriod=30
Sep 16 13:58:32.168976 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.168947    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:58:32.192399 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.192330    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:58:32.297996 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.297966    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46195fb2-2559-496f-93b3-f396ad84afb7-openshift-service-ca\") pod \"46195fb2-2559-496f-93b3-f396ad84afb7\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") "
Sep 16 13:58:32.298202 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.298013    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxqqz\" (UniqueName: \"kubernetes.io/projected/98d31c4d-0c99-4c26-ba7d-5db751b4e972-kube-api-access-sxqqz\") pod \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\" (UID: \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\") "
Sep 16 13:58:32.298202 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.298087    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-metrics-certs\") pod \"46195fb2-2559-496f-93b3-f396ad84afb7\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") "
Sep 16 13:58:32.298202 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.298118    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d31c4d-0c99-4c26-ba7d-5db751b4e972-plugins-config-volume\") pod \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\" (UID: \"98d31c4d-0c99-4c26-ba7d-5db751b4e972\") "
Sep 16 13:58:32.298202 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.298196    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcsm9\" (UniqueName: \"kubernetes.io/projected/46195fb2-2559-496f-93b3-f396ad84afb7-kube-api-access-vcsm9\") pod \"46195fb2-2559-496f-93b3-f396ad84afb7\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") "
Sep 16 13:58:32.298481 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.298237    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-maas-api-tls\") pod \"46195fb2-2559-496f-93b3-f396ad84afb7\" (UID: \"46195fb2-2559-496f-93b3-f396ad84afb7\") "
Sep 16 13:58:32.298481 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.298455    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46195fb2-2559-496f-93b3-f396ad84afb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46195fb2-2559-496f-93b3-f396ad84afb7" (UID: "46195fb2-2559-496f-93b3-f396ad84afb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:58:32.298788 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.298749    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46195fb2-2559-496f-93b3-f396ad84afb7-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:58:32.298899 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.298795    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d31c4d-0c99-4c26-ba7d-5db751b4e972-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98d31c4d-0c99-4c26-ba7d-5db751b4e972" (UID: "98d31c4d-0c99-4c26-ba7d-5db751b4e972"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:58:32.300585 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.300561    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d31c4d-0c99-4c26-ba7d-5db751b4e972-kube-api-access-sxqqz" (OuterVolumeSpecName: "kube-api-access-sxqqz") pod "98d31c4d-0c99-4c26-ba7d-5db751b4e972" (UID: "98d31c4d-0c99-4c26-ba7d-5db751b4e972"). InnerVolumeSpecName "kube-api-access-sxqqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:58:32.300843 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.300821    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46195fb2-2559-496f-93b3-f396ad84afb7-kube-api-access-vcsm9" (OuterVolumeSpecName: "kube-api-access-vcsm9") pod "46195fb2-2559-496f-93b3-f396ad84afb7" (UID: "46195fb2-2559-496f-93b3-f396ad84afb7"). InnerVolumeSpecName "kube-api-access-vcsm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:58:32.300939 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.300894    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46195fb2-2559-496f-93b3-f396ad84afb7" (UID: "46195fb2-2559-496f-93b3-f396ad84afb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:58:32.300991 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.300976    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "46195fb2-2559-496f-93b3-f396ad84afb7" (UID: "46195fb2-2559-496f-93b3-f396ad84afb7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:58:32.399456 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.399423    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxqqz\" (UniqueName: \"kubernetes.io/projected/98d31c4d-0c99-4c26-ba7d-5db751b4e972-kube-api-access-sxqqz\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:58:32.399585 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.399460    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:58:32.399585 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.399473    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d31c4d-0c99-4c26-ba7d-5db751b4e972-plugins-config-volume\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:58:32.399585 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.399484    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcsm9\" (UniqueName: \"kubernetes.io/projected/46195fb2-2559-496f-93b3-f396ad84afb7-kube-api-access-vcsm9\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:58:32.399585 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.399495    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46195fb2-2559-496f-93b3-f396ad84afb7-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:58:32.675792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.675687    2563 generic.go:356] "Generic (PLEG): container finished" podID="98d31c4d-0c99-4c26-ba7d-5db751b4e972" containerID="27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706" exitCode=0
Sep 16 13:58:32.675792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.675731    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"
Sep 16 13:58:32.675792 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.675771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg" event={"ID":"98d31c4d-0c99-4c26-ba7d-5db751b4e972","Type":"ContainerDied","Data":"27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706"}
Sep 16 13:58:32.676065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.675828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg" event={"ID":"98d31c4d-0c99-4c26-ba7d-5db751b4e972","Type":"ContainerDied","Data":"46957b2b12e360673226466a1eee01c85dc87dbe46cf5c9874c82ce50a7303ee"}
Sep 16 13:58:32.676065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.675854    2563 scope.go:117] "RemoveContainer" containerID="27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706"
Sep 16 13:58:32.677401 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.677354    2563 generic.go:356] "Generic (PLEG): container finished" podID="46195fb2-2559-496f-93b3-f396ad84afb7" containerID="862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433" exitCode=0
Sep 16 13:58:32.677527 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.677423    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"
Sep 16 13:58:32.677527 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.677420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n" event={"ID":"46195fb2-2559-496f-93b3-f396ad84afb7","Type":"ContainerDied","Data":"862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433"}
Sep 16 13:58:32.677628 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.677566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n" event={"ID":"46195fb2-2559-496f-93b3-f396ad84afb7","Type":"ContainerDied","Data":"e34b2d8fc6666c40c106bf5035b8dd2663e5253502514c9d713cd0c84f122ac7"}
Sep 16 13:58:32.687579 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.687553    2563 scope.go:117] "RemoveContainer" containerID="27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706"
Sep 16 13:58:32.688116 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:58:32.688089    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706\": container with ID starting with 27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706 not found: ID does not exist" containerID="27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706"
Sep 16 13:58:32.688226 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.688130    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706"} err="failed to get container status \"27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706\": rpc error: code = NotFound desc = could not find container \"27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706\": container with ID starting with 27c52c16cdcec5db7925a6d8ca1242f3c11b6c7ab30152ae4f76df674dcff706 not found: ID does not exist"
Sep 16 13:58:32.688226 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.688153    2563 scope.go:117] "RemoveContainer" containerID="862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433"
Sep 16 13:58:32.699243 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.699228    2563 scope.go:117] "RemoveContainer" containerID="862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433"
Sep 16 13:58:32.699594 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:58:32.699576    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433\": container with ID starting with 862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433 not found: ID does not exist" containerID="862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433"
Sep 16 13:58:32.699657 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.699600    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433"} err="failed to get container status \"862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433\": rpc error: code = NotFound desc = could not find container \"862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433\": container with ID starting with 862b8c88e27d8193ca2b29db1bd55e23e337aa3eb628631a762339b418c4e433 not found: ID does not exist"
Sep 16 13:58:32.708069 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.708049    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"]
Sep 16 13:58:32.711657 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.711636    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-44f000-76cb4f666c-2xkgg"]
Sep 16 13:58:32.721671 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.721654    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"]
Sep 16 13:58:32.723617 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:32.723600    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44f000-78d8ccb965-5544n"]
Sep 16 13:58:33.221428 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:33.221396    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46195fb2-2559-496f-93b3-f396ad84afb7" path="/var/lib/kubelet/pods/46195fb2-2559-496f-93b3-f396ad84afb7/volumes"
Sep 16 13:58:33.221782 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:58:33.221759    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d31c4d-0c99-4c26-ba7d-5db751b4e972" path="/var/lib/kubelet/pods/98d31c4d-0c99-4c26-ba7d-5db751b4e972/volumes"
Sep 16 13:59:04.721990 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:04.721953    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"]
Sep 16 13:59:12.696337 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:12.696305    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"]
Sep 16 13:59:12.696872 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:12.696580    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg" podUID="768c6065-5e7b-4435-bacc-e38e80a33219" containerName="maas-api" containerID="cri-o://a4f08447964c328ffa5defde8dd635aff49674e0fc06d34c089b142defde96c3" gracePeriod=30
Sep 16 13:59:12.762291 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:12.762258    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"]
Sep 16 13:59:12.763258 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:12.762530    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s" podUID="da85ece8-18fc-4e38-8a10-7432c05bbbca" containerName="payload-pre-processing" containerID="cri-o://b1a88d025eba8eee4c9498f6a23455a83c96e3a70a574dbe9058a5094842256d" gracePeriod=30
Sep 16 13:59:12.916834 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:12.916678    2563 generic.go:356] "Generic (PLEG): container finished" podID="768c6065-5e7b-4435-bacc-e38e80a33219" containerID="a4f08447964c328ffa5defde8dd635aff49674e0fc06d34c089b142defde96c3" exitCode=0
Sep 16 13:59:12.917028 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:12.916949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg" event={"ID":"768c6065-5e7b-4435-bacc-e38e80a33219","Type":"ContainerDied","Data":"a4f08447964c328ffa5defde8dd635aff49674e0fc06d34c089b142defde96c3"}
Sep 16 13:59:12.920780 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:12.920753    2563 generic.go:356] "Generic (PLEG): container finished" podID="da85ece8-18fc-4e38-8a10-7432c05bbbca" containerID="b1a88d025eba8eee4c9498f6a23455a83c96e3a70a574dbe9058a5094842256d" exitCode=0
Sep 16 13:59:12.920924 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:12.920829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s" event={"ID":"da85ece8-18fc-4e38-8a10-7432c05bbbca","Type":"ContainerDied","Data":"b1a88d025eba8eee4c9498f6a23455a83c96e3a70a574dbe9058a5094842256d"}
Sep 16 13:59:13.040170 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.040135    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:59:13.068219 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.068185    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:59:13.118716 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.118683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/768c6065-5e7b-4435-bacc-e38e80a33219-openshift-service-ca\") pod \"768c6065-5e7b-4435-bacc-e38e80a33219\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") "
Sep 16 13:59:13.118885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.118816    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-622nf\" (UniqueName: \"kubernetes.io/projected/768c6065-5e7b-4435-bacc-e38e80a33219-kube-api-access-622nf\") pod \"768c6065-5e7b-4435-bacc-e38e80a33219\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") "
Sep 16 13:59:13.118885 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.118841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b28t\" (UniqueName: \"kubernetes.io/projected/da85ece8-18fc-4e38-8a10-7432c05bbbca-kube-api-access-7b28t\") pod \"da85ece8-18fc-4e38-8a10-7432c05bbbca\" (UID: \"da85ece8-18fc-4e38-8a10-7432c05bbbca\") "
Sep 16 13:59:13.119027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.118889    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-metrics-certs\") pod \"768c6065-5e7b-4435-bacc-e38e80a33219\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") "
Sep 16 13:59:13.119027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.118928    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da85ece8-18fc-4e38-8a10-7432c05bbbca-plugins-config-volume\") pod \"da85ece8-18fc-4e38-8a10-7432c05bbbca\" (UID: \"da85ece8-18fc-4e38-8a10-7432c05bbbca\") "
Sep 16 13:59:13.119027 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.118975    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-maas-api-tls\") pod \"768c6065-5e7b-4435-bacc-e38e80a33219\" (UID: \"768c6065-5e7b-4435-bacc-e38e80a33219\") "
Sep 16 13:59:13.119183 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.119110    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768c6065-5e7b-4435-bacc-e38e80a33219-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "768c6065-5e7b-4435-bacc-e38e80a33219" (UID: "768c6065-5e7b-4435-bacc-e38e80a33219"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:59:13.119335 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.119314    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/768c6065-5e7b-4435-bacc-e38e80a33219-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:13.119680 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.119654    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da85ece8-18fc-4e38-8a10-7432c05bbbca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da85ece8-18fc-4e38-8a10-7432c05bbbca" (UID: "da85ece8-18fc-4e38-8a10-7432c05bbbca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:59:13.121157 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.121132    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "768c6065-5e7b-4435-bacc-e38e80a33219" (UID: "768c6065-5e7b-4435-bacc-e38e80a33219"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:59:13.121470 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.121443    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "768c6065-5e7b-4435-bacc-e38e80a33219" (UID: "768c6065-5e7b-4435-bacc-e38e80a33219"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:59:13.121744 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.121723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768c6065-5e7b-4435-bacc-e38e80a33219-kube-api-access-622nf" (OuterVolumeSpecName: "kube-api-access-622nf") pod "768c6065-5e7b-4435-bacc-e38e80a33219" (UID: "768c6065-5e7b-4435-bacc-e38e80a33219"). InnerVolumeSpecName "kube-api-access-622nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:59:13.121744 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.121734    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da85ece8-18fc-4e38-8a10-7432c05bbbca-kube-api-access-7b28t" (OuterVolumeSpecName: "kube-api-access-7b28t") pod "da85ece8-18fc-4e38-8a10-7432c05bbbca" (UID: "da85ece8-18fc-4e38-8a10-7432c05bbbca"). InnerVolumeSpecName "kube-api-access-7b28t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:59:13.220224 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.220194    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:13.220224 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.220227    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da85ece8-18fc-4e38-8a10-7432c05bbbca-plugins-config-volume\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:13.220445 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.220243    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/768c6065-5e7b-4435-bacc-e38e80a33219-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:13.220445 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.220256    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-622nf\" (UniqueName: \"kubernetes.io/projected/768c6065-5e7b-4435-bacc-e38e80a33219-kube-api-access-622nf\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:13.220445 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.220270    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b28t\" (UniqueName: \"kubernetes.io/projected/da85ece8-18fc-4e38-8a10-7432c05bbbca-kube-api-access-7b28t\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:13.928093 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.928065    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"
Sep 16 13:59:13.928583 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.928101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg" event={"ID":"768c6065-5e7b-4435-bacc-e38e80a33219","Type":"ContainerDied","Data":"68e98b2df3a7bcce6f7d4b757477fab23011dfe834b5b07581c6f19f9558134f"}
Sep 16 13:59:13.928583 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.928159    2563 scope.go:117] "RemoveContainer" containerID="a4f08447964c328ffa5defde8dd635aff49674e0fc06d34c089b142defde96c3"
Sep 16 13:59:13.929671 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.929652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s" event={"ID":"da85ece8-18fc-4e38-8a10-7432c05bbbca","Type":"ContainerDied","Data":"ffe2acefd5236f4bb36af41dfe4e3145a883142afc6c921c28fe5de5eadf7a75"}
Sep 16 13:59:13.929752 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.929660    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"
Sep 16 13:59:13.938170 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.938152    2563 scope.go:117] "RemoveContainer" containerID="b1a88d025eba8eee4c9498f6a23455a83c96e3a70a574dbe9058a5094842256d"
Sep 16 13:59:13.947253 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.947231    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"]
Sep 16 13:59:13.953701 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.953679    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4fa336-7ddc7c9c55-j4kpg"]
Sep 16 13:59:13.962819 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.962795    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"]
Sep 16 13:59:13.969238 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:13.969190    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4fa336-865c656cf8-bzr8s"]
Sep 16 13:59:15.218800 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:15.218767    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="768c6065-5e7b-4435-bacc-e38e80a33219" path="/var/lib/kubelet/pods/768c6065-5e7b-4435-bacc-e38e80a33219/volumes"
Sep 16 13:59:15.219194 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:15.219161    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da85ece8-18fc-4e38-8a10-7432c05bbbca" path="/var/lib/kubelet/pods/da85ece8-18fc-4e38-8a10-7432c05bbbca/volumes"
Sep 16 13:59:19.742065 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:19.742015    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg" podUID="74df5598-030c-4e43-908f-d1b97346dc4e" containerName="main" containerID="cri-o://82c72927cf441e792f41a580f8ecc4cdb6a757beae0bf12af8c1e58160c7599d" gracePeriod=45
Sep 16 13:59:19.809293 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:19.809260    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"]
Sep 16 13:59:19.809560 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:19.809530    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy" containerID="cri-o://a93c5973bfd92cd938b6d34dbda42fdd35b9e4a488f3d1e6e3f63295d4bf5a2e" gracePeriod=30
Sep 16 13:59:19.970169 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:19.970139    2563 generic.go:356] "Generic (PLEG): container finished" podID="74df5598-030c-4e43-908f-d1b97346dc4e" containerID="82c72927cf441e792f41a580f8ecc4cdb6a757beae0bf12af8c1e58160c7599d" exitCode=0
Sep 16 13:59:19.970367 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:19.970216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg" event={"ID":"74df5598-030c-4e43-908f-d1b97346dc4e","Type":"ContainerDied","Data":"82c72927cf441e792f41a580f8ecc4cdb6a757beae0bf12af8c1e58160c7599d"}
Sep 16 13:59:20.012360 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.012335    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:59:20.090465 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.090418    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-home\") pod \"74df5598-030c-4e43-908f-d1b97346dc4e\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") "
Sep 16 13:59:20.090654 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.090492    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pg2r\" (UniqueName: \"kubernetes.io/projected/74df5598-030c-4e43-908f-d1b97346dc4e-kube-api-access-6pg2r\") pod \"74df5598-030c-4e43-908f-d1b97346dc4e\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") "
Sep 16 13:59:20.090654 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.090590    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-model-cache\") pod \"74df5598-030c-4e43-908f-d1b97346dc4e\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") "
Sep 16 13:59:20.090791 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.090681    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-home" (OuterVolumeSpecName: "home") pod "74df5598-030c-4e43-908f-d1b97346dc4e" (UID: "74df5598-030c-4e43-908f-d1b97346dc4e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:20.090791 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.090694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74df5598-030c-4e43-908f-d1b97346dc4e-tls-certs\") pod \"74df5598-030c-4e43-908f-d1b97346dc4e\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") "
Sep 16 13:59:20.090791 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.090783    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-tmp-dir\") pod \"74df5598-030c-4e43-908f-d1b97346dc4e\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") "
Sep 16 13:59:20.090951 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.090802    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-model-cache" (OuterVolumeSpecName: "model-cache") pod "74df5598-030c-4e43-908f-d1b97346dc4e" (UID: "74df5598-030c-4e43-908f-d1b97346dc4e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:20.090951 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.090826    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-dshm\") pod \"74df5598-030c-4e43-908f-d1b97346dc4e\" (UID: \"74df5598-030c-4e43-908f-d1b97346dc4e\") "
Sep 16 13:59:20.091066 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.091030    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "74df5598-030c-4e43-908f-d1b97346dc4e" (UID: "74df5598-030c-4e43-908f-d1b97346dc4e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:20.091255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.091234    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-model-cache\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:20.091255 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.091256    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-tmp-dir\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:20.091459 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.091268    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-home\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:20.093140 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.093109    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74df5598-030c-4e43-908f-d1b97346dc4e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "74df5598-030c-4e43-908f-d1b97346dc4e" (UID: "74df5598-030c-4e43-908f-d1b97346dc4e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:59:20.093256 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.093137    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74df5598-030c-4e43-908f-d1b97346dc4e-kube-api-access-6pg2r" (OuterVolumeSpecName: "kube-api-access-6pg2r") pod "74df5598-030c-4e43-908f-d1b97346dc4e" (UID: "74df5598-030c-4e43-908f-d1b97346dc4e"). InnerVolumeSpecName "kube-api-access-6pg2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:59:20.093344 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.093326    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-dshm" (OuterVolumeSpecName: "dshm") pod "74df5598-030c-4e43-908f-d1b97346dc4e" (UID: "74df5598-030c-4e43-908f-d1b97346dc4e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:20.192578 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.192540    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74df5598-030c-4e43-908f-d1b97346dc4e-tls-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:20.192578 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.192569    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74df5598-030c-4e43-908f-d1b97346dc4e-dshm\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:20.192578 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.192578    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pg2r\" (UniqueName: \"kubernetes.io/projected/74df5598-030c-4e43-908f-d1b97346dc4e-kube-api-access-6pg2r\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:20.977555 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.977518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg" event={"ID":"74df5598-030c-4e43-908f-d1b97346dc4e","Type":"ContainerDied","Data":"933e1ee1d3238f70b9aaf8047dc9caf506177f3388cb0cb302e184d9205822b2"}
Sep 16 13:59:20.978024 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.977561    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"
Sep 16 13:59:20.978024 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.977578    2563 scope.go:117] "RemoveContainer" containerID="82c72927cf441e792f41a580f8ecc4cdb6a757beae0bf12af8c1e58160c7599d"
Sep 16 13:59:20.999278 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:20.999257    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"]
Sep 16 13:59:21.001327 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:21.001305    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-fc8c65/distinct-2-w4-fc8c65-kserve-bc879bc47-psclg"]
Sep 16 13:59:21.217432 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:21.217397    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74df5598-030c-4e43-908f-d1b97346dc4e" path="/var/lib/kubelet/pods/74df5598-030c-4e43-908f-d1b97346dc4e/volumes"
Sep 16 13:59:22.189508 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:22.189473    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"]
Sep 16 13:59:22.189990 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:22.189786    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy" containerID="cri-o://5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d" gracePeriod=30
Sep 16 13:59:24.777948 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:24.777911    2563 patch_prober.go:28] interesting pod/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 13:59:24.778393 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:24.777980    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:59:25.005458 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.005418    2563 generic.go:356] "Generic (PLEG): container finished" podID="90cc2539-6199-4d42-93ed-d580eeb72236" containerID="a93c5973bfd92cd938b6d34dbda42fdd35b9e4a488f3d1e6e3f63295d4bf5a2e" exitCode=0
Sep 16 13:59:25.005605 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.005477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" event={"ID":"90cc2539-6199-4d42-93ed-d580eeb72236","Type":"ContainerDied","Data":"a93c5973bfd92cd938b6d34dbda42fdd35b9e4a488f3d1e6e3f63295d4bf5a2e"}
Sep 16 13:59:25.005605 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.005539    2563 scope.go:117] "RemoveContainer" containerID="8e0feb510cc121b9e6187fb987e23c0028b5386f661578f11fc2cbe4c6cd2015"
Sep 16 13:59:25.067644 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.067620    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:59:25.144551 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144524    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-socket\") pod \"90cc2539-6199-4d42-93ed-d580eeb72236\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") "
Sep 16 13:59:25.144696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144581    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-data\") pod \"90cc2539-6199-4d42-93ed-d580eeb72236\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") "
Sep 16 13:59:25.144696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144613    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-istio-token\") pod \"90cc2539-6199-4d42-93ed-d580eeb72236\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") "
Sep 16 13:59:25.144696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144634    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-credential-socket\") pod \"90cc2539-6199-4d42-93ed-d580eeb72236\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") "
Sep 16 13:59:25.144696 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90cc2539-6199-4d42-93ed-d580eeb72236-istiod-ca-cert\") pod \"90cc2539-6199-4d42-93ed-d580eeb72236\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") "
Sep 16 13:59:25.144928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144705    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4t9q\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-kube-api-access-v4t9q\") pod \"90cc2539-6199-4d42-93ed-d580eeb72236\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") "
Sep 16 13:59:25.144928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144742    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-certs\") pod \"90cc2539-6199-4d42-93ed-d580eeb72236\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") "
Sep 16 13:59:25.144928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144790    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90cc2539-6199-4d42-93ed-d580eeb72236-istio-podinfo\") pod \"90cc2539-6199-4d42-93ed-d580eeb72236\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") "
Sep 16 13:59:25.144928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144826    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-envoy\") pod \"90cc2539-6199-4d42-93ed-d580eeb72236\" (UID: \"90cc2539-6199-4d42-93ed-d580eeb72236\") "
Sep 16 13:59:25.144928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144838    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90cc2539-6199-4d42-93ed-d580eeb72236" (UID: "90cc2539-6199-4d42-93ed-d580eeb72236"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:25.144928 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.144911    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-data" (OuterVolumeSpecName: "istio-data") pod "90cc2539-6199-4d42-93ed-d580eeb72236" (UID: "90cc2539-6199-4d42-93ed-d580eeb72236"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:25.145251 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.145091    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90cc2539-6199-4d42-93ed-d580eeb72236" (UID: "90cc2539-6199-4d42-93ed-d580eeb72236"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:25.145251 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.145227    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:25.145251 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.145247    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:25.145450 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.145250    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90cc2539-6199-4d42-93ed-d580eeb72236" (UID: "90cc2539-6199-4d42-93ed-d580eeb72236"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:25.145450 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.145261    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:25.145450 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.145363    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90cc2539-6199-4d42-93ed-d580eeb72236-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90cc2539-6199-4d42-93ed-d580eeb72236" (UID: "90cc2539-6199-4d42-93ed-d580eeb72236"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:59:25.147276 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.147248    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90cc2539-6199-4d42-93ed-d580eeb72236" (UID: "90cc2539-6199-4d42-93ed-d580eeb72236"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:25.147438 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.147307    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-istio-token" (OuterVolumeSpecName: "istio-token") pod "90cc2539-6199-4d42-93ed-d580eeb72236" (UID: "90cc2539-6199-4d42-93ed-d580eeb72236"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:59:25.147714 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.147694    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90cc2539-6199-4d42-93ed-d580eeb72236-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90cc2539-6199-4d42-93ed-d580eeb72236" (UID: "90cc2539-6199-4d42-93ed-d580eeb72236"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:59:25.147714 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.147701    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-kube-api-access-v4t9q" (OuterVolumeSpecName: "kube-api-access-v4t9q") pod "90cc2539-6199-4d42-93ed-d580eeb72236" (UID: "90cc2539-6199-4d42-93ed-d580eeb72236"). InnerVolumeSpecName "kube-api-access-v4t9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:59:25.246133 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.246103    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:25.246133 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.246130    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:25.246283 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.246144    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90cc2539-6199-4d42-93ed-d580eeb72236-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:25.246283 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.246157    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4t9q\" (UniqueName: \"kubernetes.io/projected/90cc2539-6199-4d42-93ed-d580eeb72236-kube-api-access-v4t9q\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:25.246283 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.246169    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90cc2539-6199-4d42-93ed-d580eeb72236-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:25.246283 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:25.246182    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90cc2539-6199-4d42-93ed-d580eeb72236-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:26.012440 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:26.012409    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"
Sep 16 13:59:26.012440 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:26.012434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x" event={"ID":"90cc2539-6199-4d42-93ed-d580eeb72236","Type":"ContainerDied","Data":"a85e8317f2e88ff6b5a10a2785b24761b6fb9d0a315aafb89e67bd5e32d02426"}
Sep 16 13:59:26.012918 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:26.012487    2563 scope.go:117] "RemoveContainer" containerID="a93c5973bfd92cd938b6d34dbda42fdd35b9e4a488f3d1e6e3f63295d4bf5a2e"
Sep 16 13:59:26.043511 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:26.043490    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"]
Sep 16 13:59:26.062122 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:26.062095    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4fa336-openshift-default-685f7d4bbd-c8t8x"]
Sep 16 13:59:27.217832 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.217808    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" path="/var/lib/kubelet/pods/90cc2539-6199-4d42-93ed-d580eeb72236/volumes"
Sep 16 13:59:27.445549 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.445520    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:59:27.567547 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567475    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-istio-token\") pod \"fbb63975-a64e-4b22-a087-674e20ba3294\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") "
Sep 16 13:59:27.567547 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-certs\") pod \"fbb63975-a64e-4b22-a087-674e20ba3294\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") "
Sep 16 13:59:27.567760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567579    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb63975-a64e-4b22-a087-674e20ba3294-istiod-ca-cert\") pod \"fbb63975-a64e-4b22-a087-674e20ba3294\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") "
Sep 16 13:59:27.567760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567607    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndcpm\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-kube-api-access-ndcpm\") pod \"fbb63975-a64e-4b22-a087-674e20ba3294\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") "
Sep 16 13:59:27.567760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567670    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-socket\") pod \"fbb63975-a64e-4b22-a087-674e20ba3294\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") "
Sep 16 13:59:27.567760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567708    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-envoy\") pod \"fbb63975-a64e-4b22-a087-674e20ba3294\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") "
Sep 16 13:59:27.567760 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567734    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb63975-a64e-4b22-a087-674e20ba3294-istio-podinfo\") pod \"fbb63975-a64e-4b22-a087-674e20ba3294\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") "
Sep 16 13:59:27.568072 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567775    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-credential-socket\") pod \"fbb63975-a64e-4b22-a087-674e20ba3294\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") "
Sep 16 13:59:27.568072 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567825    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-data\") pod \"fbb63975-a64e-4b22-a087-674e20ba3294\" (UID: \"fbb63975-a64e-4b22-a087-674e20ba3294\") "
Sep 16 13:59:27.568072 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567871    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbb63975-a64e-4b22-a087-674e20ba3294" (UID: "fbb63975-a64e-4b22-a087-674e20ba3294"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:27.568072 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567946    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbb63975-a64e-4b22-a087-674e20ba3294" (UID: "fbb63975-a64e-4b22-a087-674e20ba3294"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:27.568072 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.567958    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbb63975-a64e-4b22-a087-674e20ba3294-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbb63975-a64e-4b22-a087-674e20ba3294" (UID: "fbb63975-a64e-4b22-a087-674e20ba3294"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:59:27.568276 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.568118    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbb63975-a64e-4b22-a087-674e20ba3294" (UID: "fbb63975-a64e-4b22-a087-674e20ba3294"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:27.568276 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.568146    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbb63975-a64e-4b22-a087-674e20ba3294" (UID: "fbb63975-a64e-4b22-a087-674e20ba3294"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:27.568276 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.568259    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb63975-a64e-4b22-a087-674e20ba3294-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:27.568440 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.568281    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:27.568440 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.568293    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:27.568440 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.568307    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:27.568440 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.568319    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:27.570149 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.570123    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbb63975-a64e-4b22-a087-674e20ba3294-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbb63975-a64e-4b22-a087-674e20ba3294" (UID: "fbb63975-a64e-4b22-a087-674e20ba3294"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:59:27.570245 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.570123    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbb63975-a64e-4b22-a087-674e20ba3294" (UID: "fbb63975-a64e-4b22-a087-674e20ba3294"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:27.570476 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.570451    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbb63975-a64e-4b22-a087-674e20ba3294" (UID: "fbb63975-a64e-4b22-a087-674e20ba3294"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:59:27.570583 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.570451    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-kube-api-access-ndcpm" (OuterVolumeSpecName: "kube-api-access-ndcpm") pod "fbb63975-a64e-4b22-a087-674e20ba3294" (UID: "fbb63975-a64e-4b22-a087-674e20ba3294"). InnerVolumeSpecName "kube-api-access-ndcpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:59:27.669086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.669058    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb63975-a64e-4b22-a087-674e20ba3294-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:27.669086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.669082    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb63975-a64e-4b22-a087-674e20ba3294-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:27.669086 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.669092    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:27.669286 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:27.669100    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndcpm\" (UniqueName: \"kubernetes.io/projected/fbb63975-a64e-4b22-a087-674e20ba3294-kube-api-access-ndcpm\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:28.026226 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.026178    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbb63975-a64e-4b22-a087-674e20ba3294" containerID="5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d" exitCode=0
Sep 16 13:59:28.026226 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.026223    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"
Sep 16 13:59:28.026452 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.026248    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" event={"ID":"fbb63975-a64e-4b22-a087-674e20ba3294","Type":"ContainerDied","Data":"5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d"}
Sep 16 13:59:28.026452 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.026334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz" event={"ID":"fbb63975-a64e-4b22-a087-674e20ba3294","Type":"ContainerDied","Data":"39fc9bfb491f4c7581ccefed295025c58ef423832a792de7a0287107cc8b9d1d"}
Sep 16 13:59:28.026452 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.026358    2563 scope.go:117] "RemoveContainer" containerID="5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d"
Sep 16 13:59:28.036323 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.036305    2563 scope.go:117] "RemoveContainer" containerID="576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962"
Sep 16 13:59:28.047725 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.047515    2563 scope.go:117] "RemoveContainer" containerID="5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d"
Sep 16 13:59:28.048344 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:59:28.048265    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d\": container with ID starting with 5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d not found: ID does not exist" containerID="5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d"
Sep 16 13:59:28.048344 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.048305    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d"} err="failed to get container status \"5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d\": rpc error: code = NotFound desc = could not find container \"5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d\": container with ID starting with 5e02e7fccb57282d939cb460e89319b00f1db6b1e8426708e370d894c0fec31d not found: ID does not exist"
Sep 16 13:59:28.048344 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.048329    2563 scope.go:117] "RemoveContainer" containerID="576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962"
Sep 16 13:59:28.049502 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:59:28.049460    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962\": container with ID starting with 576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962 not found: ID does not exist" containerID="576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962"
Sep 16 13:59:28.049660 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.049496    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962"} err="failed to get container status \"576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962\": rpc error: code = NotFound desc = could not find container \"576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962\": container with ID starting with 576ce5c9412d641c8d79b543ed4614f4aa41e1e1a0069d88657b9d328ed03962 not found: ID does not exist"
Sep 16 13:59:28.051287 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.051268    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"]
Sep 16 13:59:28.053254 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:28.053232    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-fc8c65-openshift-default-54d59b494b-9jmnz"]
Sep 16 13:59:29.218354 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:29.218320    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" path="/var/lib/kubelet/pods/fbb63975-a64e-4b22-a087-674e20ba3294/volumes"
Sep 16 13:59:30.621893 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:30.621865    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"]
Sep 16 13:59:30.622366 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:30.622088    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg" podUID="9b97e72e-3139-4adb-bac6-6861167bf197" containerName="maas-api" containerID="cri-o://e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330" gracePeriod=30
Sep 16 13:59:30.877576 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:30.877510    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:59:30.998445 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:30.998412    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b97e72e-3139-4adb-bac6-6861167bf197-openshift-service-ca\") pod \"9b97e72e-3139-4adb-bac6-6861167bf197\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") "
Sep 16 13:59:30.998625 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:30.998522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9t9h\" (UniqueName: \"kubernetes.io/projected/9b97e72e-3139-4adb-bac6-6861167bf197-kube-api-access-j9t9h\") pod \"9b97e72e-3139-4adb-bac6-6861167bf197\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") "
Sep 16 13:59:30.998625 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:30.998559    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-maas-api-tls\") pod \"9b97e72e-3139-4adb-bac6-6861167bf197\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") "
Sep 16 13:59:30.998744 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:30.998694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-metrics-certs\") pod \"9b97e72e-3139-4adb-bac6-6861167bf197\" (UID: \"9b97e72e-3139-4adb-bac6-6861167bf197\") "
Sep 16 13:59:30.998744 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:30.998734    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b97e72e-3139-4adb-bac6-6861167bf197-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b97e72e-3139-4adb-bac6-6861167bf197" (UID: "9b97e72e-3139-4adb-bac6-6861167bf197"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:59:30.999052 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:30.999036    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b97e72e-3139-4adb-bac6-6861167bf197-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:31.000669 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.000643    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b97e72e-3139-4adb-bac6-6861167bf197-kube-api-access-j9t9h" (OuterVolumeSpecName: "kube-api-access-j9t9h") pod "9b97e72e-3139-4adb-bac6-6861167bf197" (UID: "9b97e72e-3139-4adb-bac6-6861167bf197"). InnerVolumeSpecName "kube-api-access-j9t9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:59:31.000768 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.000726    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9b97e72e-3139-4adb-bac6-6861167bf197" (UID: "9b97e72e-3139-4adb-bac6-6861167bf197"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:59:31.000812 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.000775    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b97e72e-3139-4adb-bac6-6861167bf197" (UID: "9b97e72e-3139-4adb-bac6-6861167bf197"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:59:31.044953 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.044921    2563 generic.go:356] "Generic (PLEG): container finished" podID="9b97e72e-3139-4adb-bac6-6861167bf197" containerID="e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330" exitCode=0
Sep 16 13:59:31.045104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.044964    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"
Sep 16 13:59:31.045104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.045014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg" event={"ID":"9b97e72e-3139-4adb-bac6-6861167bf197","Type":"ContainerDied","Data":"e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330"}
Sep 16 13:59:31.045104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.045062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg" event={"ID":"9b97e72e-3139-4adb-bac6-6861167bf197","Type":"ContainerDied","Data":"7f82ee63a52d25fa7cab56bffe8b19ef666fe011878fdac2f5cb84ddd7a347b1"}
Sep 16 13:59:31.045104 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.045083    2563 scope.go:117] "RemoveContainer" containerID="e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330"
Sep 16 13:59:31.054682 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.054662    2563 scope.go:117] "RemoveContainer" containerID="e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330"
Sep 16 13:59:31.054991 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:59:31.054974    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330\": container with ID starting with e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330 not found: ID does not exist" containerID="e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330"
Sep 16 13:59:31.055042 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.054998    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330"} err="failed to get container status \"e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330\": rpc error: code = NotFound desc = could not find container \"e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330\": container with ID starting with e7969f0af0bddb745b0a39447eb9385b699f375734cab864f71689ba84e7d330 not found: ID does not exist"
Sep 16 13:59:31.065750 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.065730    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"]
Sep 16 13:59:31.069391 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.069358    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-284b60-5768d58df9-5n6mg"]
Sep 16 13:59:31.100545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.100518    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9t9h\" (UniqueName: \"kubernetes.io/projected/9b97e72e-3139-4adb-bac6-6861167bf197-kube-api-access-j9t9h\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:31.100545 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.100542    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:31.100669 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.100556    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b97e72e-3139-4adb-bac6-6861167bf197-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:31.217324 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:31.217252    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b97e72e-3139-4adb-bac6-6861167bf197" path="/var/lib/kubelet/pods/9b97e72e-3139-4adb-bac6-6861167bf197/volumes"
Sep 16 13:59:41.645461 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:41.645428    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"]
Sep 16 13:59:56.669222 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:56.669187    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2" podUID="33637950-a44f-4062-9044-920904b37c3a" containerName="main" containerID="cri-o://497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4" gracePeriod=45
Sep 16 13:59:56.673292 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:56.673249    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2" podUID="33637950-a44f-4062-9044-920904b37c3a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": read tcp 10.134.0.2:57414->10.134.0.65:8000: read: connection reset by peer"
Sep 16 13:59:56.913872 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:56.913847    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:59:57.060741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.060657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-dshm\") pod \"33637950-a44f-4062-9044-920904b37c3a\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") "
Sep 16 13:59:57.060741 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.060718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-home\") pod \"33637950-a44f-4062-9044-920904b37c3a\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") "
Sep 16 13:59:57.060947 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.060774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-tmp-dir\") pod \"33637950-a44f-4062-9044-920904b37c3a\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") "
Sep 16 13:59:57.060947 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.060847    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-model-cache\") pod \"33637950-a44f-4062-9044-920904b37c3a\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") "
Sep 16 13:59:57.060947 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.060876    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33637950-a44f-4062-9044-920904b37c3a-tls-certs\") pod \"33637950-a44f-4062-9044-920904b37c3a\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") "
Sep 16 13:59:57.060947 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.060917    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42hmx\" (UniqueName: \"kubernetes.io/projected/33637950-a44f-4062-9044-920904b37c3a-kube-api-access-42hmx\") pod \"33637950-a44f-4062-9044-920904b37c3a\" (UID: \"33637950-a44f-4062-9044-920904b37c3a\") "
Sep 16 13:59:57.061139 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.061041    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33637950-a44f-4062-9044-920904b37c3a" (UID: "33637950-a44f-4062-9044-920904b37c3a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:57.061139 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.061062    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-model-cache" (OuterVolumeSpecName: "model-cache") pod "33637950-a44f-4062-9044-920904b37c3a" (UID: "33637950-a44f-4062-9044-920904b37c3a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:57.061139 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.061027    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-home" (OuterVolumeSpecName: "home") pod "33637950-a44f-4062-9044-920904b37c3a" (UID: "33637950-a44f-4062-9044-920904b37c3a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:57.061318 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.061214    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-model-cache\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:57.061318 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.061231    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-home\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:57.061318 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.061243    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-tmp-dir\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:57.063161 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.063119    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-dshm" (OuterVolumeSpecName: "dshm") pod "33637950-a44f-4062-9044-920904b37c3a" (UID: "33637950-a44f-4062-9044-920904b37c3a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:59:57.063161 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.063136    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33637950-a44f-4062-9044-920904b37c3a-kube-api-access-42hmx" (OuterVolumeSpecName: "kube-api-access-42hmx") pod "33637950-a44f-4062-9044-920904b37c3a" (UID: "33637950-a44f-4062-9044-920904b37c3a"). InnerVolumeSpecName "kube-api-access-42hmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:59:57.063161 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.063154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33637950-a44f-4062-9044-920904b37c3a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33637950-a44f-4062-9044-920904b37c3a" (UID: "33637950-a44f-4062-9044-920904b37c3a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:59:57.161891 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.161847    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33637950-a44f-4062-9044-920904b37c3a-tls-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:57.161891 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.161887    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42hmx\" (UniqueName: \"kubernetes.io/projected/33637950-a44f-4062-9044-920904b37c3a-kube-api-access-42hmx\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:57.161891 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.161896    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33637950-a44f-4062-9044-920904b37c3a-dshm\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 13:59:57.187813 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.187786    2563 generic.go:356] "Generic (PLEG): container finished" podID="33637950-a44f-4062-9044-920904b37c3a" containerID="497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4" exitCode=0
Sep 16 13:59:57.187939 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.187831    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"
Sep 16 13:59:57.187939 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.187861    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2" event={"ID":"33637950-a44f-4062-9044-920904b37c3a","Type":"ContainerDied","Data":"497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4"}
Sep 16 13:59:57.187939 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.187906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2" event={"ID":"33637950-a44f-4062-9044-920904b37c3a","Type":"ContainerDied","Data":"5574efef78646a07e440ac9b938cdc7a9242a6512e683955b5dbaeefd370fab4"}
Sep 16 13:59:57.187939 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.187931    2563 scope.go:117] "RemoveContainer" containerID="497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4"
Sep 16 13:59:57.200717 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.200675    2563 scope.go:117] "RemoveContainer" containerID="497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4"
Sep 16 13:59:57.204403 ip-10-0-131-28 kubenswrapper[2563]: E0916 13:59:57.201365    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4\": container with ID starting with 497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4 not found: ID does not exist" containerID="497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4"
Sep 16 13:59:57.204403 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.201439    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4"} err="failed to get container status \"497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4\": rpc error: code = NotFound desc = could not find container \"497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4\": container with ID starting with 497bc954fa022e4dbb03ded788b70b0364b44bca3d83d7154e65a60e3ab6a6c4 not found: ID does not exist"
Sep 16 13:59:57.217903 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.217876    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"]
Sep 16 13:59:57.217903 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:57.217908    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ac8045/auth-test-model-ac8045-kserve-96f886fc9-d2gr2"]
Sep 16 13:59:59.217069 ip-10-0-131-28 kubenswrapper[2563]: I0916 13:59:59.217036    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33637950-a44f-4062-9044-920904b37c3a" path="/var/lib/kubelet/pods/33637950-a44f-4062-9044-920904b37c3a/volumes"
Sep 16 14:02:16.340267 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340235    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"]
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340810    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da85ece8-18fc-4e38-8a10-7432c05bbbca" containerName="payload-pre-processing"
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340832    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da85ece8-18fc-4e38-8a10-7432c05bbbca" containerName="payload-pre-processing"
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340846    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74df5598-030c-4e43-908f-d1b97346dc4e" containerName="main"
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340854    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74df5598-030c-4e43-908f-d1b97346dc4e" containerName="main"
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340873    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46195fb2-2559-496f-93b3-f396ad84afb7" containerName="maas-api"
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340883    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="46195fb2-2559-496f-93b3-f396ad84afb7" containerName="maas-api"
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340894    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy"
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340902    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy"
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340923    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy"
Sep 16 14:02:16.340935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340931    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340950    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b97e72e-3139-4adb-bac6-6861167bf197" containerName="maas-api"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340958    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b97e72e-3139-4adb-bac6-6861167bf197" containerName="maas-api"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340969    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33637950-a44f-4062-9044-920904b37c3a" containerName="main"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.340976    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="33637950-a44f-4062-9044-920904b37c3a" containerName="main"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341001    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341008    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341024    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341031    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341040    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768c6065-5e7b-4435-bacc-e38e80a33219" containerName="maas-api"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341047    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="768c6065-5e7b-4435-bacc-e38e80a33219" containerName="maas-api"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341055    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d31c4d-0c99-4c26-ba7d-5db751b4e972" containerName="payload-processing"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341064    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d31c4d-0c99-4c26-ba7d-5db751b4e972" containerName="payload-processing"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341156    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341166    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="768c6065-5e7b-4435-bacc-e38e80a33219" containerName="maas-api"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341174    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d31c4d-0c99-4c26-ba7d-5db751b4e972" containerName="payload-processing"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341186    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341192    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da85ece8-18fc-4e38-8a10-7432c05bbbca" containerName="payload-pre-processing"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341199    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="33637950-a44f-4062-9044-920904b37c3a" containerName="main"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341208    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="46195fb2-2559-496f-93b3-f396ad84afb7" containerName="maas-api"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341217    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74df5598-030c-4e43-908f-d1b97346dc4e" containerName="main"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341226    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb63975-a64e-4b22-a087-674e20ba3294" containerName="istio-proxy"
Sep 16 14:02:16.341510 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.341234    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b97e72e-3139-4adb-bac6-6861167bf197" containerName="maas-api"
Sep 16 14:02:16.344604 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.344583    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.346629 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.346593    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-2ed470-serving-cert\""
Sep 16 14:02:16.354727 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.354302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"]
Sep 16 14:02:16.392291 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.392249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-metrics-certs\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.392475 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.392335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8874b1-eb73-4aa8-be47-050ffc14d095-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.392475 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.392447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.392595 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.392511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9mh\" (UniqueName: \"kubernetes.io/projected/4d8874b1-eb73-4aa8-be47-050ffc14d095-kube-api-access-kz9mh\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.493441 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.493403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.493631 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.493476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9mh\" (UniqueName: \"kubernetes.io/projected/4d8874b1-eb73-4aa8-be47-050ffc14d095-kube-api-access-kz9mh\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.493631 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:02:16.493484    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-serving-cert: secret "maas-api-e2e-ipp-a-2ed470-serving-cert" not found
Sep 16 14:02:16.493631 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.493533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-metrics-certs\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.493631 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.493579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8874b1-eb73-4aa8-be47-050ffc14d095-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.493631 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:02:16.493611    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-maas-api-tls podName:4d8874b1-eb73-4aa8-be47-050ffc14d095 nodeName:}" failed. No retries permitted until 2026-09-16 14:02:16.993579424 +0000 UTC m=+1746.240457231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-maas-api-tls") pod "maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2" (UID: "4d8874b1-eb73-4aa8-be47-050ffc14d095") : secret "maas-api-e2e-ipp-a-2ed470-serving-cert" not found
Sep 16 14:02:16.494203 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.494178    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8874b1-eb73-4aa8-be47-050ffc14d095-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.496056 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.496030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-metrics-certs\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.511653 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.511620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9mh\" (UniqueName: \"kubernetes.io/projected/4d8874b1-eb73-4aa8-be47-050ffc14d095-kube-api-access-kz9mh\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:16.998271 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:16.998237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:17.001624 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:17.001592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:17.263234 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:17.263084    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:17.538124 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:17.538033    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"]
Sep 16 14:02:17.540534 ip-10-0-131-28 kubenswrapper[2563]: W0916 14:02:17.540509    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8874b1_eb73_4aa8_be47_050ffc14d095.slice/crio-e572ab224b7504b56bf49071d28f3cf8147f724daa0d7f3c96c01dd3bb0443f9 WatchSource:0}: Error finding container e572ab224b7504b56bf49071d28f3cf8147f724daa0d7f3c96c01dd3bb0443f9: Status 404 returned error can't find the container with id e572ab224b7504b56bf49071d28f3cf8147f724daa0d7f3c96c01dd3bb0443f9
Sep 16 14:02:17.541817 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:17.541802    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:02:17.907736 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:17.907695    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2" event={"ID":"4d8874b1-eb73-4aa8-be47-050ffc14d095","Type":"ContainerStarted","Data":"e572ab224b7504b56bf49071d28f3cf8147f724daa0d7f3c96c01dd3bb0443f9"}
Sep 16 14:02:18.913896 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:18.913863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2" event={"ID":"4d8874b1-eb73-4aa8-be47-050ffc14d095","Type":"ContainerStarted","Data":"773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0"}
Sep 16 14:02:18.914391 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:18.913939    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:18.929444 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:18.929396    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2" podStartSLOduration=2.489437053 podStartE2EDuration="2.929357092s" totalImagesPullingTime="439.920039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:02:18.928560737 +0000 UTC m=+1748.175438563" watchObservedRunningTime="2026-09-16 14:02:18.929357092 +0000 UTC m=+1748.176234917"
Sep 16 14:02:24.925152 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:24.925119    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:02:47.140221 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.140184    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"]
Sep 16 14:02:47.141018 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.140994    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cc2539-6199-4d42-93ed-d580eeb72236" containerName="istio-proxy"
Sep 16 14:02:47.144779 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.144753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.146818 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.146784    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-9e8244-serving-cert\""
Sep 16 14:02:47.152507 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.152481    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"]
Sep 16 14:02:47.193776 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.193750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-metrics-certs\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.193945 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.193784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.193945 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.193826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.193945 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.193856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7svg\" (UniqueName: \"kubernetes.io/projected/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-kube-api-access-d7svg\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.294787 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.294750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-metrics-certs\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.294992 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.294791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.294992 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.294882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.294992 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.294953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7svg\" (UniqueName: \"kubernetes.io/projected/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-kube-api-access-d7svg\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.295176 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:02:47.295157    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-serving-cert: secret "maas-api-e2e-ipp-b-9e8244-serving-cert" not found
Sep 16 14:02:47.295281 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:02:47.295261    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-maas-api-tls podName:adf323d6-ec47-4de3-b429-f9dc8fdb0c77 nodeName:}" failed. No retries permitted until 2026-09-16 14:02:47.795237116 +0000 UTC m=+1777.042114938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-maas-api-tls") pod "maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg" (UID: "adf323d6-ec47-4de3-b429-f9dc8fdb0c77") : secret "maas-api-e2e-ipp-b-9e8244-serving-cert" not found
Sep 16 14:02:47.295633 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.295607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.297429 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.297407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-metrics-certs\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.302609 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.302591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7svg\" (UniqueName: \"kubernetes.io/projected/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-kube-api-access-d7svg\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.799618 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.799585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:47.802061 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:47.802036    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:48.060730 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:48.060651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:48.334215 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:48.334191    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"]
Sep 16 14:02:48.336304 ip-10-0-131-28 kubenswrapper[2563]: W0916 14:02:48.336271    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf323d6_ec47_4de3_b429_f9dc8fdb0c77.slice/crio-12a093c36312c4738c5a56f81e0e612c5111aa4fef7756b8226ea8866d2afe94 WatchSource:0}: Error finding container 12a093c36312c4738c5a56f81e0e612c5111aa4fef7756b8226ea8866d2afe94: Status 404 returned error can't find the container with id 12a093c36312c4738c5a56f81e0e612c5111aa4fef7756b8226ea8866d2afe94
Sep 16 14:02:49.072093 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:49.072061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg" event={"ID":"adf323d6-ec47-4de3-b429-f9dc8fdb0c77","Type":"ContainerStarted","Data":"12a093c36312c4738c5a56f81e0e612c5111aa4fef7756b8226ea8866d2afe94"}
Sep 16 14:02:50.080385 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:50.080205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg" event={"ID":"adf323d6-ec47-4de3-b429-f9dc8fdb0c77","Type":"ContainerStarted","Data":"36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f"}
Sep 16 14:02:50.080385 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:50.080316    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:02:50.101469 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:50.101411    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg" podStartSLOduration=1.64452953 podStartE2EDuration="3.101362063s" totalImagesPullingTime="1.456832533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:02:50.097306871 +0000 UTC m=+1779.344184697" watchObservedRunningTime="2026-09-16 14:02:50.101362063 +0000 UTC m=+1779.348239889"
Sep 16 14:02:56.091971 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:02:56.091935    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:03:11.293683 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:11.293654    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 14:03:11.298085 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:11.298063    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 14:03:54.451599 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.451562    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"]
Sep 16 14:03:54.456600 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.456573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.458611 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.458591    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-11bfbd-serving-cert\""
Sep 16 14:03:54.466612 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.466583    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"]
Sep 16 14:03:54.556506 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.556467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.556718 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.556648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8gc8\" (UniqueName: \"kubernetes.io/projected/6b910d26-eca6-4c13-941b-c37972219e8b-kube-api-access-l8gc8\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.556795 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.556745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.556856 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.556823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b910d26-eca6-4c13-941b-c37972219e8b-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.657770 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.657727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.657994 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.657802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gc8\" (UniqueName: \"kubernetes.io/projected/6b910d26-eca6-4c13-941b-c37972219e8b-kube-api-access-l8gc8\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.657994 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.657862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.657994 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.657923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b910d26-eca6-4c13-941b-c37972219e8b-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.658584 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.658559    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b910d26-eca6-4c13-941b-c37972219e8b-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.660449 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.660423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.660539 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.660465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.665208 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.665187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8gc8\" (UniqueName: \"kubernetes.io/projected/6b910d26-eca6-4c13-941b-c37972219e8b-kube-api-access-l8gc8\") pod \"maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:54.769411 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:54.769302    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:55.045580 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:55.042579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"]
Sep 16 14:03:55.046467 ip-10-0-131-28 kubenswrapper[2563]: W0916 14:03:55.046439    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b910d26_eca6_4c13_941b_c37972219e8b.slice/crio-b4993197da3c7f4043132a7adfb73b72c070b86ba81207a9f6842dbddc268c12 WatchSource:0}: Error finding container b4993197da3c7f4043132a7adfb73b72c070b86ba81207a9f6842dbddc268c12: Status 404 returned error can't find the container with id b4993197da3c7f4043132a7adfb73b72c070b86ba81207a9f6842dbddc268c12
Sep 16 14:03:55.431158 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:55.431124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd" event={"ID":"6b910d26-eca6-4c13-941b-c37972219e8b","Type":"ContainerStarted","Data":"b4993197da3c7f4043132a7adfb73b72c070b86ba81207a9f6842dbddc268c12"}
Sep 16 14:03:56.438805 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:56.438763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd" event={"ID":"6b910d26-eca6-4c13-941b-c37972219e8b","Type":"ContainerStarted","Data":"c734b05c49ae2a6239d3686a83b475a44301325512cff5fe10d3eb1bc3e5ddcb"}
Sep 16 14:03:56.439230 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:56.438914    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:03:56.454887 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:03:56.454841    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd" podStartSLOduration=2.047083729 podStartE2EDuration="2.454825658s" totalImagesPullingTime="407.741929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:03:56.453368994 +0000 UTC m=+1845.700246816" watchObservedRunningTime="2026-09-16 14:03:56.454825658 +0000 UTC m=+1845.701703483"
Sep 16 14:04:02.450818 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:02.450787    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:04:23.347393 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.347350    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"]
Sep 16 14:04:23.347849 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.347653    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd" podUID="6b910d26-eca6-4c13-941b-c37972219e8b" containerName="maas-api" containerID="cri-o://c734b05c49ae2a6239d3686a83b475a44301325512cff5fe10d3eb1bc3e5ddcb" gracePeriod=30
Sep 16 14:04:23.579613 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.579583    2563 generic.go:356] "Generic (PLEG): container finished" podID="6b910d26-eca6-4c13-941b-c37972219e8b" containerID="c734b05c49ae2a6239d3686a83b475a44301325512cff5fe10d3eb1bc3e5ddcb" exitCode=0
Sep 16 14:04:23.579742 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.579651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd" event={"ID":"6b910d26-eca6-4c13-941b-c37972219e8b","Type":"ContainerDied","Data":"c734b05c49ae2a6239d3686a83b475a44301325512cff5fe10d3eb1bc3e5ddcb"}
Sep 16 14:04:23.597831 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.597772    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:04:23.739365 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.738433    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b910d26-eca6-4c13-941b-c37972219e8b-openshift-service-ca\") pod \"6b910d26-eca6-4c13-941b-c37972219e8b\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") "
Sep 16 14:04:23.739365 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.738482    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-maas-api-tls\") pod \"6b910d26-eca6-4c13-941b-c37972219e8b\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") "
Sep 16 14:04:23.739365 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.738515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-metrics-certs\") pod \"6b910d26-eca6-4c13-941b-c37972219e8b\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") "
Sep 16 14:04:23.739365 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.738665    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8gc8\" (UniqueName: \"kubernetes.io/projected/6b910d26-eca6-4c13-941b-c37972219e8b-kube-api-access-l8gc8\") pod \"6b910d26-eca6-4c13-941b-c37972219e8b\" (UID: \"6b910d26-eca6-4c13-941b-c37972219e8b\") "
Sep 16 14:04:23.739365 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.738838    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b910d26-eca6-4c13-941b-c37972219e8b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b910d26-eca6-4c13-941b-c37972219e8b" (UID: "6b910d26-eca6-4c13-941b-c37972219e8b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:04:23.739365 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.739080    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b910d26-eca6-4c13-941b-c37972219e8b-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:04:23.741981 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.741881    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b910d26-eca6-4c13-941b-c37972219e8b-kube-api-access-l8gc8" (OuterVolumeSpecName: "kube-api-access-l8gc8") pod "6b910d26-eca6-4c13-941b-c37972219e8b" (UID: "6b910d26-eca6-4c13-941b-c37972219e8b"). InnerVolumeSpecName "kube-api-access-l8gc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:04:23.742305 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.742277    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b910d26-eca6-4c13-941b-c37972219e8b" (UID: "6b910d26-eca6-4c13-941b-c37972219e8b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:04:23.743427 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.743391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6b910d26-eca6-4c13-941b-c37972219e8b" (UID: "6b910d26-eca6-4c13-941b-c37972219e8b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:04:23.840037 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.840001    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:04:23.840037 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.840031    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8gc8\" (UniqueName: \"kubernetes.io/projected/6b910d26-eca6-4c13-941b-c37972219e8b-kube-api-access-l8gc8\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:04:23.840037 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:23.840040    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b910d26-eca6-4c13-941b-c37972219e8b-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:04:24.587216 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:24.587185    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"
Sep 16 14:04:24.587656 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:24.587222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd" event={"ID":"6b910d26-eca6-4c13-941b-c37972219e8b","Type":"ContainerDied","Data":"b4993197da3c7f4043132a7adfb73b72c070b86ba81207a9f6842dbddc268c12"}
Sep 16 14:04:24.587656 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:24.587285    2563 scope.go:117] "RemoveContainer" containerID="c734b05c49ae2a6239d3686a83b475a44301325512cff5fe10d3eb1bc3e5ddcb"
Sep 16 14:04:24.609632 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:24.609603    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"]
Sep 16 14:04:24.613500 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:24.613473    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-11bfbd-69494c545f-f8rgd"]
Sep 16 14:04:25.218864 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:25.218822    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b910d26-eca6-4c13-941b-c37972219e8b" path="/var/lib/kubelet/pods/6b910d26-eca6-4c13-941b-c37972219e8b/volumes"
Sep 16 14:04:49.668725 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:49.668630    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"]
Sep 16 14:04:49.669298 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:49.668895    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2" podUID="4d8874b1-eb73-4aa8-be47-050ffc14d095" containerName="maas-api" containerID="cri-o://773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0" gracePeriod=30
Sep 16 14:04:49.929307 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:49.929243    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:04:50.011546 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.011515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-metrics-certs\") pod \"4d8874b1-eb73-4aa8-be47-050ffc14d095\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") "
Sep 16 14:04:50.011730 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.011556    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-maas-api-tls\") pod \"4d8874b1-eb73-4aa8-be47-050ffc14d095\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") "
Sep 16 14:04:50.011730 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.011581    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz9mh\" (UniqueName: \"kubernetes.io/projected/4d8874b1-eb73-4aa8-be47-050ffc14d095-kube-api-access-kz9mh\") pod \"4d8874b1-eb73-4aa8-be47-050ffc14d095\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") "
Sep 16 14:04:50.011730 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.011617    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8874b1-eb73-4aa8-be47-050ffc14d095-openshift-service-ca\") pod \"4d8874b1-eb73-4aa8-be47-050ffc14d095\" (UID: \"4d8874b1-eb73-4aa8-be47-050ffc14d095\") "
Sep 16 14:04:50.012078 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.012051    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8874b1-eb73-4aa8-be47-050ffc14d095-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d8874b1-eb73-4aa8-be47-050ffc14d095" (UID: "4d8874b1-eb73-4aa8-be47-050ffc14d095"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:04:50.013787 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.013757    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4d8874b1-eb73-4aa8-be47-050ffc14d095" (UID: "4d8874b1-eb73-4aa8-be47-050ffc14d095"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:04:50.013890 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.013806    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d8874b1-eb73-4aa8-be47-050ffc14d095-kube-api-access-kz9mh" (OuterVolumeSpecName: "kube-api-access-kz9mh") pod "4d8874b1-eb73-4aa8-be47-050ffc14d095" (UID: "4d8874b1-eb73-4aa8-be47-050ffc14d095"). InnerVolumeSpecName "kube-api-access-kz9mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:04:50.013890 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.013842    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d8874b1-eb73-4aa8-be47-050ffc14d095" (UID: "4d8874b1-eb73-4aa8-be47-050ffc14d095"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:04:50.112713 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.112679    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:04:50.112713 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.112706    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d8874b1-eb73-4aa8-be47-050ffc14d095-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:04:50.112713 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.112715    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz9mh\" (UniqueName: \"kubernetes.io/projected/4d8874b1-eb73-4aa8-be47-050ffc14d095-kube-api-access-kz9mh\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:04:50.112956 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.112727    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8874b1-eb73-4aa8-be47-050ffc14d095-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:04:50.724478 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.724441    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d8874b1-eb73-4aa8-be47-050ffc14d095" containerID="773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0" exitCode=0
Sep 16 14:04:50.724888 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.724487    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"
Sep 16 14:04:50.724888 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.724524    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2" event={"ID":"4d8874b1-eb73-4aa8-be47-050ffc14d095","Type":"ContainerDied","Data":"773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0"}
Sep 16 14:04:50.724888 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.724586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2" event={"ID":"4d8874b1-eb73-4aa8-be47-050ffc14d095","Type":"ContainerDied","Data":"e572ab224b7504b56bf49071d28f3cf8147f724daa0d7f3c96c01dd3bb0443f9"}
Sep 16 14:04:50.724888 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.724614    2563 scope.go:117] "RemoveContainer" containerID="773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0"
Sep 16 14:04:50.736614 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.736592    2563 scope.go:117] "RemoveContainer" containerID="773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0"
Sep 16 14:04:50.736880 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:04:50.736860    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0\": container with ID starting with 773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0 not found: ID does not exist" containerID="773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0"
Sep 16 14:04:50.736925 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.736890    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0"} err="failed to get container status \"773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0\": rpc error: code = NotFound desc = could not find container \"773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0\": container with ID starting with 773de315e1a20410a4eeda3f5bc81e41fdb6c5705b50049e2998fc5eb3dac2b0 not found: ID does not exist"
Sep 16 14:04:50.747855 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.747831    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"]
Sep 16 14:04:50.749771 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:50.749752    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2"]
Sep 16 14:04:51.216546 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:51.216518    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d8874b1-eb73-4aa8-be47-050ffc14d095" path="/var/lib/kubelet/pods/4d8874b1-eb73-4aa8-be47-050ffc14d095/volumes"
Sep 16 14:04:52.919611 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:04:52.919577    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2ed470-686ddd6698-9dws2" podUID="4d8874b1-eb73-4aa8-be47-050ffc14d095" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.69:8443/health\": context deadline exceeded"
Sep 16 14:05:49.006399 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.006074    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"]
Sep 16 14:05:49.006399 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.006315    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg" podUID="adf323d6-ec47-4de3-b429-f9dc8fdb0c77" containerName="maas-api" containerID="cri-o://36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f" gracePeriod=30
Sep 16 14:05:49.272081 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.272021    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:05:49.370172 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.370137    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-openshift-service-ca\") pod \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") "
Sep 16 14:05:49.370172 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.370179    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-metrics-certs\") pod \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") "
Sep 16 14:05:49.370417 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.370288    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7svg\" (UniqueName: \"kubernetes.io/projected/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-kube-api-access-d7svg\") pod \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") "
Sep 16 14:05:49.370417 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.370318    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-maas-api-tls\") pod \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\" (UID: \"adf323d6-ec47-4de3-b429-f9dc8fdb0c77\") "
Sep 16 14:05:49.370580 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.370550    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "adf323d6-ec47-4de3-b429-f9dc8fdb0c77" (UID: "adf323d6-ec47-4de3-b429-f9dc8fdb0c77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:05:49.372516 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.372491    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-kube-api-access-d7svg" (OuterVolumeSpecName: "kube-api-access-d7svg") pod "adf323d6-ec47-4de3-b429-f9dc8fdb0c77" (UID: "adf323d6-ec47-4de3-b429-f9dc8fdb0c77"). InnerVolumeSpecName "kube-api-access-d7svg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:49.372604 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.372546    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "adf323d6-ec47-4de3-b429-f9dc8fdb0c77" (UID: "adf323d6-ec47-4de3-b429-f9dc8fdb0c77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:05:49.372604 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.372564    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "adf323d6-ec47-4de3-b429-f9dc8fdb0c77" (UID: "adf323d6-ec47-4de3-b429-f9dc8fdb0c77"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:05:49.471438 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.471405    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7svg\" (UniqueName: \"kubernetes.io/projected/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-kube-api-access-d7svg\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:05:49.471438 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.471436    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:05:49.471438 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.471445    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:05:49.471673 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:49.471453    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adf323d6-ec47-4de3-b429-f9dc8fdb0c77-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:05:50.045141 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:50.045105    2563 generic.go:356] "Generic (PLEG): container finished" podID="adf323d6-ec47-4de3-b429-f9dc8fdb0c77" containerID="36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f" exitCode=0
Sep 16 14:05:50.045663 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:50.045155    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"
Sep 16 14:05:50.045663 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:50.045192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg" event={"ID":"adf323d6-ec47-4de3-b429-f9dc8fdb0c77","Type":"ContainerDied","Data":"36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f"}
Sep 16 14:05:50.045663 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:50.045260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg" event={"ID":"adf323d6-ec47-4de3-b429-f9dc8fdb0c77","Type":"ContainerDied","Data":"12a093c36312c4738c5a56f81e0e612c5111aa4fef7756b8226ea8866d2afe94"}
Sep 16 14:05:50.045663 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:50.045299    2563 scope.go:117] "RemoveContainer" containerID="36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f"
Sep 16 14:05:50.055274 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:50.055257    2563 scope.go:117] "RemoveContainer" containerID="36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f"
Sep 16 14:05:50.055564 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:05:50.055545    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f\": container with ID starting with 36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f not found: ID does not exist" containerID="36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f"
Sep 16 14:05:50.055627 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:50.055573    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f"} err="failed to get container status \"36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f\": rpc error: code = NotFound desc = could not find container \"36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f\": container with ID starting with 36d605237fa4e136c29f9eccf43a6c0674b62a33fd1d301d5323428973b8e55f not found: ID does not exist"
Sep 16 14:05:50.067681 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:50.067655    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"]
Sep 16 14:05:50.070484 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:50.070463    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9e8244-7c7dcc47bf-jq4gg"]
Sep 16 14:05:51.218409 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:05:51.218361    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf323d6-ec47-4de3-b429-f9dc8fdb0c77" path="/var/lib/kubelet/pods/adf323d6-ec47-4de3-b429-f9dc8fdb0c77/volumes"
Sep 16 14:06:06.299477 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.299362    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"]
Sep 16 14:06:06.300035 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.299639    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt" podUID="ece990f3-8022-43ab-97c9-89615145eaa8" containerName="maas-api" containerID="cri-o://0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153" gracePeriod=30
Sep 16 14:06:06.547505 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.547481    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 14:06:06.630103 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.630073    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-maas-api-tls\") pod \"ece990f3-8022-43ab-97c9-89615145eaa8\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") "
Sep 16 14:06:06.630272 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.630108    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-metrics-certs\") pod \"ece990f3-8022-43ab-97c9-89615145eaa8\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") "
Sep 16 14:06:06.630272 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.630124    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-525lq\" (UniqueName: \"kubernetes.io/projected/ece990f3-8022-43ab-97c9-89615145eaa8-kube-api-access-525lq\") pod \"ece990f3-8022-43ab-97c9-89615145eaa8\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") "
Sep 16 14:06:06.630272 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.630160    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ece990f3-8022-43ab-97c9-89615145eaa8-openshift-service-ca\") pod \"ece990f3-8022-43ab-97c9-89615145eaa8\" (UID: \"ece990f3-8022-43ab-97c9-89615145eaa8\") "
Sep 16 14:06:06.630493 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.630472    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ece990f3-8022-43ab-97c9-89615145eaa8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ece990f3-8022-43ab-97c9-89615145eaa8" (UID: "ece990f3-8022-43ab-97c9-89615145eaa8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:06:06.630598 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.630582    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ece990f3-8022-43ab-97c9-89615145eaa8-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:06.632221 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.632187    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ece990f3-8022-43ab-97c9-89615145eaa8-kube-api-access-525lq" (OuterVolumeSpecName: "kube-api-access-525lq") pod "ece990f3-8022-43ab-97c9-89615145eaa8" (UID: "ece990f3-8022-43ab-97c9-89615145eaa8"). InnerVolumeSpecName "kube-api-access-525lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:06:06.632334 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.632249    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ece990f3-8022-43ab-97c9-89615145eaa8" (UID: "ece990f3-8022-43ab-97c9-89615145eaa8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:06.632334 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.632319    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ece990f3-8022-43ab-97c9-89615145eaa8" (UID: "ece990f3-8022-43ab-97c9-89615145eaa8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:06.732021 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.731980    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:06.732021 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.732007    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece990f3-8022-43ab-97c9-89615145eaa8-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:06.732021 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:06.732016    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-525lq\" (UniqueName: \"kubernetes.io/projected/ece990f3-8022-43ab-97c9-89615145eaa8-kube-api-access-525lq\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:07.132160 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.132130    2563 generic.go:356] "Generic (PLEG): container finished" podID="ece990f3-8022-43ab-97c9-89615145eaa8" containerID="0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153" exitCode=0
Sep 16 14:06:07.132331 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.132186    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"
Sep 16 14:06:07.132331 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.132220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt" event={"ID":"ece990f3-8022-43ab-97c9-89615145eaa8","Type":"ContainerDied","Data":"0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153"}
Sep 16 14:06:07.132331 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.132278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt" event={"ID":"ece990f3-8022-43ab-97c9-89615145eaa8","Type":"ContainerDied","Data":"be9ccb489e3a6be834111fae61c6f4f0e282da42f2909ae467a6f90b6427b951"}
Sep 16 14:06:07.132331 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.132307    2563 scope.go:117] "RemoveContainer" containerID="0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153"
Sep 16 14:06:07.142389 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.142359    2563 scope.go:117] "RemoveContainer" containerID="0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153"
Sep 16 14:06:07.142707 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:06:07.142687    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153\": container with ID starting with 0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153 not found: ID does not exist" containerID="0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153"
Sep 16 14:06:07.142774 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.142718    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153"} err="failed to get container status \"0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153\": rpc error: code = NotFound desc = could not find container \"0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153\": container with ID starting with 0d9952885014075eb69f104dfcd6b14a7414e87f2717a3de5289f6fb3b279153 not found: ID does not exist"
Sep 16 14:06:07.153189 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.153169    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"]
Sep 16 14:06:07.156849 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.156826    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt"]
Sep 16 14:06:07.216586 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:07.216566    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ece990f3-8022-43ab-97c9-89615145eaa8" path="/var/lib/kubelet/pods/ece990f3-8022-43ab-97c9-89615145eaa8/volumes"
Sep 16 14:06:09.483933 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:09.483888    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2284bd-6558f4f667-68srt" podUID="ece990f3-8022-43ab-97c9-89615145eaa8" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.61:8443/health\": context deadline exceeded"
Sep 16 14:06:13.519386 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:13.519341    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"]
Sep 16 14:06:13.520096 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:13.519568    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy" containerID="cri-o://3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8" gracePeriod=30
Sep 16 14:06:18.773460 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.773436    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 14:06:18.847575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847504    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-envoy\") pod \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") "
Sep 16 14:06:18.847575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-podinfo\") pod \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") "
Sep 16 14:06:18.847575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847561    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-credential-socket\") pod \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") "
Sep 16 14:06:18.847834 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847581    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istiod-ca-cert\") pod \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") "
Sep 16 14:06:18.847834 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847607    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-token\") pod \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") "
Sep 16 14:06:18.847834 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847664    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-socket\") pod \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") "
Sep 16 14:06:18.847834 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847715    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-data\") pod \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") "
Sep 16 14:06:18.847834 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847737    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-certs\") pod \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") "
Sep 16 14:06:18.847834 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847791    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6mm5\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-kube-api-access-r6mm5\") pod \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\" (UID: \"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a\") "
Sep 16 14:06:18.848128 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847966    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" (UID: "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:06:18.848128 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847997    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" (UID: "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:06:18.848128 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.847971    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" (UID: "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:06:18.848280 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.848160    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" (UID: "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:06:18.848280 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.848201    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" (UID: "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:06:18.848414 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.848289    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-credential-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:18.848414 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.848308    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istiod-ca-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:18.848414 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.848319    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-socket\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:18.848414 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.848327    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-data\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:18.848414 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.848336    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-workload-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:18.849907 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.849888    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" (UID: "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:06:18.850191 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.850169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-kube-api-access-r6mm5" (OuterVolumeSpecName: "kube-api-access-r6mm5") pod "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" (UID: "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a"). InnerVolumeSpecName "kube-api-access-r6mm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:06:18.850294 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.850274    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" (UID: "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:06:18.850335 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.850287    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" (UID: "6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:06:18.949569 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.949539    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:18.949569 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.949565    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6mm5\" (UniqueName: \"kubernetes.io/projected/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-kube-api-access-r6mm5\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:18.949569 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.949574    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-envoy\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:18.949788 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:18.949584    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a-istio-podinfo\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:19.199517 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.199484    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerID="3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8" exitCode=0
Sep 16 14:06:19.199739 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.199539    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"
Sep 16 14:06:19.199739 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.199573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" event={"ID":"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a","Type":"ContainerDied","Data":"3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8"}
Sep 16 14:06:19.199739 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.199664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp" event={"ID":"6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a","Type":"ContainerDied","Data":"6b6869d2fc931be62fba8e71715fa047e01c2a72e9fc46e488456967b986246f"}
Sep 16 14:06:19.199739 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.199698    2563 scope.go:117] "RemoveContainer" containerID="3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8"
Sep 16 14:06:19.209200 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.209185    2563 scope.go:117] "RemoveContainer" containerID="a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260"
Sep 16 14:06:19.218006 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.217990    2563 scope.go:117] "RemoveContainer" containerID="3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8"
Sep 16 14:06:19.218270 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:06:19.218253    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8\": container with ID starting with 3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8 not found: ID does not exist" containerID="3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8"
Sep 16 14:06:19.218354 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.218280    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8"} err="failed to get container status \"3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8\": rpc error: code = NotFound desc = could not find container \"3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8\": container with ID starting with 3bcb5d09ae860d755ae18434c9fc139b87e9943d549183d705088a4b294d44f8 not found: ID does not exist"
Sep 16 14:06:19.218354 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.218297    2563 scope.go:117] "RemoveContainer" containerID="a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260"
Sep 16 14:06:19.218741 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:06:19.218665    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260\": container with ID starting with a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260 not found: ID does not exist" containerID="a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260"
Sep 16 14:06:19.218741 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.218701    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260"} err="failed to get container status \"a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260\": rpc error: code = NotFound desc = could not find container \"a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260\": container with ID starting with a4777f25b84e274ec2499facd91a26209fc9610e300f727afb6c151f2ba8a260 not found: ID does not exist"
Sep 16 14:06:19.221276 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.221258    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"]
Sep 16 14:06:19.225259 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:19.225240    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2284bd-openshift-default-648f79984d-5mkvp"]
Sep 16 14:06:21.217121 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:21.217080    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" path="/var/lib/kubelet/pods/6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a/volumes"
Sep 16 14:06:24.466489 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.466451    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"]
Sep 16 14:06:24.466956 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.466757    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v" podUID="622c1ac0-0b11-4526-9808-e75c37600c00" containerName="maas-api" containerID="cri-o://4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51" gracePeriod=30
Sep 16 14:06:24.712756 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.712733    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 14:06:24.798332 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.798263    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-metrics-certs\") pod \"622c1ac0-0b11-4526-9808-e75c37600c00\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") "
Sep 16 14:06:24.798332 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.798302    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/622c1ac0-0b11-4526-9808-e75c37600c00-openshift-service-ca\") pod \"622c1ac0-0b11-4526-9808-e75c37600c00\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") "
Sep 16 14:06:24.798542 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.798345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-maas-api-tls\") pod \"622c1ac0-0b11-4526-9808-e75c37600c00\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") "
Sep 16 14:06:24.798542 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.798459    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kmhk\" (UniqueName: \"kubernetes.io/projected/622c1ac0-0b11-4526-9808-e75c37600c00-kube-api-access-2kmhk\") pod \"622c1ac0-0b11-4526-9808-e75c37600c00\" (UID: \"622c1ac0-0b11-4526-9808-e75c37600c00\") "
Sep 16 14:06:24.798716 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.798679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/622c1ac0-0b11-4526-9808-e75c37600c00-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "622c1ac0-0b11-4526-9808-e75c37600c00" (UID: "622c1ac0-0b11-4526-9808-e75c37600c00"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:06:24.798833 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.798815    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/622c1ac0-0b11-4526-9808-e75c37600c00-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:24.800552 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.800524    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "622c1ac0-0b11-4526-9808-e75c37600c00" (UID: "622c1ac0-0b11-4526-9808-e75c37600c00"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:24.800663 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.800602    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "622c1ac0-0b11-4526-9808-e75c37600c00" (UID: "622c1ac0-0b11-4526-9808-e75c37600c00"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:24.800710 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.800690    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/622c1ac0-0b11-4526-9808-e75c37600c00-kube-api-access-2kmhk" (OuterVolumeSpecName: "kube-api-access-2kmhk") pod "622c1ac0-0b11-4526-9808-e75c37600c00" (UID: "622c1ac0-0b11-4526-9808-e75c37600c00"). InnerVolumeSpecName "kube-api-access-2kmhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:06:24.900305 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.900270    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kmhk\" (UniqueName: \"kubernetes.io/projected/622c1ac0-0b11-4526-9808-e75c37600c00-kube-api-access-2kmhk\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:24.900305 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.900297    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:24.900305 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:24.900305    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/622c1ac0-0b11-4526-9808-e75c37600c00-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:06:25.229550 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:25.229518    2563 generic.go:356] "Generic (PLEG): container finished" podID="622c1ac0-0b11-4526-9808-e75c37600c00" containerID="4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51" exitCode=0
Sep 16 14:06:25.229672 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:25.229584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v" event={"ID":"622c1ac0-0b11-4526-9808-e75c37600c00","Type":"ContainerDied","Data":"4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51"}
Sep 16 14:06:25.229672 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:25.229624    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v" event={"ID":"622c1ac0-0b11-4526-9808-e75c37600c00","Type":"ContainerDied","Data":"acf31d386fb84a72c8ccc570d4d60c53d2c5d79c1d86a6703371c583566becb1"}
Sep 16 14:06:25.229672 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:25.229645    2563 scope.go:117] "RemoveContainer" containerID="4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51"
Sep 16 14:06:25.229672 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:25.229578    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"
Sep 16 14:06:25.238437 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:25.238419    2563 scope.go:117] "RemoveContainer" containerID="4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51"
Sep 16 14:06:25.238708 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:06:25.238689    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51\": container with ID starting with 4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51 not found: ID does not exist" containerID="4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51"
Sep 16 14:06:25.238762 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:25.238716    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51"} err="failed to get container status \"4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51\": rpc error: code = NotFound desc = could not find container \"4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51\": container with ID starting with 4936dd1ccf7cd1e8fdeb46f658f588dfc45900d1836827abc960d41aad823f51 not found: ID does not exist"
Sep 16 14:06:25.244859 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:25.244839    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"]
Sep 16 14:06:25.248501 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:25.248479    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ac8045-7fbd97c847-xww7v"]
Sep 16 14:06:27.216812 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:06:27.216779    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="622c1ac0-0b11-4526-9808-e75c37600c00" path="/var/lib/kubelet/pods/622c1ac0-0b11-4526-9808-e75c37600c00/volumes"
Sep 16 14:08:11.326873 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:08:11.326847    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 14:08:11.331941 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:08:11.331920    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 14:09:09.350726 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:09.350645    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"]
Sep 16 14:09:09.351195 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:09.350908    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9" podUID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" containerName="manager" containerID="cri-o://1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb" gracePeriod=10
Sep 16 14:09:09.905909 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:09.905881    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 14:09:10.016152 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.016065    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c61cef-8fa3-41fb-a2f7-e6e240432171-extensions-socket-volume\") pod \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\" (UID: \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\") "
Sep 16 14:09:10.016311 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.016216    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvgtn\" (UniqueName: \"kubernetes.io/projected/e3c61cef-8fa3-41fb-a2f7-e6e240432171-kube-api-access-lvgtn\") pod \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\" (UID: \"e3c61cef-8fa3-41fb-a2f7-e6e240432171\") "
Sep 16 14:09:10.016531 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.016502    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c61cef-8fa3-41fb-a2f7-e6e240432171-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e3c61cef-8fa3-41fb-a2f7-e6e240432171" (UID: "e3c61cef-8fa3-41fb-a2f7-e6e240432171"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:09:10.018500 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.018478    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3c61cef-8fa3-41fb-a2f7-e6e240432171-kube-api-access-lvgtn" (OuterVolumeSpecName: "kube-api-access-lvgtn") pod "e3c61cef-8fa3-41fb-a2f7-e6e240432171" (UID: "e3c61cef-8fa3-41fb-a2f7-e6e240432171"). InnerVolumeSpecName "kube-api-access-lvgtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:09:10.036131 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.036105    2563 generic.go:356] "Generic (PLEG): container finished" podID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" containerID="1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb" exitCode=0
Sep 16 14:09:10.036230 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.036144    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"
Sep 16 14:09:10.036230 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.036158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9" event={"ID":"e3c61cef-8fa3-41fb-a2f7-e6e240432171","Type":"ContainerDied","Data":"1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb"}
Sep 16 14:09:10.036230 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.036203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9" event={"ID":"e3c61cef-8fa3-41fb-a2f7-e6e240432171","Type":"ContainerDied","Data":"94fb58a45a046311d24fe311419f09c93416f4bd95ab5ea22b19514759f60860"}
Sep 16 14:09:10.036230 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.036228    2563 scope.go:117] "RemoveContainer" containerID="1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb"
Sep 16 14:09:10.045397 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.045357    2563 scope.go:117] "RemoveContainer" containerID="ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7"
Sep 16 14:09:10.053059 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.053041    2563 scope.go:117] "RemoveContainer" containerID="1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb"
Sep 16 14:09:10.053295 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:09:10.053276    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb\": container with ID starting with 1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb not found: ID does not exist" containerID="1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb"
Sep 16 14:09:10.053344 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.053304    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb"} err="failed to get container status \"1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb\": rpc error: code = NotFound desc = could not find container \"1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb\": container with ID starting with 1183055d6dde83d215e562efd5476677ef9f8a94550418c1b68bb5f65480a4fb not found: ID does not exist"
Sep 16 14:09:10.053344 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.053319    2563 scope.go:117] "RemoveContainer" containerID="ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7"
Sep 16 14:09:10.053559 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:09:10.053540    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7\": container with ID starting with ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7 not found: ID does not exist" containerID="ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7"
Sep 16 14:09:10.053615 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.053569    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7"} err="failed to get container status \"ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7\": rpc error: code = NotFound desc = could not find container \"ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7\": container with ID starting with ddf4636c518c19c7190cceb064ed8131ec6e7c0c55730a989a7be34e2425d2b7 not found: ID does not exist"
Sep 16 14:09:10.057311 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.057287    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"]
Sep 16 14:09:10.063267 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.063249    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-8cfs9"]
Sep 16 14:09:10.117147 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.117123    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvgtn\" (UniqueName: \"kubernetes.io/projected/e3c61cef-8fa3-41fb-a2f7-e6e240432171-kube-api-access-lvgtn\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:09:10.117230 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:10.117150    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c61cef-8fa3-41fb-a2f7-e6e240432171-extensions-socket-volume\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:09:11.217366 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:09:11.217327    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" path="/var/lib/kubelet/pods/e3c61cef-8fa3-41fb-a2f7-e6e240432171/volumes"
Sep 16 14:10:10.065053 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065019    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"]
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065419    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b910d26-eca6-4c13-941b-c37972219e8b" containerName="maas-api"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065431    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b910d26-eca6-4c13-941b-c37972219e8b" containerName="maas-api"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065439    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ece990f3-8022-43ab-97c9-89615145eaa8" containerName="maas-api"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065444    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece990f3-8022-43ab-97c9-89615145eaa8" containerName="maas-api"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065451    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8874b1-eb73-4aa8-be47-050ffc14d095" containerName="maas-api"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065457    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8874b1-eb73-4aa8-be47-050ffc14d095" containerName="maas-api"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065464    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="622c1ac0-0b11-4526-9808-e75c37600c00" containerName="maas-api"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065469    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="622c1ac0-0b11-4526-9808-e75c37600c00" containerName="maas-api"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065478    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" containerName="manager"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065483    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" containerName="manager"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065491    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065495    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy"
Sep 16 14:10:10.065495 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065501    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" containerName="manager"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065506    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" containerName="manager"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065512    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065517    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065522    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf323d6-ec47-4de3-b429-f9dc8fdb0c77" containerName="maas-api"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065528    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf323d6-ec47-4de3-b429-f9dc8fdb0c77" containerName="maas-api"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065587    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ece990f3-8022-43ab-97c9-89615145eaa8" containerName="maas-api"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065595    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b910d26-eca6-4c13-941b-c37972219e8b" containerName="maas-api"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065604    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="622c1ac0-0b11-4526-9808-e75c37600c00" containerName="maas-api"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065608    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf323d6-ec47-4de3-b429-f9dc8fdb0c77" containerName="maas-api"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065613    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" containerName="manager"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065618    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3c61cef-8fa3-41fb-a2f7-e6e240432171" containerName="manager"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065624    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d8874b1-eb73-4aa8-be47-050ffc14d095" containerName="maas-api"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065628    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy"
Sep 16 14:10:10.065897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.065633    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f0c5c5e-e938-46e4-ba0a-4bfb6baa0f9a" containerName="istio-proxy"
Sep 16 14:10:10.068900 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.068883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:10:10.071664 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.071625    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 14:10:10.071664 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.071643    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ldzgv\""
Sep 16 14:10:10.071858 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.071671    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 14:10:10.079719 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.079697    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"]
Sep 16 14:10:10.256132 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.256091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csqlk\" (UniqueName: \"kubernetes.io/projected/e8e26cf9-6303-4d2d-aee7-56caad2a3258-kube-api-access-csqlk\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dgttp\" (UID: \"e8e26cf9-6303-4d2d-aee7-56caad2a3258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:10:10.256311 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.256211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8e26cf9-6303-4d2d-aee7-56caad2a3258-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dgttp\" (UID: \"e8e26cf9-6303-4d2d-aee7-56caad2a3258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:10:10.357414 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.357300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8e26cf9-6303-4d2d-aee7-56caad2a3258-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dgttp\" (UID: \"e8e26cf9-6303-4d2d-aee7-56caad2a3258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:10:10.357414 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.357397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csqlk\" (UniqueName: \"kubernetes.io/projected/e8e26cf9-6303-4d2d-aee7-56caad2a3258-kube-api-access-csqlk\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dgttp\" (UID: \"e8e26cf9-6303-4d2d-aee7-56caad2a3258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:10:10.357809 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.357785    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8e26cf9-6303-4d2d-aee7-56caad2a3258-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dgttp\" (UID: \"e8e26cf9-6303-4d2d-aee7-56caad2a3258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:10:10.365635 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.365605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csqlk\" (UniqueName: \"kubernetes.io/projected/e8e26cf9-6303-4d2d-aee7-56caad2a3258-kube-api-access-csqlk\") pod \"kuadrant-operator-controller-manager-5769f99d9f-dgttp\" (UID: \"e8e26cf9-6303-4d2d-aee7-56caad2a3258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:10:10.379427 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.379397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:10:10.662199 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:10.662162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"]
Sep 16 14:10:10.665788 ip-10-0-131-28 kubenswrapper[2563]: W0916 14:10:10.665761    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e26cf9_6303_4d2d_aee7_56caad2a3258.slice/crio-91066890d74cb8e94f1893341ed835a7d65634fd44138750d4c2639d8ef99cb1 WatchSource:0}: Error finding container 91066890d74cb8e94f1893341ed835a7d65634fd44138750d4c2639d8ef99cb1: Status 404 returned error can't find the container with id 91066890d74cb8e94f1893341ed835a7d65634fd44138750d4c2639d8ef99cb1
Sep 16 14:10:11.327795 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:11.327758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp" event={"ID":"e8e26cf9-6303-4d2d-aee7-56caad2a3258","Type":"ContainerStarted","Data":"6ed112238bdef417109d2967023803716f465398fa7e816c19607876e4ae61c6"}
Sep 16 14:10:11.328234 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:11.327818    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp" event={"ID":"e8e26cf9-6303-4d2d-aee7-56caad2a3258","Type":"ContainerStarted","Data":"91066890d74cb8e94f1893341ed835a7d65634fd44138750d4c2639d8ef99cb1"}
Sep 16 14:10:11.328234 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:11.327868    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:10:11.346988 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:11.346938    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp" podStartSLOduration=1.346924465 podStartE2EDuration="1.346924465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:10:11.346706866 +0000 UTC m=+2220.593584690" watchObservedRunningTime="2026-09-16 14:10:11.346924465 +0000 UTC m=+2220.593802289"
Sep 16 14:10:22.335259 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:10:22.335228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-dgttp"
Sep 16 14:11:57.267522 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.267486    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"]
Sep 16 14:11:57.276007 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.275977    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.278844 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.278806    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 14:11:57.278844 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.278816    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 14:11:57.279144 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.278868    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9ljkc\""
Sep 16 14:11:57.279144 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.278879    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 14:11:57.279144 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.279092    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 14:11:57.282437 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.282410    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"]
Sep 16 14:11:57.330898 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.330856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-maas-api-tls\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.331090 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.330945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9271c2bb-ccab-48d0-8337-2530a94c90f3-openshift-service-ca\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.331090 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.330978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5rc8\" (UniqueName: \"kubernetes.io/projected/9271c2bb-ccab-48d0-8337-2530a94c90f3-kube-api-access-t5rc8\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.331090 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.331003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-metrics-certs\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.432120 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.432078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-maas-api-tls\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.432336 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.432131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9271c2bb-ccab-48d0-8337-2530a94c90f3-openshift-service-ca\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.432336 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.432153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rc8\" (UniqueName: \"kubernetes.io/projected/9271c2bb-ccab-48d0-8337-2530a94c90f3-kube-api-access-t5rc8\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.432336 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.432174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-metrics-certs\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.432895 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.432868    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9271c2bb-ccab-48d0-8337-2530a94c90f3-openshift-service-ca\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.434838 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.434818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-metrics-certs\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.434924 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.434864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-maas-api-tls\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.439443 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.439421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5rc8\" (UniqueName: \"kubernetes.io/projected/9271c2bb-ccab-48d0-8337-2530a94c90f3-kube-api-access-t5rc8\") pod \"maas-api-67c45f647d-llgtk\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") " pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.589066 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.588970    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:57.860990 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.860966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"]
Sep 16 14:11:57.862950 ip-10-0-131-28 kubenswrapper[2563]: W0916 14:11:57.862911    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9271c2bb_ccab_48d0_8337_2530a94c90f3.slice/crio-84d04d4c47f7607d67cdea39ae9d2efa238123978eb1e4e6165094441af15d47 WatchSource:0}: Error finding container 84d04d4c47f7607d67cdea39ae9d2efa238123978eb1e4e6165094441af15d47: Status 404 returned error can't find the container with id 84d04d4c47f7607d67cdea39ae9d2efa238123978eb1e4e6165094441af15d47
Sep 16 14:11:57.864352 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:57.864333    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:11:58.854214 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:58.854174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk" event={"ID":"9271c2bb-ccab-48d0-8337-2530a94c90f3","Type":"ContainerStarted","Data":"84d04d4c47f7607d67cdea39ae9d2efa238123978eb1e4e6165094441af15d47"}
Sep 16 14:11:59.860980 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:59.860889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk" event={"ID":"9271c2bb-ccab-48d0-8337-2530a94c90f3","Type":"ContainerStarted","Data":"5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d"}
Sep 16 14:11:59.861348 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:59.860991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:11:59.879609 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:11:59.879552    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk" podStartSLOduration=1.268283237 podStartE2EDuration="2.879535967s" totalImagesPullingTime="1.61125273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:11:59.877031542 +0000 UTC m=+2329.123909383" watchObservedRunningTime="2026-09-16 14:11:59.879535967 +0000 UTC m=+2329.126413792"
Sep 16 14:12:05.872305 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:05.872221    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:12:06.451550 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.451508    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"]
Sep 16 14:12:06.455288 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.455266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.463942 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.463907    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"]
Sep 16 14:12:06.513762 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.513726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7896d16d-7a1e-42be-975a-d2792461e96d-openshift-service-ca\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.513935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.513809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7896d16d-7a1e-42be-975a-d2792461e96d-maas-api-tls\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.513935 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.513910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7896d16d-7a1e-42be-975a-d2792461e96d-metrics-certs\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.514033 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.513945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqfw2\" (UniqueName: \"kubernetes.io/projected/7896d16d-7a1e-42be-975a-d2792461e96d-kube-api-access-vqfw2\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.615263 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.615223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7896d16d-7a1e-42be-975a-d2792461e96d-metrics-certs\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.615263 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.615269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqfw2\" (UniqueName: \"kubernetes.io/projected/7896d16d-7a1e-42be-975a-d2792461e96d-kube-api-access-vqfw2\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.615557 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.615427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7896d16d-7a1e-42be-975a-d2792461e96d-openshift-service-ca\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.615557 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.615540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7896d16d-7a1e-42be-975a-d2792461e96d-maas-api-tls\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.616014 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.615986    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7896d16d-7a1e-42be-975a-d2792461e96d-openshift-service-ca\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.617874 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.617853    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7896d16d-7a1e-42be-975a-d2792461e96d-metrics-certs\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.617980 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.617929    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7896d16d-7a1e-42be-975a-d2792461e96d-maas-api-tls\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.622459 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.622437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqfw2\" (UniqueName: \"kubernetes.io/projected/7896d16d-7a1e-42be-975a-d2792461e96d-kube-api-access-vqfw2\") pod \"maas-api-85fc744486-4mqk6\" (UID: \"7896d16d-7a1e-42be-975a-d2792461e96d\") " pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:06.766322 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:06.766241    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:07.038195 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:07.038136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"]
Sep 16 14:12:07.040540 ip-10-0-131-28 kubenswrapper[2563]: W0916 14:12:07.040513    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7896d16d_7a1e_42be_975a_d2792461e96d.slice/crio-a22cb61e0f243c557d3bc219d4990c55d9daa141d0584d6d50aa3036b6e8ed02 WatchSource:0}: Error finding container a22cb61e0f243c557d3bc219d4990c55d9daa141d0584d6d50aa3036b6e8ed02: Status 404 returned error can't find the container with id a22cb61e0f243c557d3bc219d4990c55d9daa141d0584d6d50aa3036b6e8ed02
Sep 16 14:12:07.904506 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:07.904472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6" event={"ID":"7896d16d-7a1e-42be-975a-d2792461e96d","Type":"ContainerStarted","Data":"a22cb61e0f243c557d3bc219d4990c55d9daa141d0584d6d50aa3036b6e8ed02"}
Sep 16 14:12:08.910635 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:08.910594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6" event={"ID":"7896d16d-7a1e-42be-975a-d2792461e96d","Type":"ContainerStarted","Data":"7142af70b58806b32d976d55488a3ba3b4668b26c9a7752cf795afc064df4f27"}
Sep 16 14:12:08.911033 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:08.910690    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:08.927993 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:08.927944    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6" podStartSLOduration=1.712487007 podStartE2EDuration="2.927930924s" totalImagesPullingTime="1.215443917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:12:08.925943276 +0000 UTC m=+2338.172821139" watchObservedRunningTime="2026-09-16 14:12:08.927930924 +0000 UTC m=+2338.174808749"
Sep 16 14:12:14.921415 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:14.921387    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-85fc744486-4mqk6"
Sep 16 14:12:14.965987 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:14.965950    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"]
Sep 16 14:12:14.966255 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:14.966229    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk" podUID="9271c2bb-ccab-48d0-8337-2530a94c90f3" containerName="maas-api" containerID="cri-o://5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d" gracePeriod=30
Sep 16 14:12:15.210335 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.210311    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:12:15.301128 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.301090    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-metrics-certs\") pod \"9271c2bb-ccab-48d0-8337-2530a94c90f3\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") "
Sep 16 14:12:15.301329 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.301138    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5rc8\" (UniqueName: \"kubernetes.io/projected/9271c2bb-ccab-48d0-8337-2530a94c90f3-kube-api-access-t5rc8\") pod \"9271c2bb-ccab-48d0-8337-2530a94c90f3\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") "
Sep 16 14:12:15.301329 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.301195    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-maas-api-tls\") pod \"9271c2bb-ccab-48d0-8337-2530a94c90f3\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") "
Sep 16 14:12:15.301329 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.301249    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9271c2bb-ccab-48d0-8337-2530a94c90f3-openshift-service-ca\") pod \"9271c2bb-ccab-48d0-8337-2530a94c90f3\" (UID: \"9271c2bb-ccab-48d0-8337-2530a94c90f3\") "
Sep 16 14:12:15.301668 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.301639    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9271c2bb-ccab-48d0-8337-2530a94c90f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9271c2bb-ccab-48d0-8337-2530a94c90f3" (UID: "9271c2bb-ccab-48d0-8337-2530a94c90f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:12:15.303512 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.303484    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9271c2bb-ccab-48d0-8337-2530a94c90f3" (UID: "9271c2bb-ccab-48d0-8337-2530a94c90f3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:12:15.303512 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.303491    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9271c2bb-ccab-48d0-8337-2530a94c90f3-kube-api-access-t5rc8" (OuterVolumeSpecName: "kube-api-access-t5rc8") pod "9271c2bb-ccab-48d0-8337-2530a94c90f3" (UID: "9271c2bb-ccab-48d0-8337-2530a94c90f3"). InnerVolumeSpecName "kube-api-access-t5rc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:12:15.303639 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.303561    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9271c2bb-ccab-48d0-8337-2530a94c90f3" (UID: "9271c2bb-ccab-48d0-8337-2530a94c90f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:12:15.402199 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.402158    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-metrics-certs\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:12:15.402199 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.402196    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5rc8\" (UniqueName: \"kubernetes.io/projected/9271c2bb-ccab-48d0-8337-2530a94c90f3-kube-api-access-t5rc8\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:12:15.402445 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.402210    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9271c2bb-ccab-48d0-8337-2530a94c90f3-maas-api-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:12:15.402445 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.402223    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9271c2bb-ccab-48d0-8337-2530a94c90f3-openshift-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\""
Sep 16 14:12:15.946800 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.946762    2563 generic.go:356] "Generic (PLEG): container finished" podID="9271c2bb-ccab-48d0-8337-2530a94c90f3" containerID="5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d" exitCode=0
Sep 16 14:12:15.947267 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.946809    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"
Sep 16 14:12:15.947267 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.946846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk" event={"ID":"9271c2bb-ccab-48d0-8337-2530a94c90f3","Type":"ContainerDied","Data":"5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d"}
Sep 16 14:12:15.947267 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.946893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67c45f647d-llgtk" event={"ID":"9271c2bb-ccab-48d0-8337-2530a94c90f3","Type":"ContainerDied","Data":"84d04d4c47f7607d67cdea39ae9d2efa238123978eb1e4e6165094441af15d47"}
Sep 16 14:12:15.947267 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.946914    2563 scope.go:117] "RemoveContainer" containerID="5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d"
Sep 16 14:12:15.956339 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.956320    2563 scope.go:117] "RemoveContainer" containerID="5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d"
Sep 16 14:12:15.956631 ip-10-0-131-28 kubenswrapper[2563]: E0916 14:12:15.956614    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d\": container with ID starting with 5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d not found: ID does not exist" containerID="5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d"
Sep 16 14:12:15.956686 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.956638    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d"} err="failed to get container status \"5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d\": rpc error: code = NotFound desc = could not find container \"5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d\": container with ID starting with 5a30585ec5adb6d969f05224640a088628866612b14f953d292bf43c7773f72d not found: ID does not exist"
Sep 16 14:12:15.967320 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.967296    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"]
Sep 16 14:12:15.971356 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:15.971334    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-67c45f647d-llgtk"]
Sep 16 14:12:17.216978 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:17.216946    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9271c2bb-ccab-48d0-8337-2530a94c90f3" path="/var/lib/kubelet/pods/9271c2bb-ccab-48d0-8337-2530a94c90f3/volumes"
Sep 16 14:12:33.312210 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:33.312182    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2rfx8_c2a88169-8184-4efa-803d-ee8aa0f53fb4/server/0.log"
Sep 16 14:12:33.431548 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:33.431517    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-r7q6m_c3c776c2-1340-496b-9c2b-54b18235599e/manager/0.log"
Sep 16 14:12:33.805975 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:33.805947    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6444576fdb-zkqqr_9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc/copy-manifests/0.log"
Sep 16 14:12:33.818053 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:33.818028    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6444576fdb-zkqqr_9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc/manager/0.log"
Sep 16 14:12:34.191448 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:34.191415    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-85fc744486-4mqk6_7896d16d-7a1e-42be-975a-d2792461e96d/maas-api/0.log"
Sep 16 14:12:34.420059 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:34.420022    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29826105-fhb6f_e9fd4327-d20a-4e13-8c21-ff792bcaf84a/cleanup/0.log"
Sep 16 14:12:35.915053 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:35.915019    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-dgttp_e8e26cf9-6303-4d2d-aee7-56caad2a3258/manager/0.log"
Sep 16 14:12:36.532122 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:36.532086    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7_324cdf62-32ba-4686-a2db-7429d0c87486/istio-proxy/0.log"
Sep 16 14:12:36.652117 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:36.652087    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q5psz_38d3d4ca-5d76-4e9f-afc5-9a7927f14885/discovery/0.log"
Sep 16 14:12:37.825320 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:37.825293    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-b5s4p_117d6a45-2a88-4803-ba78-b726453bb834/main/0.log"
Sep 16 14:12:37.939333 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:37.939307    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-rhffk_cc2b2d87-8085-4358-a35c-b48b4129512f/main/0.log"
Sep 16 14:12:46.340236 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:46.340179    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gwjjm_5a7b1004-d23b-485b-ab34-ea5d2ec5c0c7/global-pull-secret-syncer/0.log"
Sep 16 14:12:46.482237 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:46.482206    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wm54d_29e45f57-dc70-4421-84d6-65738d7f19fc/konnectivity-agent/0.log"
Sep 16 14:12:46.525822 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:46.525789    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-28.ec2.internal_cbfe9bfbe47f47cb125932644c1fcafa/haproxy/0.log"
Sep 16 14:12:51.689897 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:51.689855    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-dgttp_e8e26cf9-6303-4d2d-aee7-56caad2a3258/manager/0.log"
Sep 16 14:12:53.106461 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.106417    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7cf7aff-4dae-456f-be8e-10a7ffbf3222/alertmanager/0.log"
Sep 16 14:12:53.126597 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.126553    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7cf7aff-4dae-456f-be8e-10a7ffbf3222/config-reloader/0.log"
Sep 16 14:12:53.146677 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.146652    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7cf7aff-4dae-456f-be8e-10a7ffbf3222/kube-rbac-proxy-web/0.log"
Sep 16 14:12:53.165456 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.165341    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7cf7aff-4dae-456f-be8e-10a7ffbf3222/kube-rbac-proxy/0.log"
Sep 16 14:12:53.184596 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.184574    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7cf7aff-4dae-456f-be8e-10a7ffbf3222/kube-rbac-proxy-metric/0.log"
Sep 16 14:12:53.203661 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.203640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7cf7aff-4dae-456f-be8e-10a7ffbf3222/prom-label-proxy/0.log"
Sep 16 14:12:53.227134 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.227106    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7cf7aff-4dae-456f-be8e-10a7ffbf3222/init-config-reloader/0.log"
Sep 16 14:12:53.358504 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.358478    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-756dfbb69d-td6zz_453c77df-ac7b-4682-861e-f46a759a8fcd/metrics-server/0.log"
Sep 16 14:12:53.382994 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.382967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-s8l4p_aec8d5fa-3a05-4f47-9edb-ff4b0e43fb50/monitoring-plugin/0.log"
Sep 16 14:12:53.656660 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.656629    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jsvkm_2c51152c-8d4d-495b-aeba-cf5719ae7952/node-exporter/0.log"
Sep 16 14:12:53.693550 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.693523    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jsvkm_2c51152c-8d4d-495b-aeba-cf5719ae7952/kube-rbac-proxy/0.log"
Sep 16 14:12:53.715122 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.715099    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jsvkm_2c51152c-8d4d-495b-aeba-cf5719ae7952/init-textfile/0.log"
Sep 16 14:12:53.745873 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.745848    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-8vj5v_ae5cbee4-901d-4b22-b411-a7516467548f/kube-rbac-proxy-main/0.log"
Sep 16 14:12:53.774041 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.774017    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-8vj5v_ae5cbee4-901d-4b22-b411-a7516467548f/kube-rbac-proxy-self/0.log"
Sep 16 14:12:53.799645 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.799617    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-8vj5v_ae5cbee4-901d-4b22-b411-a7516467548f/openshift-state-metrics/0.log"
Sep 16 14:12:53.839095 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.839068    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c62cfcd2-0a97-4968-adfe-df8cd0140a11/prometheus/0.log"
Sep 16 14:12:53.861787 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.861761    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c62cfcd2-0a97-4968-adfe-df8cd0140a11/config-reloader/0.log"
Sep 16 14:12:53.886284 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.886263    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c62cfcd2-0a97-4968-adfe-df8cd0140a11/thanos-sidecar/0.log"
Sep 16 14:12:53.908888 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.908818    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c62cfcd2-0a97-4968-adfe-df8cd0140a11/kube-rbac-proxy-web/0.log"
Sep 16 14:12:53.932131 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.932106    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c62cfcd2-0a97-4968-adfe-df8cd0140a11/kube-rbac-proxy/0.log"
Sep 16 14:12:53.955259 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.955231    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c62cfcd2-0a97-4968-adfe-df8cd0140a11/kube-rbac-proxy-thanos/0.log"
Sep 16 14:12:53.975103 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:53.975079    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c62cfcd2-0a97-4968-adfe-df8cd0140a11/init-config-reloader/0.log"
Sep 16 14:12:54.002111 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:54.002062    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-qphfz_ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f/prometheus-operator/0.log"
Sep 16 14:12:54.019735 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:54.019707    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-qphfz_ef8e7e3d-5ada-4c03-83ab-e7ddf7a1362f/kube-rbac-proxy/0.log"
Sep 16 14:12:54.042183 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:54.042149    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-88r8l_4c8e4a19-6c9a-44a1-95f5-a726960cd74d/prometheus-operator-admission-webhook/0.log"
Sep 16 14:12:56.259413 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:56.259364    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 14:12:56.264353 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:56.264334    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/2.log"
Sep 16 14:12:56.817806 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:56.817781    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-mszlq_3561d972-ac2d-4ba0-8a44-ab82ee44527c/download-server/0.log"
Sep 16 14:12:57.076521 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.076444    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"]
Sep 16 14:12:57.076949 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.076930    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9271c2bb-ccab-48d0-8337-2530a94c90f3" containerName="maas-api"
Sep 16 14:12:57.077037 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.076951    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9271c2bb-ccab-48d0-8337-2530a94c90f3" containerName="maas-api"
Sep 16 14:12:57.077118 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.077095    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9271c2bb-ccab-48d0-8337-2530a94c90f3" containerName="maas-api"
Sep 16 14:12:57.080466 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.080446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.082514 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.082495    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6t22r\"/\"kube-root-ca.crt\""
Sep 16 14:12:57.082601 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.082495    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6t22r\"/\"default-dockercfg-qntd4\""
Sep 16 14:12:57.082601 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.082576    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6t22r\"/\"openshift-service-ca.crt\""
Sep 16 14:12:57.088158 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.088137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"]
Sep 16 14:12:57.187803 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.187779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-podres\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.187919 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.187805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-proc\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.187919 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.187833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-sys\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.187919 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.187912    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-lib-modules\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.188037 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.187971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vzq7\" (UniqueName: \"kubernetes.io/projected/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-kube-api-access-2vzq7\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.289150 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.289120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vzq7\" (UniqueName: \"kubernetes.io/projected/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-kube-api-access-2vzq7\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.289575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.289154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-podres\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.289575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.289171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-proc\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.289575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.289199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-sys\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.289575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.289250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-lib-modules\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.289575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.289284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-proc\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.289575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.289303    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-podres\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.289575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.289340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-sys\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.289575 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.289446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-lib-modules\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.296828 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.296809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vzq7\" (UniqueName: \"kubernetes.io/projected/0d0742ae-e740-43b3-8fb1-e125ac9a03f9-kube-api-access-2vzq7\") pod \"perf-node-gather-daemonset-hckjs\" (UID: \"0d0742ae-e740-43b3-8fb1-e125ac9a03f9\") " pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.390917 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.390892    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:57.522481 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.522452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-mxr7x_edd82d9a-5e3c-4edb-a375-c173259b158e/volume-data-source-validator/0.log"
Sep 16 14:12:57.663536 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:57.663450    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"]
Sep 16 14:12:57.670213 ip-10-0-131-28 kubenswrapper[2563]: W0916 14:12:57.670189    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0d0742ae_e740_43b3_8fb1_e125ac9a03f9.slice/crio-697d11943c233a03d4791777997bb25b7a98bf11e4ecb8206f50b8f1133d8e98 WatchSource:0}: Error finding container 697d11943c233a03d4791777997bb25b7a98bf11e4ecb8206f50b8f1133d8e98: Status 404 returned error can't find the container with id 697d11943c233a03d4791777997bb25b7a98bf11e4ecb8206f50b8f1133d8e98
Sep 16 14:12:58.159011 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:58.158971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs" event={"ID":"0d0742ae-e740-43b3-8fb1-e125ac9a03f9","Type":"ContainerStarted","Data":"4369a3b5119f353a85ab28e8c0ae0a4fc5cae0cd9ee76529bcec6d10f0cc38e1"}
Sep 16 14:12:58.159192 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:58.159036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs" event={"ID":"0d0742ae-e740-43b3-8fb1-e125ac9a03f9","Type":"ContainerStarted","Data":"697d11943c233a03d4791777997bb25b7a98bf11e4ecb8206f50b8f1133d8e98"}
Sep 16 14:12:58.159192 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:58.159093    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:12:58.173829 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:58.173776    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs" podStartSLOduration=1.173760007 podStartE2EDuration="1.173760007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:12:58.172796226 +0000 UTC m=+2387.419674052" watchObservedRunningTime="2026-09-16 14:12:58.173760007 +0000 UTC m=+2387.420637880"
Sep 16 14:12:58.600960 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:58.600885    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g2cp9_7e3534a5-1569-4161-8c8d-f1766a07661f/dns/0.log"
Sep 16 14:12:58.623274 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:58.623247    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g2cp9_7e3534a5-1569-4161-8c8d-f1766a07661f/kube-rbac-proxy/0.log"
Sep 16 14:12:58.766155 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:58.766124    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q88zn_2ce2d887-1482-4f90-bfc0-742e2b7a6dc9/dns-node-resolver/0.log"
Sep 16 14:12:59.325713 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:12:59.325680    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dvxnq_6a955d66-0e9e-4f78-b842-e74b42cde550/node-ca/0.log"
Sep 16 14:13:00.381817 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:00.381791    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7_324cdf62-32ba-4686-a2db-7429d0c87486/istio-proxy/0.log"
Sep 16 14:13:00.807824 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:00.807740    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q5psz_38d3d4ca-5d76-4e9f-afc5-9a7927f14885/discovery/0.log"
Sep 16 14:13:01.858350 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:01.858320    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-95t95_6579a61f-e766-47d4-8de5-b4fea959481a/serve-healthcheck-canary/0.log"
Sep 16 14:13:02.352508 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:02.352477    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-jksst_27e26432-9ffc-4fa7-af88-a9ac82242fad/insights-operator/0.log"
Sep 16 14:13:02.353241 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:02.353223    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-jksst_27e26432-9ffc-4fa7-af88-a9ac82242fad/insights-operator/1.log"
Sep 16 14:13:02.441258 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:02.441233    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvbc8_0cb91846-1e86-41fa-8f57-2d028d961b10/kube-rbac-proxy/0.log"
Sep 16 14:13:02.464279 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:02.464258    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvbc8_0cb91846-1e86-41fa-8f57-2d028d961b10/exporter/0.log"
Sep 16 14:13:02.485303 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:02.485283    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvbc8_0cb91846-1e86-41fa-8f57-2d028d961b10/extractor/0.log"
Sep 16 14:13:04.173822 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:04.173796    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6t22r/perf-node-gather-daemonset-hckjs"
Sep 16 14:13:05.023702 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:05.023677    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2rfx8_c2a88169-8184-4efa-803d-ee8aa0f53fb4/server/0.log"
Sep 16 14:13:05.112447 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:05.112417    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-r7q6m_c3c776c2-1340-496b-9c2b-54b18235599e/manager/0.log"
Sep 16 14:13:05.281930 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:05.281856    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6444576fdb-zkqqr_9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc/manager/0.log"
Sep 16 14:13:05.298491 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:05.298464    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6444576fdb-zkqqr_9cab71ed-cfd7-4c88-bd58-ffe4bb3b57dc/copy-manifests/0.log"
Sep 16 14:13:06.526462 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:06.526437    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7_324cdf62-32ba-4686-a2db-7429d0c87486/istio-proxy/0.log"
Sep 16 14:13:06.676880 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:06.676852    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8878d4c7-jbqc6_b3322248-37be-4a7e-92fa-2f360a093770/manager/0.log"
Sep 16 14:13:06.964080 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:06.964044    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q5psz_38d3d4ca-5d76-4e9f-afc5-9a7927f14885/discovery/0.log"
Sep 16 14:13:08.535040 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:08.535009    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7b75d5c99c9lrl7_324cdf62-32ba-4686-a2db-7429d0c87486/istio-proxy/0.log"
Sep 16 14:13:08.970810 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:08.970779    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-q5psz_38d3d4ca-5d76-4e9f-afc5-9a7927f14885/discovery/0.log"
Sep 16 14:13:11.358939 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:11.358833    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 14:13:11.368358 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:11.364952    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cts8d_35c1c44d-b926-4f14-8bfe-d3fea957a5c4/console-operator/1.log"
Sep 16 14:13:11.802827 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:11.802798    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-nwkm2_b00d773f-c5c8-43c3-a261-95602e8175f5/migrator/0.log"
Sep 16 14:13:11.821889 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:11.821863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-nwkm2_b00d773f-c5c8-43c3-a261-95602e8175f5/graceful-termination/0.log"
Sep 16 14:13:13.212054 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.211978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5dh2l_0bbf7553-72a6-4af8-a03b-139fb12cae7e/kube-multus/0.log"
Sep 16 14:13:13.397020 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.396990    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rn9p6_09a12ca6-e32d-43b7-bfa4-ebd942adc292/kube-multus-additional-cni-plugins/0.log"
Sep 16 14:13:13.417554 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.417528    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rn9p6_09a12ca6-e32d-43b7-bfa4-ebd942adc292/egress-router-binary-copy/0.log"
Sep 16 14:13:13.438829 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.438807    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rn9p6_09a12ca6-e32d-43b7-bfa4-ebd942adc292/cni-plugins/0.log"
Sep 16 14:13:13.458633 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.458611    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rn9p6_09a12ca6-e32d-43b7-bfa4-ebd942adc292/bond-cni-plugin/0.log"
Sep 16 14:13:13.478135 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.478076    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rn9p6_09a12ca6-e32d-43b7-bfa4-ebd942adc292/routeoverride-cni/0.log"
Sep 16 14:13:13.496895 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.496877    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rn9p6_09a12ca6-e32d-43b7-bfa4-ebd942adc292/whereabouts-cni-bincopy/0.log"
Sep 16 14:13:13.518548 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.518531    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rn9p6_09a12ca6-e32d-43b7-bfa4-ebd942adc292/whereabouts-cni/0.log"
Sep 16 14:13:13.771216 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.771140    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kmgcm_da1a2822-eac6-413f-a0a4-e0609001d6f6/network-metrics-daemon/0.log"
Sep 16 14:13:13.788847 ip-10-0-131-28 kubenswrapper[2563]: I0916 14:13:13.788826    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kmgcm_da1a2822-eac6-413f-a0a4-e0609001d6f6/kube-rbac-proxy/0.log"