Jul 07 04:22:14.895117 ip-10-0-128-250 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 04:22:14.895128 ip-10-0-128-250 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 04:22:14.895135 ip-10-0-128-250 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 04:22:14.895409 ip-10-0-128-250 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 04:22:25.030731 ip-10-0-128-250 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 04:22:25.030745 ip-10-0-128-250 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6cd7209cd15b47c78944331cf32fe6ca --
Jul 07 04:23:59.992635 ip-10-0-128-250 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.394403    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400430    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400443    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400446    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400450    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400454    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400458    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400461    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 04:24:00.687518 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400463    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 04:24:00.465436 ip-10-0-128-250 systemd[1]: Started Kubernetes Kubelet.
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400467    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400469    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400472    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400475    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400478    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400481    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400483    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400486    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400489    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400492    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400495    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400497    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400500    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400503    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400506    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400508    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400514    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400516    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400519    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 04:24:00.695317 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400521    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400524    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400526    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400529    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400531    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400534    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400536    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400539    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400541    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400544    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400547    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400549    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400551    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400554    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400556    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400558    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400563    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400567    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400570    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 04:24:00.696025 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400574    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400577    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400580    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400584    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400587    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400590    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400592    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400595    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400598    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400600    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400603    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400606    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400608    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400611    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400613    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400616    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400619    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400621    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400624    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400626    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 04:24:00.696808 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400629    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400631    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400634    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400637    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400639    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400641    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400644    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400646    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400649    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400652    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400654    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400657    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400659    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400662    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400665    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400667    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400671    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400674    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400677    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400680    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 04:24:00.697422 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400682    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400684    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400687    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400689    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400692    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400694    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400697    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400699    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400702    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400704    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400708    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400711    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.400714    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401438    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401446    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401450    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401453    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401456    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401459    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401463    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 04:24:00.698026 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401465    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401468    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401471    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401474    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401477    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401480    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401482    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401485    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401488    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401490    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401494    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401497    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401500    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401502    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401505    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401508    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401510    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401512    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401515    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 04:24:00.698611 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401519    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401523    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401526    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401543    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401547    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401551    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401554    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401557    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401559    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401562    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401565    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401567    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401570    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401572    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401577    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401580    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401583    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401585    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401588    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401590    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 04:24:00.699215 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401593    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401596    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401598    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401601    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401605    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401607    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401610    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401612    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401615    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401617    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401619    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401622    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401625    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401629    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401631    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401634    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401637    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401640    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401643    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401645    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 04:24:00.699800 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401648    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401650    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401653    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401655    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401657    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401660    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401662    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401665    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401667    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401670    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401672    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401675    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401677    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401679    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401682    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401684    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401689    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401692    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401694    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401697    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 04:24:00.700444 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401699    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401702    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401704    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401707    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401709    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401712    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401714    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401717    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401720    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401722    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401725    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401730    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.401733    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402105    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402110    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402112    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402115    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402118    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402121    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 04:24:00.701007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402123    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402126    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402129    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402131    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402134    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402137    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402139    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402142    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402145    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402153    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402157    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402160    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402163    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402166    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402169    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402171    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402174    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402176    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402179    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 04:24:00.701610 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402182    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402184    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402187    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402189    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402191    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402196    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402198    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402201    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402203    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402205    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402208    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402210    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402213    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402215    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402218    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402221    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402223    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402226    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402228    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402231    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 04:24:00.702181 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402235    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402238    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402243    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402245    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402249    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402251    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402254    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402256    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402259    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402261    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402264    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402267    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402270    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402272    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402274    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402277    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402279    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402283    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402285    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402288    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 04:24:00.702801 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402290    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402293    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402296    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402298    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402301    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402303    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402306    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402308    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402311    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402313    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402316    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402318    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402322    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402325    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402328    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402331    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402334    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402336    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402339    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402341    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 04:24:00.703378 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402344    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402361    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402364    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402368    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402371    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402374    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402377    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402380    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402383    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402387    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402390    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402393    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402395    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.402398    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402463    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402469    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402475    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402479    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402483    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402486    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402490    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 04:24:00.703968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402494    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402497    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402500    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402503    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402506    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402511    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402514    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402517    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402520    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402523    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402526    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402529    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402532    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402535    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402538    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402541    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402545    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402548    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402550    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402554    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402558    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402561    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402563    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402567    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 04:24:00.704803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402569    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402574    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402576    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402579    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402582    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402585    2568 flags.go:64] FLAG: --enable-server="true"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402587    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402591    2568 flags.go:64] FLAG: --event-burst="100"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402594    2568 flags.go:64] FLAG: --event-qps="50"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402597    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402600    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402603    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402607    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402611    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402614    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402616    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402619    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402622    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402629    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402632    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402635    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402637    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402640    2568 flags.go:64] FLAG: --feature-gates=""
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402646    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402649    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 04:24:00.705932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402652    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402655    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402658    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402662    2568 flags.go:64] FLAG: --help="false"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402664    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-128-250.ec2.internal"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402667    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402670    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402673    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402676    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402680    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402682    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402685    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402688    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402691    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402694    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402697    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402699    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402703    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402705    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402708    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402712    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402715    2568 flags.go:64] FLAG: --lock-file=""
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402718    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402721    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 04:24:00.707043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402724    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402728    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402732    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402734    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402737    2568 flags.go:64] FLAG: --logging-format="text"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402740    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402743    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402746    2568 flags.go:64] FLAG: --manifest-url=""
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402748    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402752    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402756    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402760    2568 flags.go:64] FLAG: --max-pods="110"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402763    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402767    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402770    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402772    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402775    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402778    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402781    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402788    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402791    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402794    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402797    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 07 04:24:00.708159 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402799    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402805    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402807    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402810    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402813    2568 flags.go:64] FLAG: --port="10250"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402817    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402820    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0df4add1570624270"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402823    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402826    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402829    2568 flags.go:64] FLAG: --register-node="true"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402832    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402835    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402838    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402841    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402844    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402847    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402850    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402853    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402856    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402858    2568 flags.go:64] FLAG: --runonce="false"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402861    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402866    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402868    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402871    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402874    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402877    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 04:24:00.711596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402879    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402882    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402885    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402888    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402890    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402894    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402896    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402899    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402902    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402907    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402910    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402915    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402918    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402921    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402924    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402926    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402929    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402932    2568 flags.go:64] FLAG: --v="2"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402936    2568 flags.go:64] FLAG: --version="false"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402940    2568 flags.go:64] FLAG: --vmodule=""
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402943    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.402947    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403056    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403059    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 04:24:00.712727 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403062    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403065    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403068    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403072    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403075    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403077    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403080    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403083    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403086    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403089    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403091    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403094    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403096    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403099    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403102    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403104    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403106    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403109    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403111    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403115    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 04:24:01.003013 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403117    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403120    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403122    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403125    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403127    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403130    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403132    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403135    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403138    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403140    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403142    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403145    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403147    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403150    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403152    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403156    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403158    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403161    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403163    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 04:24:01.004047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403166    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403169    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403171    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403174    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403176    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403179    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403181    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403184    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403186    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403189    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403191    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403194    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403198    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403200    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403203    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403205    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403208    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403211    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403213    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403216    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 04:24:01.004607 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403218    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403221    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403224    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403226    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403228    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403231    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403233    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403235    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403239    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403242    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403245    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403249    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403252    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403255    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403257    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403260    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403262    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403265    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403267    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 04:24:01.005171 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403271    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403274    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403278    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403280    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403283    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403288    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403291    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403293    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403296    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403298    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403301    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403303    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403305    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403308    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403310    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403313    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403316    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403319    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 04:24:01.005695 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.403323    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.403821    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.410716    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.410730    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.410749    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.410755    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410830    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410835    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410838    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410841    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410844    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410846    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410849    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410852    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410855    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 04:24:01.006210 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410857    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410860    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410862    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410865    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410867    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410870    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410872    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410875    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410877    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410880    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410882    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410885    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410888    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410890    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410893    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410902    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410904    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410907    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410910    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410912    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 04:24:01.006637 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410914    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410917    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410920    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410922    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410925    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410933    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410936    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410939    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410941    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410944    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410946    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410949    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410951    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410954    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410956    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410959    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410963    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410966    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410969    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410972    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 04:24:01.007247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410974    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410977    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410980    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410984    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410987    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410990    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410993    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.410996    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411005    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411008    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411010    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411013    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411015    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411018    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411020    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411023    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411025    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411028    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411030    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411033    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 04:24:01.007790 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411035    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411038    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411040    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411043    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411045    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411048    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411051    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411053    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411056    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411059    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411061    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411065    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411071    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411075    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411077    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411080    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411083    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411085    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411088    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 04:24:01.008383 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411090    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411093    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411101    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411104    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411107    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411109    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411112    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411114    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411117    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411119    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411122    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.411127    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411272    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411276    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411279    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 04:24:01.008884 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411281    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411284    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411287    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411292    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411295    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411297    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411300    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411302    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411305    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411308    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411310    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411314    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411316    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411319    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411322    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411326    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411329    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411332    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 04:24:01.009326 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411335    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411337    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411361    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411365    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411367    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411370    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411372    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411375    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411377    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411380    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411382    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411385    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411388    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411390    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411392    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411395    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411397    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411401    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411404    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411406    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 04:24:01.009823 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411409    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411411    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411414    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411416    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411419    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411422    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411425    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411427    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411430    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411432    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411435    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411438    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411440    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411443    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411445    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411454    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411457    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411461    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411463    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411467    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 04:24:01.010388 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411470    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411473    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411475    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411478    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411480    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411482    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411485    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411488    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411490    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411494    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411496    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411499    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411501    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411503    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411506    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411509    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411511    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411515    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411517    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411520    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 04:24:01.010933 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411523    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411525    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411527    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411530    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411533    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411535    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411537    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411540    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411548    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411551    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411554    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411556    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411559    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411561    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411563    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411566    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411568    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 04:24:01.011519 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:00.411571    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.411576    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.411666    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.413682    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.415029    2568 server.go:1019] "Starting client certificate rotation"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.415130    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.415160    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.417566    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.422582    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.431531    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.433623    2568 log.go:25] "Validated CRI v1 image API"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.434494    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 04:24:01.011971 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.439780    2568 fs.go:135] Filesystem UUIDs: map[107d1fbf-afe4-4e13-91a6-1f1f76282a5d:/dev/nvme0n1p4 79325888-5a97-4ea5-bbf4-86e5e0939d63:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 07 04:24:01.012409 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.439793    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 04:24:01.012481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.444618    2568 manager.go:216] Machine: {Timestamp:2026-07-07 04:24:00.443291016 +0000 UTC m=+0.330829808 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3037519 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dcaccc1332cf36324a2fdd62e85a9 SystemUUID:ec2dcacc-c133-2cf3-6324-a2fdd62e85a9 BootID:6cd7209c-d15b-47c7-8944-331cf32fe6ca Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2e:7e:fa:b7:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2e:7e:fa:b7:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:ae:23:c0:8a:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 04:24:01.012481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.444715    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 04:24:01.012481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.444809    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 04:24:01.012481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.447131    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 04:24:01.012481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.448025    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 04:24:01.012481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.448061    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 04:24:01.012481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.448742    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.448752    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.448760    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.449296    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.450422    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.454833    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.454952    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.454992    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.455001    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.455011    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.455018    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.455027    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.455460    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.455478    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.457555    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.459583    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.459610    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460698    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460710    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460716    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460721    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460729    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460744    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460753    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460758    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460764    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460769    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460780    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.460786    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.461525    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.461531    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.464631    2568 server.go:1268] "Started kubelet"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.464760    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.464818    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.464907    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.464982    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.465079    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.465213    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.466332    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 04:24:01.012765 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.471619    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6pr47"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.472571    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.472695    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.472799    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-250.ec2.internal.18bfe74037f3151e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-250.ec2.internal,UID:ip-10-0-128-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-250.ec2.internal,},FirstTimestamp:2026-07-07 04:24:00.464606494 +0000 UTC m=+0.352145286,LastTimestamp:2026-07-07 04:24:00.464606494 +0000 UTC m=+0.352145286,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-250.ec2.internal,}"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.475733    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.475741    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.475819    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476261    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476275    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476287    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476445    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476455    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476511    2568 factory.go:55] Registering systemd factory
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476522    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476704    2568 factory.go:153] Registering CRI-O factory
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476715    2568 factory.go:223] Registration of the crio container factory successfully
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476758    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476781    2568 factory.go:103] Registering Raw factory
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.476792    2568 manager.go:1196] Started watching for new ooms in manager
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.477124    2568 manager.go:349] Starting recovery of all containers
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.478233    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6pr47"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.485098    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.485239    2568 manager.go:354] Recovery completed
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.487839    2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-250.ec2.internal\" not found" node="ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.491242    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.494028    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.495843    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.495860    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.496908    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.496920    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.496938    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.496944    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.497963    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.497986    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.497996    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.498372    2568 policy_none.go:49] "None policy: Start"
Jul 07 04:24:01.014156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.498383    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.498393    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.499280    2568 policy_none.go:47] "Start"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.552918    2568 manager.go:337] "Starting Device Plugin manager"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.552945    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.552955    2568 server.go:87] "Starting device plugin registration server"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.553183    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.553470    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.553807    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.553915    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.553927    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.555119    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.555196    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.583683    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.584853    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.584892    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.584913    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.584945    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.587374    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.654324    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.655786    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.655822    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.655840    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.655865    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.665429    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.665453    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-250.ec2.internal\": node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.678329    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.685392    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"]
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.685454    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.688081    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.688242    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.688253    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.689587    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.689751    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.689782    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.691055    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.691071    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 04:24:01.304882 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.691081    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.691092    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.691094    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.691109    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.692879    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.692924    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.693710    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.693740    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.693757    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeHasSufficientPID"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.741322    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-250.ec2.internal\" not found" node="ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.745741    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-250.ec2.internal\" not found" node="ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.778016    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/016bf9dec8ec3160265788daa113acde-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"016bf9dec8ec3160265788daa113acde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.778056    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/016bf9dec8ec3160265788daa113acde-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"016bf9dec8ec3160265788daa113acde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.778080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e122e28a36009eb5aa8349191a2630e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-250.ec2.internal\" (UID: \"5e122e28a36009eb5aa8349191a2630e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.779109    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.878708    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/016bf9dec8ec3160265788daa113acde-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"016bf9dec8ec3160265788daa113acde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.878736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/016bf9dec8ec3160265788daa113acde-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"016bf9dec8ec3160265788daa113acde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.878756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e122e28a36009eb5aa8349191a2630e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-250.ec2.internal\" (UID: \"5e122e28a36009eb5aa8349191a2630e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.878817    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e122e28a36009eb5aa8349191a2630e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-250.ec2.internal\" (UID: \"5e122e28a36009eb5aa8349191a2630e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.311830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.878818    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/016bf9dec8ec3160265788daa113acde-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"016bf9dec8ec3160265788daa113acde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.312433 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:00.878820    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/016bf9dec8ec3160265788daa113acde-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal\" (UID: \"016bf9dec8ec3160265788daa113acde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.312433 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.879742    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.312433 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:00.980482    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.312433 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.044652    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.312433 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.051141    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:01.312433 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:01.081051    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.312433 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:01.181536    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.312433 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:01.281968    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:01.382451    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.414613    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.414754    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.414754    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.480180    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 04:19:00 +0000 UTC" deadline="2028-01-07 00:36:42.975487505 +0000 UTC"
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.480205    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13172h12m41.495286319s"
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:01.482781    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:01.567593    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e122e28a36009eb5aa8349191a2630e.slice/crio-b92a37f9fc222a4667bb59e25e7308960e628e3404bf6fa428816aae47dc7e18 WatchSource:0}: Error finding container b92a37f9fc222a4667bb59e25e7308960e628e3404bf6fa428816aae47dc7e18: Status 404 returned error can't find the container with id b92a37f9fc222a4667bb59e25e7308960e628e3404bf6fa428816aae47dc7e18
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:01.567872    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016bf9dec8ec3160265788daa113acde.slice/crio-c5bc3fa70812bda1050d78a1c0b8dd2b234ad7aee22dcd447986f022caf71269 WatchSource:0}: Error finding container c5bc3fa70812bda1050d78a1c0b8dd2b234ad7aee22dcd447986f022caf71269: Status 404 returned error can't find the container with id c5bc3fa70812bda1050d78a1c0b8dd2b234ad7aee22dcd447986f022caf71269
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.573032    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:01.583589    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.588519    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal" event={"ID":"5e122e28a36009eb5aa8349191a2630e","Type":"ContainerStarted","Data":"b92a37f9fc222a4667bb59e25e7308960e628e3404bf6fa428816aae47dc7e18"}
Jul 07 04:24:01.592738 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.589478    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal" event={"ID":"016bf9dec8ec3160265788daa113acde","Type":"ContainerStarted","Data":"c5bc3fa70812bda1050d78a1c0b8dd2b234ad7aee22dcd447986f022caf71269"}
Jul 07 04:24:01.869310 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:01.683875    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:01.869310 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:01.784989    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:02.149014 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:01.885183    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-250.ec2.internal\" not found"
Jul 07 04:24:02.149014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.899668    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 04:24:02.149014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.969756    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 04:24:02.149014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.976893    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:02.149014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.989963    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 04:24:02.149014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.990947    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal"
Jul 07 04:24:02.149014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:01.999783    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 04:24:02.430166 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.425183    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.463955    2568 apiserver.go:52] "Watching apiserver"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.470734    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.473204    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-q5kxz","openshift-network-diagnostics/network-check-target-f2bll","openshift-ovn-kubernetes/ovnkube-node-npkcf","kube-system/konnectivity-agent-p77tx","openshift-image-registry/node-ca-7bqc5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal","openshift-multus/multus-additional-cni-plugins-k7fzv","openshift-multus/network-metrics-daemon-tp8x8","openshift-network-operator/iptables-alerter-8qwlw","kube-system/global-pull-secret-syncer-qlnzn","kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw","openshift-cluster-node-tuning-operator/tuned-vl59x","openshift-dns/node-resolver-xv5rb"]
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.474972    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.476768    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.477226    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.478215    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.478263    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.482107    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.483200    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lpgd\""
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.483729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.484078    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.486052    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.486752    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.486851    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.487534    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.487590    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.487967    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488220    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/491a93ac-9c61-4d51-a90d-0d32ee991667-ovnkube-config\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488252    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/491a93ac-9c61-4d51-a90d-0d32ee991667-ovn-node-metrics-cert\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488286    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.522903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488312    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bdd1ad5-7005-4c96-8005-4983545d62d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488340    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-modprobe-d\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488366    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-sysctl-d\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488389    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-lib-modules\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488431    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-tuned\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488487    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vsjl\" (UniqueName: \"kubernetes.io/projected/da8206f6-40d3-4ad9-9c62-25301c696e75-kube-api-access-2vsjl\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488536    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-run-openvswitch\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488573    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-log-socket\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-sysctl-conf\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488672    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-sys\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-host\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-node-log\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d666k\" (UniqueName: \"kubernetes.io/projected/491a93ac-9c61-4d51-a90d-0d32ee991667-kube-api-access-d666k\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.524860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-os-release\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-sysconfig\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-var-lib-kubelet\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-run-netns\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488882    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-run-ovn\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488905    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-cni-bin\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488943    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/491a93ac-9c61-4d51-a90d-0d32ee991667-env-overrides\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488966    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/491a93ac-9c61-4d51-a90d-0d32ee991667-ovnkube-script-lib\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.488993    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hz7l\" (UniqueName: \"kubernetes.io/projected/7bdd1ad5-7005-4c96-8005-4983545d62d9-kube-api-access-2hz7l\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489017    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-systemd\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489037    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da8206f6-40d3-4ad9-9c62-25301c696e75-tmp\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489058    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-kubelet\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489182    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-slash\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.525767 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-run-systemd\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489236    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-var-lib-openvswitch\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489148    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fjm6l\""
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-etc-openvswitch\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-cnibin\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489312    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9m5k7\""
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-run-ovn-kubernetes\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489408    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-cni-netd\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-system-cni-dir\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bdd1ad5-7005-4c96-8005-4983545d62d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489494    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bdd1ad5-7005-4c96-8005-4983545d62d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489518    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-kubernetes\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489540    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-systemd-units\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.489563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-run\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.490769    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.491628    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.491902    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 04:24:02.529295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.491906    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.493535    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.493601    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.493794    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.493822    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-69shv\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.493537    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.493891    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.493797    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.494037    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.494074    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jmdfk\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.494099    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4cpvg\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.494119    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.494339    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.495636    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.496865    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.497100    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.497142    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.497495    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.498138    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tt8j8\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.498362    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.498707    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x9lg2\""
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.499129    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.499208    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.499534    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.499598    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.500094    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.500158    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:02.530667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.501645    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.532585 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.504104    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 04:24:02.532585 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.504481    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hnsjj\""
Jul 07 04:24:02.532585 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.504611    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 04:24:02.532585 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.504660    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 04:24:02.532585 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.524670    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-79rk6"
Jul 07 04:24:02.534940 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.534146    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-79rk6"
Jul 07 04:24:02.536482 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.536222    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.577223    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.589881    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlhxb\" (UniqueName: \"kubernetes.io/projected/a65c2a9d-2394-473d-bd17-db7eec281c80-kube-api-access-wlhxb\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.589919    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-cnibin\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.589947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-run-ovn-kubernetes\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.589990    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-cni-netd\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-device-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590023    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-cnibin\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590030    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-run-ovn-kubernetes\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590036    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-sys-fs\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590087    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-run-multus-certs\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590106    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-cni-netd\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bdd1ad5-7005-4c96-8005-4983545d62d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bdd1ad5-7005-4c96-8005-4983545d62d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-kubernetes\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.689187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-systemd-units\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590438    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-kubernetes\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590458    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-systemd-units\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590492    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clv4b\" (UniqueName: \"kubernetes.io/projected/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-kube-api-access-clv4b\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-os-release\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590553    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a65c2a9d-2394-473d-bd17-db7eec281c80-cni-binary-copy\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590577    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-cni-dir\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-conf-dir\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-modprobe-d\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590664    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-sysctl-d\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-lib-modules\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590694    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-tuned\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590708    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vsjl\" (UniqueName: \"kubernetes.io/projected/da8206f6-40d3-4ad9-9c62-25301c696e75-kube-api-access-2vsjl\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.690053 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590724    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d-serviceca\") pod \"node-ca-7bqc5\" (UID: \"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d\") " pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590854    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bdd1ad5-7005-4c96-8005-4983545d62d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590966    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bdd1ad5-7005-4c96-8005-4983545d62d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f78sl\" (UniqueName: \"kubernetes.io/projected/74bf3def-bf1b-4616-b263-6053719e4b63-kube-api-access-f78sl\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.590996    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/607766ce-6c56-44f6-9d7e-4f250460b207-tmp-dir\") pod \"node-resolver-xv5rb\" (UID: \"607766ce-6c56-44f6-9d7e-4f250460b207\") " pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591020    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b93b525a-aebf-47a0-a974-319583d88a5d-kubelet-config\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591066    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b93b525a-aebf-47a0-a974-319583d88a5d-dbus\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591103    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591122    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-modprobe-d\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591127    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-lib-modules\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591142    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-sys\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591149    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-sysctl-d\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-node-log\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.691320 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591183    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-sys\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591207    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-node-log\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591259    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-daemon-config\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591302    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d-host\") pod \"node-ca-7bqc5\" (UID: \"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d\") " pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591325    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591336    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-var-lib-kubelet\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-cni-bin\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591409    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-var-lib-kubelet\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591442    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/491a93ac-9c61-4d51-a90d-0d32ee991667-ovnkube-script-lib\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591454    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-cni-bin\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591472    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hz7l\" (UniqueName: \"kubernetes.io/projected/7bdd1ad5-7005-4c96-8005-4983545d62d9-kube-api-access-2hz7l\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-systemd\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da8206f6-40d3-4ad9-9c62-25301c696e75-tmp\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-socket-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.692412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591573    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7395655-13b9-4c94-80ea-f371a9687b58-konnectivity-ca\") pod \"konnectivity-agent-p77tx\" (UID: \"d7395655-13b9-4c94-80ea-f371a9687b58\") " pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591581    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-systemd\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591595    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-run-netns\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591622    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-hostroot\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3d1a701-7fd4-4b53-977f-dded6a385cdd-host-slash\") pod \"iptables-alerter-8qwlw\" (UID: \"f3d1a701-7fd4-4b53-977f-dded6a385cdd\") " pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591667    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-var-lib-cni-multus\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-etc-kubernetes\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-system-cni-dir\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591783    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591808    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9tkk\" (UniqueName: \"kubernetes.io/projected/23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d-kube-api-access-g9tkk\") pod \"node-ca-7bqc5\" (UID: \"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d\") " pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591834    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/607766ce-6c56-44f6-9d7e-4f250460b207-hosts-file\") pod \"node-resolver-xv5rb\" (UID: \"607766ce-6c56-44f6-9d7e-4f250460b207\") " pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591841    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-system-cni-dir\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwps\" (UniqueName: \"kubernetes.io/projected/607766ce-6c56-44f6-9d7e-4f250460b207-kube-api-access-7dwps\") pod \"node-resolver-xv5rb\" (UID: \"607766ce-6c56-44f6-9d7e-4f250460b207\") " pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:02.693757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-run\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591956    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/491a93ac-9c61-4d51-a90d-0d32ee991667-ovnkube-config\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.591987    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/491a93ac-9c61-4d51-a90d-0d32ee991667-ovn-node-metrics-cert\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592010    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-cnibin\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592026    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/491a93ac-9c61-4d51-a90d-0d32ee991667-ovnkube-script-lib\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592032    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-var-lib-kubelet\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592056    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-run\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592061    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bdd1ad5-7005-4c96-8005-4983545d62d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592193    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-run-openvswitch\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592222    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-log-socket\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592280    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-run-openvswitch\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7395655-13b9-4c94-80ea-f371a9687b58-agent-certs\") pod \"konnectivity-agent-p77tx\" (UID: \"d7395655-13b9-4c94-80ea-f371a9687b58\") " pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592325    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-var-lib-cni-bin\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.694688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592393    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-sysctl-conf\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-host\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592441    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d666k\" (UniqueName: \"kubernetes.io/projected/491a93ac-9c61-4d51-a90d-0d32ee991667-kube-api-access-d666k\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-registration-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592494    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq75h\" (UniqueName: \"kubernetes.io/projected/f3d1a701-7fd4-4b53-977f-dded6a385cdd-kube-api-access-dq75h\") pod \"iptables-alerter-8qwlw\" (UID: \"f3d1a701-7fd4-4b53-977f-dded6a385cdd\") " pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-os-release\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-sysconfig\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592571    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-run-netns\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-run-ovn\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592621    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/491a93ac-9c61-4d51-a90d-0d32ee991667-env-overrides\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592653    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3d1a701-7fd4-4b53-977f-dded6a385cdd-iptables-alerter-script\") pod \"iptables-alerter-8qwlw\" (UID: \"f3d1a701-7fd4-4b53-977f-dded6a385cdd\") " pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-system-cni-dir\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592719    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-socket-dir-parent\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-kubelet\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.695648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592786    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-slash\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592800    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/491a93ac-9c61-4d51-a90d-0d32ee991667-ovnkube-config\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-run-systemd\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592843    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-var-lib-openvswitch\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-etc-openvswitch\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.592974    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-run-k8s-cni-cncf-io\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593047    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-run-netns\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593085    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-run-ovn\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593099    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-log-socket\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593146    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593250    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bdd1ad5-7005-4c96-8005-4983545d62d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593273    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-sysctl-conf\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593316    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-slash\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.696809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593359    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bdd1ad5-7005-4c96-8005-4983545d62d9-os-release\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593435    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-sysconfig\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593495    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-var-lib-openvswitch\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593497    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/491a93ac-9c61-4d51-a90d-0d32ee991667-env-overrides\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593540    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-etc-openvswitch\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593564    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-run-systemd\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593579    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da8206f6-40d3-4ad9-9c62-25301c696e75-host\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.593573    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/491a93ac-9c61-4d51-a90d-0d32ee991667-host-kubelet\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.595682    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da8206f6-40d3-4ad9-9c62-25301c696e75-etc-tuned\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.595894    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da8206f6-40d3-4ad9-9c62-25301c696e75-tmp\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.598147    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/491a93ac-9c61-4d51-a90d-0d32ee991667-ovn-node-metrics-cert\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.602316    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vsjl\" (UniqueName: \"kubernetes.io/projected/da8206f6-40d3-4ad9-9c62-25301c696e75-kube-api-access-2vsjl\") pod \"tuned-vl59x\" (UID: \"da8206f6-40d3-4ad9-9c62-25301c696e75\") " pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.602539    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d666k\" (UniqueName: \"kubernetes.io/projected/491a93ac-9c61-4d51-a90d-0d32ee991667-kube-api-access-d666k\") pod \"ovnkube-node-npkcf\" (UID: \"491a93ac-9c61-4d51-a90d-0d32ee991667\") " pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.602941    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hz7l\" (UniqueName: \"kubernetes.io/projected/7bdd1ad5-7005-4c96-8005-4983545d62d9-kube-api-access-2hz7l\") pod \"multus-additional-cni-plugins-k7fzv\" (UID: \"7bdd1ad5-7005-4c96-8005-4983545d62d9\") " pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694007    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clv4b\" (UniqueName: \"kubernetes.io/projected/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-kube-api-access-clv4b\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.697716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-os-release\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694054    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a65c2a9d-2394-473d-bd17-db7eec281c80-cni-binary-copy\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694081    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-cni-dir\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694166    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-os-release\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694221    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-cni-dir\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694218    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-conf-dir\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694250    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d-serviceca\") pod \"node-ca-7bqc5\" (UID: \"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d\") " pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694264    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-conf-dir\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f78sl\" (UniqueName: \"kubernetes.io/projected/74bf3def-bf1b-4616-b263-6053719e4b63-kube-api-access-f78sl\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694315    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/607766ce-6c56-44f6-9d7e-4f250460b207-tmp-dir\") pod \"node-resolver-xv5rb\" (UID: \"607766ce-6c56-44f6-9d7e-4f250460b207\") " pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694340    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b93b525a-aebf-47a0-a974-319583d88a5d-kubelet-config\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694376    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b93b525a-aebf-47a0-a974-319583d88a5d-dbus\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694401    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-daemon-config\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.698822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694472    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d-host\") pod \"node-ca-7bqc5\" (UID: \"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d\") " pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-socket-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694527    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b93b525a-aebf-47a0-a974-319583d88a5d-kubelet-config\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694556    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7395655-13b9-4c94-80ea-f371a9687b58-konnectivity-ca\") pod \"konnectivity-agent-p77tx\" (UID: \"d7395655-13b9-4c94-80ea-f371a9687b58\") " pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.694558    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694580    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-run-netns\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-hostroot\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.694658    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs podName:74bf3def-bf1b-4616-b263-6053719e4b63 nodeName:}" failed. No retries permitted until 2026-07-07 04:24:03.19461555 +0000 UTC m=+3.082154338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs") pod "network-metrics-daemon-tp8x8" (UID: "74bf3def-bf1b-4616-b263-6053719e4b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3d1a701-7fd4-4b53-977f-dded6a385cdd-host-slash\") pod \"iptables-alerter-8qwlw\" (UID: \"f3d1a701-7fd4-4b53-977f-dded6a385cdd\") " pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694695    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a65c2a9d-2394-473d-bd17-db7eec281c80-cni-binary-copy\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694705    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-socket-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694712    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-var-lib-cni-multus\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694742    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-etc-kubernetes\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694751    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d-serviceca\") pod \"node-ca-7bqc5\" (UID: \"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d\") " pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.699727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9tkk\" (UniqueName: \"kubernetes.io/projected/23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d-kube-api-access-g9tkk\") pod \"node-ca-7bqc5\" (UID: \"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d\") " pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/607766ce-6c56-44f6-9d7e-4f250460b207-hosts-file\") pod \"node-resolver-xv5rb\" (UID: \"607766ce-6c56-44f6-9d7e-4f250460b207\") " pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694874    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwps\" (UniqueName: \"kubernetes.io/projected/607766ce-6c56-44f6-9d7e-4f250460b207-kube-api-access-7dwps\") pod \"node-resolver-xv5rb\" (UID: \"607766ce-6c56-44f6-9d7e-4f250460b207\") " pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694902    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694933    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-cnibin\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694958    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-var-lib-kubelet\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694988    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7395655-13b9-4c94-80ea-f371a9687b58-agent-certs\") pod \"konnectivity-agent-p77tx\" (UID: \"d7395655-13b9-4c94-80ea-f371a9687b58\") " pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-var-lib-cni-bin\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695028    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-run-netns\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695045    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-registration-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695070    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/607766ce-6c56-44f6-9d7e-4f250460b207-tmp-dir\") pod \"node-resolver-xv5rb\" (UID: \"607766ce-6c56-44f6-9d7e-4f250460b207\") " pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694753    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d-host\") pod \"node-ca-7bqc5\" (UID: \"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d\") " pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695101    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-registration-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq75h\" (UniqueName: \"kubernetes.io/projected/f3d1a701-7fd4-4b53-977f-dded6a385cdd-kube-api-access-dq75h\") pod \"iptables-alerter-8qwlw\" (UID: \"f3d1a701-7fd4-4b53-977f-dded6a385cdd\") " pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.700419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695141    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3d1a701-7fd4-4b53-977f-dded6a385cdd-iptables-alerter-script\") pod \"iptables-alerter-8qwlw\" (UID: \"f3d1a701-7fd4-4b53-977f-dded6a385cdd\") " pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695171    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-system-cni-dir\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.695185    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695197    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-socket-dir-parent\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695218    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-var-lib-cni-multus\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695250    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7395655-13b9-4c94-80ea-f371a9687b58-konnectivity-ca\") pod \"konnectivity-agent-p77tx\" (UID: \"d7395655-13b9-4c94-80ea-f371a9687b58\") " pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695260    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-daemon-config\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.695255    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret podName:b93b525a-aebf-47a0-a974-319583d88a5d nodeName:}" failed. No retries permitted until 2026-07-07 04:24:03.19522992 +0000 UTC m=+3.082768719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret") pod "global-pull-secret-syncer-qlnzn" (UID: "b93b525a-aebf-47a0-a974-319583d88a5d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695282    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b93b525a-aebf-47a0-a974-319583d88a5d-dbus\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-run-k8s-cni-cncf-io\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695337    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695343    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695351    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlhxb\" (UniqueName: \"kubernetes.io/projected/a65c2a9d-2394-473d-bd17-db7eec281c80-kube-api-access-wlhxb\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.703768 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.694655    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-hostroot\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695352    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-cnibin\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-device-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695449    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-var-lib-cni-bin\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695453    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-device-dir\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695458    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-sys-fs\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695489    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-run-k8s-cni-cncf-io\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695493    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-run-multus-certs\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695497    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-multus-socket-dir-parent\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695462    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-var-lib-kubelet\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695384    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-etc-kubernetes\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695605    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-sys-fs\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695663    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/607766ce-6c56-44f6-9d7e-4f250460b207-hosts-file\") pod \"node-resolver-xv5rb\" (UID: \"607766ce-6c56-44f6-9d7e-4f250460b207\") " pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695667    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-host-run-multus-certs\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695692    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a65c2a9d-2394-473d-bd17-db7eec281c80-system-cni-dir\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.704945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695714    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3d1a701-7fd4-4b53-977f-dded6a385cdd-host-slash\") pod \"iptables-alerter-8qwlw\" (UID: \"f3d1a701-7fd4-4b53-977f-dded6a385cdd\") " pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.706160 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.695930    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3d1a701-7fd4-4b53-977f-dded6a385cdd-iptables-alerter-script\") pod \"iptables-alerter-8qwlw\" (UID: \"f3d1a701-7fd4-4b53-977f-dded6a385cdd\") " pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.706160 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.697761    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7395655-13b9-4c94-80ea-f371a9687b58-agent-certs\") pod \"konnectivity-agent-p77tx\" (UID: \"d7395655-13b9-4c94-80ea-f371a9687b58\") " pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:02.706160 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.704593    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 04:24:02.706160 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.704624    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 04:24:02.706160 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.704637    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4hwm2 for pod openshift-network-diagnostics/network-check-target-f2bll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:02.706160 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:02.704698    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2 podName:15b6ddd6-2b79-440b-8098-20a5252af8bf nodeName:}" failed. No retries permitted until 2026-07-07 04:24:03.204681643 +0000 UTC m=+3.092220441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4hwm2" (UniqueName: "kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2") pod "network-check-target-f2bll" (UID: "15b6ddd6-2b79-440b-8098-20a5252af8bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:02.710198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.709509    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwps\" (UniqueName: \"kubernetes.io/projected/607766ce-6c56-44f6-9d7e-4f250460b207-kube-api-access-7dwps\") pod \"node-resolver-xv5rb\" (UID: \"607766ce-6c56-44f6-9d7e-4f250460b207\") " pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.710198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.709974    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlhxb\" (UniqueName: \"kubernetes.io/projected/a65c2a9d-2394-473d-bd17-db7eec281c80-kube-api-access-wlhxb\") pod \"multus-q5kxz\" (UID: \"a65c2a9d-2394-473d-bd17-db7eec281c80\") " pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.710198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.710004    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9tkk\" (UniqueName: \"kubernetes.io/projected/23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d-kube-api-access-g9tkk\") pod \"node-ca-7bqc5\" (UID: \"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d\") " pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.711785 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.710449    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq75h\" (UniqueName: \"kubernetes.io/projected/f3d1a701-7fd4-4b53-977f-dded6a385cdd-kube-api-access-dq75h\") pod \"iptables-alerter-8qwlw\" (UID: \"f3d1a701-7fd4-4b53-977f-dded6a385cdd\") " pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.711785 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.710456    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clv4b\" (UniqueName: \"kubernetes.io/projected/578c85e8-a1fe-45cc-8f7c-18db8b2d17f4-kube-api-access-clv4b\") pod \"aws-ebs-csi-driver-node-6wsrw\" (UID: \"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:02.711785 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.710869    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f78sl\" (UniqueName: \"kubernetes.io/projected/74bf3def-bf1b-4616-b263-6053719e4b63-kube-api-access-f78sl\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:02.806015 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.797645    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k7fzv"
Jul 07 04:24:02.819197 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.814838    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vl59x"
Jul 07 04:24:02.826396 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.824238    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:02.886059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.832652    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7bqc5"
Jul 07 04:24:02.886059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.839863    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:02.886059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.852857    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xv5rb"
Jul 07 04:24:02.886059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.865149    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8qwlw"
Jul 07 04:24:02.886059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.872116    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q5kxz"
Jul 07 04:24:02.886059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:02.880262    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw"
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:03.200078    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:03.200123    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:03.200281    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:03.200349    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret podName:b93b525a-aebf-47a0-a974-319583d88a5d nodeName:}" failed. No retries permitted until 2026-07-07 04:24:04.200332181 +0000 UTC m=+4.087870985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret") pod "global-pull-secret-syncer-qlnzn" (UID: "b93b525a-aebf-47a0-a974-319583d88a5d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:03.200407    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:03.200503    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs podName:74bf3def-bf1b-4616-b263-6053719e4b63 nodeName:}" failed. No retries permitted until 2026-07-07 04:24:04.200481514 +0000 UTC m=+4.088020298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs") pod "network-metrics-daemon-tp8x8" (UID: "74bf3def-bf1b-4616-b263-6053719e4b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:03.301102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:03.301284    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:03.301307    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:03.301319    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4hwm2 for pod openshift-network-diagnostics/network-check-target-f2bll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:03.362739 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:03.301397    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2 podName:15b6ddd6-2b79-440b-8098-20a5252af8bf nodeName:}" failed. No retries permitted until 2026-07-07 04:24:04.301376606 +0000 UTC m=+4.188915406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hwm2" (UniqueName: "kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2") pod "network-check-target-f2bll" (UID: "15b6ddd6-2b79-440b-8098-20a5252af8bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:03.537123 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:03.537072    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 04:19:02 +0000 UTC" deadline="2027-12-01 23:30:20.565601578 +0000 UTC"
Jul 07 04:24:03.537123 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:03.537117    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12307h6m17.028487115s"
Jul 07 04:24:03.830725 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:03.830699    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8206f6_40d3_4ad9_9c62_25301c696e75.slice/crio-17856718a940e642d2b88fa0ff5903fcd6f7d6d0862d60dd231abfb1616f8ea9 WatchSource:0}: Error finding container 17856718a940e642d2b88fa0ff5903fcd6f7d6d0862d60dd231abfb1616f8ea9: Status 404 returned error can't find the container with id 17856718a940e642d2b88fa0ff5903fcd6f7d6d0862d60dd231abfb1616f8ea9
Jul 07 04:24:03.846199 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:03.846080    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607766ce_6c56_44f6_9d7e_4f250460b207.slice/crio-46feb6931776968cd4641972202e968dd8f632fe01d68625b774f1d8aacfea0b WatchSource:0}: Error finding container 46feb6931776968cd4641972202e968dd8f632fe01d68625b774f1d8aacfea0b: Status 404 returned error can't find the container with id 46feb6931776968cd4641972202e968dd8f632fe01d68625b774f1d8aacfea0b
Jul 07 04:24:03.848903 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:03.848879    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d1a701_7fd4_4b53_977f_dded6a385cdd.slice/crio-f0c05743118a1477453c37bf5f698017d585200efc2d283d25e476c2419dfc6e WatchSource:0}: Error finding container f0c05743118a1477453c37bf5f698017d585200efc2d283d25e476c2419dfc6e: Status 404 returned error can't find the container with id f0c05743118a1477453c37bf5f698017d585200efc2d283d25e476c2419dfc6e
Jul 07 04:24:03.849575 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:03.849549    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491a93ac_9c61_4d51_a90d_0d32ee991667.slice/crio-111a7d17ef5f2f65a40527560fabee95044ecafe9e35f57714fda65842a6639e WatchSource:0}: Error finding container 111a7d17ef5f2f65a40527560fabee95044ecafe9e35f57714fda65842a6639e: Status 404 returned error can't find the container with id 111a7d17ef5f2f65a40527560fabee95044ecafe9e35f57714fda65842a6639e
Jul 07 04:24:03.850878 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:03.850466    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ca5ba7_765b_4bc7_af6e_6c2e01b78f4d.slice/crio-e579f440ebdb3a608d56fe36f2d8d8a9dc7712681fa3a09ea08b9a7f48857082 WatchSource:0}: Error finding container e579f440ebdb3a608d56fe36f2d8d8a9dc7712681fa3a09ea08b9a7f48857082: Status 404 returned error can't find the container with id e579f440ebdb3a608d56fe36f2d8d8a9dc7712681fa3a09ea08b9a7f48857082
Jul 07 04:24:03.851107 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:03.851088    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7395655_13b9_4c94_80ea_f371a9687b58.slice/crio-e7c04ac1e6a510c0fdea35484f227e27e71979e15c7cd1bc4c30dcd985c2fae7 WatchSource:0}: Error finding container e7c04ac1e6a510c0fdea35484f227e27e71979e15c7cd1bc4c30dcd985c2fae7: Status 404 returned error can't find the container with id e7c04ac1e6a510c0fdea35484f227e27e71979e15c7cd1bc4c30dcd985c2fae7
Jul 07 04:24:03.854374 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:03.852611    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdd1ad5_7005_4c96_8005_4983545d62d9.slice/crio-5c228009ac590bcef9d60ee39beffc6fa2c3ebda3fab02595f5721c4190b27c0 WatchSource:0}: Error finding container 5c228009ac590bcef9d60ee39beffc6fa2c3ebda3fab02595f5721c4190b27c0: Status 404 returned error can't find the container with id 5c228009ac590bcef9d60ee39beffc6fa2c3ebda3fab02595f5721c4190b27c0
Jul 07 04:24:03.854374 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:03.853430    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578c85e8_a1fe_45cc_8f7c_18db8b2d17f4.slice/crio-1ca7a415c921f8e2dbfa63334a6a804d1159d2e63392dac4db0f3c38d540f093 WatchSource:0}: Error finding container 1ca7a415c921f8e2dbfa63334a6a804d1159d2e63392dac4db0f3c38d540f093: Status 404 returned error can't find the container with id 1ca7a415c921f8e2dbfa63334a6a804d1159d2e63392dac4db0f3c38d540f093
Jul 07 04:24:03.855088 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:03.855026    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65c2a9d_2394_473d_bd17_db7eec281c80.slice/crio-c5b17e84dc62e05a572907c5f0cc1fc158ca65f8f253b3394811ac891a84ce55 WatchSource:0}: Error finding container c5b17e84dc62e05a572907c5f0cc1fc158ca65f8f253b3394811ac891a84ce55: Status 404 returned error can't find the container with id c5b17e84dc62e05a572907c5f0cc1fc158ca65f8f253b3394811ac891a84ce55
Jul 07 04:24:04.208864 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.208654    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:04.209428 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.208896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:04.209428 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.208774    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:04.209428 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.209010    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret podName:b93b525a-aebf-47a0-a974-319583d88a5d nodeName:}" failed. No retries permitted until 2026-07-07 04:24:06.208991473 +0000 UTC m=+6.096530257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret") pod "global-pull-secret-syncer-qlnzn" (UID: "b93b525a-aebf-47a0-a974-319583d88a5d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:04.209428 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.209033    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:04.209428 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.209086    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs podName:74bf3def-bf1b-4616-b263-6053719e4b63 nodeName:}" failed. No retries permitted until 2026-07-07 04:24:06.209068474 +0000 UTC m=+6.096607252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs") pod "network-metrics-daemon-tp8x8" (UID: "74bf3def-bf1b-4616-b263-6053719e4b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:04.310101 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.310065    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:04.310285 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.310260    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 04:24:04.310421 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.310292    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 04:24:04.310421 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.310304    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4hwm2 for pod openshift-network-diagnostics/network-check-target-f2bll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:04.310421 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.310381    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2 podName:15b6ddd6-2b79-440b-8098-20a5252af8bf nodeName:}" failed. No retries permitted until 2026-07-07 04:24:06.310360954 +0000 UTC m=+6.197899750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hwm2" (UniqueName: "kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2") pod "network-check-target-f2bll" (UID: "15b6ddd6-2b79-440b-8098-20a5252af8bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:04.537586 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.537425    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 04:19:02 +0000 UTC" deadline="2027-12-10 20:44:36.084654654 +0000 UTC"
Jul 07 04:24:04.537586 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.537467    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12520h20m31.547192073s"
Jul 07 04:24:04.589647 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.588757    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:04.589647 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.588877    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:04.589647 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.589233    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:04.589647 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.589318    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:04.589647 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.589400    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:04.589647 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:04.589479    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:04.600577 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.600550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p77tx" event={"ID":"d7395655-13b9-4c94-80ea-f371a9687b58","Type":"ContainerStarted","Data":"e7c04ac1e6a510c0fdea35484f227e27e71979e15c7cd1bc4c30dcd985c2fae7"}
Jul 07 04:24:04.619730 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.619522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xv5rb" event={"ID":"607766ce-6c56-44f6-9d7e-4f250460b207","Type":"ContainerStarted","Data":"46feb6931776968cd4641972202e968dd8f632fe01d68625b774f1d8aacfea0b"}
Jul 07 04:24:04.632789 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.632761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vl59x" event={"ID":"da8206f6-40d3-4ad9-9c62-25301c696e75","Type":"ContainerStarted","Data":"17856718a940e642d2b88fa0ff5903fcd6f7d6d0862d60dd231abfb1616f8ea9"}
Jul 07 04:24:04.642371 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.642282    2568 generic.go:356] "Generic (PLEG): container finished" podID="016bf9dec8ec3160265788daa113acde" containerID="358492eac0e6cf18eb22b70e8bb16899dd2f92096616dd85bc323fff7332d056" exitCode=0
Jul 07 04:24:04.642371 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.642367    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal" event={"ID":"016bf9dec8ec3160265788daa113acde","Type":"ContainerDied","Data":"358492eac0e6cf18eb22b70e8bb16899dd2f92096616dd85bc323fff7332d056"}
Jul 07 04:24:04.673582 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.673554    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q5kxz" event={"ID":"a65c2a9d-2394-473d-bd17-db7eec281c80","Type":"ContainerStarted","Data":"c5b17e84dc62e05a572907c5f0cc1fc158ca65f8f253b3394811ac891a84ce55"}
Jul 07 04:24:04.683003 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.682978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" event={"ID":"7bdd1ad5-7005-4c96-8005-4983545d62d9","Type":"ContainerStarted","Data":"5c228009ac590bcef9d60ee39beffc6fa2c3ebda3fab02595f5721c4190b27c0"}
Jul 07 04:24:04.689693 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.689636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7bqc5" event={"ID":"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d","Type":"ContainerStarted","Data":"e579f440ebdb3a608d56fe36f2d8d8a9dc7712681fa3a09ea08b9a7f48857082"}
Jul 07 04:24:04.691787 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.691691    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerStarted","Data":"111a7d17ef5f2f65a40527560fabee95044ecafe9e35f57714fda65842a6639e"}
Jul 07 04:24:04.693410 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.693335    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8qwlw" event={"ID":"f3d1a701-7fd4-4b53-977f-dded6a385cdd","Type":"ContainerStarted","Data":"f0c05743118a1477453c37bf5f698017d585200efc2d283d25e476c2419dfc6e"}
Jul 07 04:24:04.699830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.699244    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal" event={"ID":"5e122e28a36009eb5aa8349191a2630e","Type":"ContainerStarted","Data":"3afd81de335b465c239c009c6bf058f2693f90c9f02343385ac262d54d52ea19"}
Jul 07 04:24:04.705108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.705083    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw" event={"ID":"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4","Type":"ContainerStarted","Data":"1ca7a415c921f8e2dbfa63334a6a804d1159d2e63392dac4db0f3c38d540f093"}
Jul 07 04:24:04.718759 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:04.718693    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-250.ec2.internal" podStartSLOduration=2.7186779 podStartE2EDuration="2.7186779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:04.718677191 +0000 UTC m=+4.606215990" watchObservedRunningTime="2026-07-07 04:24:04.7186779 +0000 UTC m=+4.606216702"
Jul 07 04:24:05.718638 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:05.718541    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal" event={"ID":"016bf9dec8ec3160265788daa113acde","Type":"ContainerStarted","Data":"46136086d6c4b80210c63275e5aaa5fafd1f492a382836b2f59e37524b9676bb"}
Jul 07 04:24:06.231735 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:06.231578    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:06.231735 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:06.231628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:06.231982 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.231819    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:06.231982 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.231893    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret podName:b93b525a-aebf-47a0-a974-319583d88a5d nodeName:}" failed. No retries permitted until 2026-07-07 04:24:10.231872793 +0000 UTC m=+10.119411586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret") pod "global-pull-secret-syncer-qlnzn" (UID: "b93b525a-aebf-47a0-a974-319583d88a5d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:06.232093 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.232084    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:06.232166 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.232137    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs podName:74bf3def-bf1b-4616-b263-6053719e4b63 nodeName:}" failed. No retries permitted until 2026-07-07 04:24:10.232123547 +0000 UTC m=+10.119662328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs") pod "network-metrics-daemon-tp8x8" (UID: "74bf3def-bf1b-4616-b263-6053719e4b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:06.333176 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:06.333040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:06.333461 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.333222    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 04:24:06.333461 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.333244    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 04:24:06.333461 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.333257    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4hwm2 for pod openshift-network-diagnostics/network-check-target-f2bll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:06.333461 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.333319    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2 podName:15b6ddd6-2b79-440b-8098-20a5252af8bf nodeName:}" failed. No retries permitted until 2026-07-07 04:24:10.333300393 +0000 UTC m=+10.220839175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hwm2" (UniqueName: "kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2") pod "network-check-target-f2bll" (UID: "15b6ddd6-2b79-440b-8098-20a5252af8bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:06.589368 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:06.588547    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:06.589368 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.588661    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:06.589368 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:06.589022    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:06.589368 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.589112    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:06.589368 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:06.589182    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:06.589368 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:06.589260    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:08.587780 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:08.585561    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:08.587780 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:08.585691    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:08.587780 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:08.586081    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:08.587780 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:08.586177    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:08.587780 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:08.587427    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:08.587780 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:08.587552    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:10.264425 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:10.264314    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:10.264425 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:10.264379    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:10.264927 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.264465    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:10.264927 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.264555    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret podName:b93b525a-aebf-47a0-a974-319583d88a5d nodeName:}" failed. No retries permitted until 2026-07-07 04:24:18.26453336 +0000 UTC m=+18.152072155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret") pod "global-pull-secret-syncer-qlnzn" (UID: "b93b525a-aebf-47a0-a974-319583d88a5d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:10.264927 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.264607    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:10.264927 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.264655    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs podName:74bf3def-bf1b-4616-b263-6053719e4b63 nodeName:}" failed. No retries permitted until 2026-07-07 04:24:18.264642881 +0000 UTC m=+18.152181660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs") pod "network-metrics-daemon-tp8x8" (UID: "74bf3def-bf1b-4616-b263-6053719e4b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:10.365286 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:10.365248    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:10.365469 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.365437    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 04:24:10.365469 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.365462    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 04:24:10.365582 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.365476    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4hwm2 for pod openshift-network-diagnostics/network-check-target-f2bll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:10.365582 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.365530    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2 podName:15b6ddd6-2b79-440b-8098-20a5252af8bf nodeName:}" failed. No retries permitted until 2026-07-07 04:24:18.365516963 +0000 UTC m=+18.253055742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hwm2" (UniqueName: "kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2") pod "network-check-target-f2bll" (UID: "15b6ddd6-2b79-440b-8098-20a5252af8bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:10.587288 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:10.587058    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:10.587288 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.587158    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:10.587536 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:10.587506    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:10.587616 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.587590    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:10.587743 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:10.587653    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:10.587743 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:10.587730    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:12.585419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:12.585387    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:12.585911 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:12.585513    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:12.585911 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:12.585876    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:12.586022 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:12.585961    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:12.586022 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:12.586014    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:12.586117 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:12.586065    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:14.587656 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:14.587617    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:14.588096 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:14.587741    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:14.588155 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:14.588111    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:14.588219 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:14.588188    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:14.588278 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:14.588243    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:14.588340 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:14.588322    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:16.585234 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:16.585202    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:16.585735 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:16.585247    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:16.585735 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:16.585363    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:16.585735 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:16.585455    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:16.585735 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:16.585481    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:16.585735 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:16.585587    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:18.326076 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.326040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:18.326518 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.326089    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:18.326518 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.326205    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:18.326518 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.326235    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:18.326518 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.326270    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret podName:b93b525a-aebf-47a0-a974-319583d88a5d nodeName:}" failed. No retries permitted until 2026-07-07 04:24:34.326250691 +0000 UTC m=+34.213789488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret") pod "global-pull-secret-syncer-qlnzn" (UID: "b93b525a-aebf-47a0-a974-319583d88a5d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:18.326518 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.326288    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs podName:74bf3def-bf1b-4616-b263-6053719e4b63 nodeName:}" failed. No retries permitted until 2026-07-07 04:24:34.326278788 +0000 UTC m=+34.213817569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs") pod "network-metrics-daemon-tp8x8" (UID: "74bf3def-bf1b-4616-b263-6053719e4b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:18.428060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.426601    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:18.428060 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.426757    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 04:24:18.428060 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.426775    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 04:24:18.428060 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.426787    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4hwm2 for pod openshift-network-diagnostics/network-check-target-f2bll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:18.428060 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.426838    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2 podName:15b6ddd6-2b79-440b-8098-20a5252af8bf nodeName:}" failed. No retries permitted until 2026-07-07 04:24:34.42682069 +0000 UTC m=+34.314359486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hwm2" (UniqueName: "kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2") pod "network-check-target-f2bll" (UID: "15b6ddd6-2b79-440b-8098-20a5252af8bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:18.586034 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.585533    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:18.586034 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.585533    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:18.586034 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.585784    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:18.586034 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.585576    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:18.586034 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.585861    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:18.586034 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:18.585977    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:18.746169 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.746090    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw" event={"ID":"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4","Type":"ContainerStarted","Data":"3015037192a326e7dee8119c18d6719870d49001832da3f2a2607994baf6c437"}
Jul 07 04:24:18.747604 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.747576    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p77tx" event={"ID":"d7395655-13b9-4c94-80ea-f371a9687b58","Type":"ContainerStarted","Data":"6508d7e39ddbc22aa241893daf86a988a7f0c901a4e684edd94eba56bd73f702"}
Jul 07 04:24:18.749213 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.749184    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xv5rb" event={"ID":"607766ce-6c56-44f6-9d7e-4f250460b207","Type":"ContainerStarted","Data":"14b4a5b67db76ec330f44f4b0cb53a0b1b1ac1627000b6c39a499b0e816a17ce"}
Jul 07 04:24:18.750983 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.750949    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vl59x" event={"ID":"da8206f6-40d3-4ad9-9c62-25301c696e75","Type":"ContainerStarted","Data":"dfc855d61307e4fb7ebbcabc07dce591c2613c73a2769811b5f419681d3565b5"}
Jul 07 04:24:18.752648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.752624    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q5kxz" event={"ID":"a65c2a9d-2394-473d-bd17-db7eec281c80","Type":"ContainerStarted","Data":"0c77eaa3e6a732282ac40fbe2d15fadbf0cab0f64a246d620f256e99b7e264ca"}
Jul 07 04:24:18.754542 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.754520    2568 generic.go:356] "Generic (PLEG): container finished" podID="7bdd1ad5-7005-4c96-8005-4983545d62d9" containerID="a306111a0215b0dc46c6b9930bd81e77fd1db68a3ef83b4b251191686f03179b" exitCode=0
Jul 07 04:24:18.754636 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.754591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" event={"ID":"7bdd1ad5-7005-4c96-8005-4983545d62d9","Type":"ContainerDied","Data":"a306111a0215b0dc46c6b9930bd81e77fd1db68a3ef83b4b251191686f03179b"}
Jul 07 04:24:18.756091 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.756071    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7bqc5" event={"ID":"23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d","Type":"ContainerStarted","Data":"9cf5426f0ecf30e4d898a58b4642b580439d8e5b03eac9a9b5093ceaf7048abf"}
Jul 07 04:24:18.766068 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.766031    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p77tx" podStartSLOduration=4.378731497 podStartE2EDuration="18.766018856s" totalImagesPullingTime="14.387287359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:18.76574234 +0000 UTC m=+18.653281145" watchObservedRunningTime="2026-07-07 04:24:18.766018856 +0000 UTC m=+18.653557657"
Jul 07 04:24:18.766154 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.766134    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-250.ec2.internal" podStartSLOduration=16.766129571 podStartE2EDuration="16.766129571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:05.7347549 +0000 UTC m=+5.622293708" watchObservedRunningTime="2026-07-07 04:24:18.766129571 +0000 UTC m=+18.653668372"
Jul 07 04:24:18.804138 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.804097    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vl59x" podStartSLOduration=4.374695115 podStartE2EDuration="18.804084644s" totalImagesPullingTime="14.429389529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:18.803674443 +0000 UTC m=+18.691213245" watchObservedRunningTime="2026-07-07 04:24:18.804084644 +0000 UTC m=+18.691623445"
Jul 07 04:24:18.818477 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.818437    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7bqc5" podStartSLOduration=4.430091578 podStartE2EDuration="18.818425471s" totalImagesPullingTime="14.388333893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:18.817830976 +0000 UTC m=+18.705369777" watchObservedRunningTime="2026-07-07 04:24:18.818425471 +0000 UTC m=+18.705964272"
Jul 07 04:24:18.830493 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.830468    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:18.831509 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.831478    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xv5rb" podStartSLOduration=4.438707965 podStartE2EDuration="18.831467565s" totalImagesPullingTime="14.3927596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:18.831118026 +0000 UTC m=+18.718656828" watchObservedRunningTime="2026-07-07 04:24:18.831467565 +0000 UTC m=+18.719006367"
Jul 07 04:24:18.847769 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:18.847721    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q5kxz" podStartSLOduration=4.432013847 podStartE2EDuration="18.847710347s" totalImagesPullingTime="14.4156965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:18.847606399 +0000 UTC m=+18.735145202" watchObservedRunningTime="2026-07-07 04:24:18.847710347 +0000 UTC m=+18.735249177"
Jul 07 04:24:19.991861 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:19.991834    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 04:24:20.567838 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:20.567727    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T04:24:19.991858317Z","UUID":"01a0ec04-d9c3-4623-aeea-3ea320ae7ee3","Handler":null,"Name":"","Endpoint":""}
Jul 07 04:24:20.570476 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:20.570223    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 04:24:20.570476 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:20.570270    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 04:24:20.588692 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:20.587641    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:20.588692 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:20.587781    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:20.588692 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:20.587972    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:20.588692 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:20.588104    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:20.588692 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:20.588482    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:20.588692 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:20.588602    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:20.762221 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:20.762188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8qwlw" event={"ID":"f3d1a701-7fd4-4b53-977f-dded6a385cdd","Type":"ContainerStarted","Data":"7d4cd6e495166ab602b42bd19a30db385311b20647ad70979c7dafbfb1287393"}
Jul 07 04:24:20.764919 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:20.764887    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw" event={"ID":"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4","Type":"ContainerStarted","Data":"c191ed7b17946a80004d63372d056e2640a51e23601e840fd11af5c9553ca81f"}
Jul 07 04:24:20.778406 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:20.778187    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8qwlw" podStartSLOduration=6.352427627 podStartE2EDuration="20.778167633s" totalImagesPullingTime="14.425740006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:20.777037616 +0000 UTC m=+20.664576419" watchObservedRunningTime="2026-07-07 04:24:20.778167633 +0000 UTC m=+20.665706435"
Jul 07 04:24:21.769377 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:21.769088    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw" event={"ID":"578c85e8-a1fe-45cc-8f7c-18db8b2d17f4","Type":"ContainerStarted","Data":"9524b0ce8ea856852791ef5c9fe4c9ff7006cd12e7c0a78f74c6d74c5ad19d88"}
Jul 07 04:24:22.585547 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:22.585465    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:22.585880 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:22.585597    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:22.585880 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:22.585612    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:22.585880 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:22.585642    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:22.585880 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:22.585787    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:22.585880 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:22.585871    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:22.820253 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:22.820199    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:22.820913 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:22.820880    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:22.836542 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:22.836467    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6wsrw" podStartSLOduration=6.311825318 podStartE2EDuration="22.83645326s" totalImagesPullingTime="16.524627942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:21.785599904 +0000 UTC m=+21.673138707" watchObservedRunningTime="2026-07-07 04:24:22.83645326 +0000 UTC m=+22.723992080"
Jul 07 04:24:23.774529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:23.774500    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p77tx"
Jul 07 04:24:24.585335 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:24.585304    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:24.585335 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:24.585319    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:24.585927 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:24.585438    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:24.585927 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:24.585496    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:24.585927 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:24.585539    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:24.585927 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:24.585650    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:26.585205 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:26.585164    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:26.585205 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:26.585202    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:26.585957 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:26.585164    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:26.585957 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:26.585299    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:26.585957 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:26.585430    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:26.585957 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:26.585507    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:28.585386 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.585221    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:28.585777 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.585230    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:28.585777 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:28.585492    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:28.585777 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.585278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:28.585777 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:28.585571    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:28.585777 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:28.585644    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:28.784024 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.783998    2568 generic.go:356] "Generic (PLEG): container finished" podID="7bdd1ad5-7005-4c96-8005-4983545d62d9" containerID="791d76578b66f58287cc9af701d3c841a73df89cfa9a030d4daa069830c4769d" exitCode=0
Jul 07 04:24:28.784147 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.784071    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" event={"ID":"7bdd1ad5-7005-4c96-8005-4983545d62d9","Type":"ContainerDied","Data":"791d76578b66f58287cc9af701d3c841a73df89cfa9a030d4daa069830c4769d"}
Jul 07 04:24:28.786844 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.786828    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:24:28.787126 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.787107    2568 generic.go:356] "Generic (PLEG): container finished" podID="491a93ac-9c61-4d51-a90d-0d32ee991667" containerID="fc1761ccd6c5ae6ace697dff1a0ff0eff9f1633519177da89dda96f04ffd0e4b" exitCode=1
Jul 07 04:24:28.787172 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.787140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerStarted","Data":"74e9c309b58ce097b87ff06e498a7df1a388511a933d32c02e5e617a4112a17b"}
Jul 07 04:24:28.787209 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.787193    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerStarted","Data":"8137c26e1eff4e97c54a09ed50f9db1a9c0a338b3302f5a1421fca1e5ebf65ce"}
Jul 07 04:24:28.787248 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.787225    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerStarted","Data":"8c494c1a3e3f09981008e14201a79c0932f4cbc450bad30da6f56264201bf2a8"}
Jul 07 04:24:28.787286 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.787260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerStarted","Data":"39113478cc9ef5e133f51f33a586cd11936382fd175b2aa38a621799cd885734"}
Jul 07 04:24:28.787317 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.787287    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerDied","Data":"fc1761ccd6c5ae6ace697dff1a0ff0eff9f1633519177da89dda96f04ffd0e4b"}
Jul 07 04:24:28.787362 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:28.787319    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerStarted","Data":"7b42d9c4fb7a6ac7a259afdc3a08cf77251644aaea7a5c5865fccc2a9322dcc4"}
Jul 07 04:24:30.585862 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:30.585832    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:30.586601 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:30.585916    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:30.586601 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:30.585964    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:30.586601 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:30.586014    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:30.586601 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:30.586052    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:30.586601 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:30.586113    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:30.792747 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:30.792710    2568 generic.go:356] "Generic (PLEG): container finished" podID="7bdd1ad5-7005-4c96-8005-4983545d62d9" containerID="c5ead1c91352779292a9701427e47946f19fe93172a3876bab826576e1de095f" exitCode=0
Jul 07 04:24:30.792904 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:30.792764    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" event={"ID":"7bdd1ad5-7005-4c96-8005-4983545d62d9","Type":"ContainerDied","Data":"c5ead1c91352779292a9701427e47946f19fe93172a3876bab826576e1de095f"}
Jul 07 04:24:31.797083 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:31.797056    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:24:31.797481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:31.797417    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerStarted","Data":"4f344eda1524d11ce9e95d4057c17feb29ee5aec326fda221750d62ec1858309"}
Jul 07 04:24:32.585789 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:32.585754    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:32.585968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:32.585763    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:32.585968 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:32.585865    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:32.585968 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:32.585883    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:32.585968 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:32.585950    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:32.586175 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:32.586004    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:32.801118 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:32.801085    2568 generic.go:356] "Generic (PLEG): container finished" podID="7bdd1ad5-7005-4c96-8005-4983545d62d9" containerID="3d39dc1e91ac32e1903e83a8c7eea39fc9be2128f005cc4cc0dbda50cd5d550a" exitCode=0
Jul 07 04:24:32.801505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:32.801129    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" event={"ID":"7bdd1ad5-7005-4c96-8005-4983545d62d9","Type":"ContainerDied","Data":"3d39dc1e91ac32e1903e83a8c7eea39fc9be2128f005cc4cc0dbda50cd5d550a"}
Jul 07 04:24:33.807303 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:33.807105    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:24:33.807870 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:33.807714    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerStarted","Data":"40558586f45efa1689538df577d5958ca75a0f936c18a01735b50e3fa03b2c1d"}
Jul 07 04:24:33.808805 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:33.807997    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:33.808805 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:33.808067    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:33.808805 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:33.808110    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:33.808805 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:33.808185    2568 scope.go:117] "RemoveContainer" containerID="fc1761ccd6c5ae6ace697dff1a0ff0eff9f1633519177da89dda96f04ffd0e4b"
Jul 07 04:24:33.827440 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:33.827415    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:33.829260 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:33.829242    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:24:34.349427 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:34.349387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:34.349427 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:34.349438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:34.349675 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.349547    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:34.349675 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.349559    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:34.349675 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.349624    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs podName:74bf3def-bf1b-4616-b263-6053719e4b63 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:06.349604912 +0000 UTC m=+66.237143694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs") pod "network-metrics-daemon-tp8x8" (UID: "74bf3def-bf1b-4616-b263-6053719e4b63") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 04:24:34.349675 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.349642    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret podName:b93b525a-aebf-47a0-a974-319583d88a5d nodeName:}" failed. No retries permitted until 2026-07-07 04:25:06.349633053 +0000 UTC m=+66.237171838 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret") pod "global-pull-secret-syncer-qlnzn" (UID: "b93b525a-aebf-47a0-a974-319583d88a5d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 04:24:34.450007 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:34.449967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:34.450185 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.450122    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 04:24:34.450185 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.450143    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 04:24:34.450185 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.450156    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4hwm2 for pod openshift-network-diagnostics/network-check-target-f2bll: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:34.450365 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.450220    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2 podName:15b6ddd6-2b79-440b-8098-20a5252af8bf nodeName:}" failed. No retries permitted until 2026-07-07 04:25:06.450202143 +0000 UTC m=+66.337740936 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hwm2" (UniqueName: "kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2") pod "network-check-target-f2bll" (UID: "15b6ddd6-2b79-440b-8098-20a5252af8bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 04:24:34.585453 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:34.585408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:34.585608 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:34.585408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:34.585608 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.585541    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:34.585608 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:34.585421    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:34.585777 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.585605    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:34.585777 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:34.585680    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:34.815887 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:34.815821    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:24:34.816316 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:34.816291    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" event={"ID":"491a93ac-9c61-4d51-a90d-0d32ee991667","Type":"ContainerStarted","Data":"e8105cd9c50acc76a46d62c72896a0786d69dc3cff856ec803ce4af2a59d0202"}
Jul 07 04:24:34.850759 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:34.850716    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf" podStartSLOduration=10.510457842 podStartE2EDuration="34.850702509s" totalImagesPullingTime="24.340244667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:34.850610659 +0000 UTC m=+34.738149475" watchObservedRunningTime="2026-07-07 04:24:34.850702509 +0000 UTC m=+34.738241310"
Jul 07 04:24:35.161726 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:35.161627    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qlnzn"]
Jul 07 04:24:35.161892 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:35.161768    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:35.161953 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:35.161906    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:35.162449 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:35.162415    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f2bll"]
Jul 07 04:24:35.162580 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:35.162500    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:35.162625 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:35.162583    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:35.164105 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:35.164087    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tp8x8"]
Jul 07 04:24:35.164230 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:35.164159    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:35.164303 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:35.164250    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:36.586206 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:36.586168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:36.586762 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:36.586169    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:36.586762 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:36.586316    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:36.586762 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:36.586308    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:36.586762 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:36.586444    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:36.586762 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:36.586536    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:37.826729 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:37.826692    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" event={"ID":"7bdd1ad5-7005-4c96-8005-4983545d62d9","Type":"ContainerStarted","Data":"3731eff8fbf95c5f62e83ea3e2b8d65fb2a6d82e5856b587621d6656a183f6cc"}
Jul 07 04:24:38.585116 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:38.585091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:38.585300 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:38.585099    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:38.585300 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:38.585178    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:38.585300 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:38.585239    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:38.585300 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:38.585255    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:38.585539 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:38.585382    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:38.831034 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:38.831007    2568 generic.go:356] "Generic (PLEG): container finished" podID="7bdd1ad5-7005-4c96-8005-4983545d62d9" containerID="3731eff8fbf95c5f62e83ea3e2b8d65fb2a6d82e5856b587621d6656a183f6cc" exitCode=0
Jul 07 04:24:38.831403 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:38.831058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" event={"ID":"7bdd1ad5-7005-4c96-8005-4983545d62d9","Type":"ContainerDied","Data":"3731eff8fbf95c5f62e83ea3e2b8d65fb2a6d82e5856b587621d6656a183f6cc"}
Jul 07 04:24:39.836158 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:39.836121    2568 generic.go:356] "Generic (PLEG): container finished" podID="7bdd1ad5-7005-4c96-8005-4983545d62d9" containerID="6d17796a9dcf90669573e95db33c10d20aeda6f442e99db64e891f85e1ade3f8" exitCode=0
Jul 07 04:24:39.836722 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:39.836173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" event={"ID":"7bdd1ad5-7005-4c96-8005-4983545d62d9","Type":"ContainerDied","Data":"6d17796a9dcf90669573e95db33c10d20aeda6f442e99db64e891f85e1ade3f8"}
Jul 07 04:24:40.586110 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:40.586074    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:40.586298 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:40.586161    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:40.586298 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:40.586179    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:40.586298 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:40.586264    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:40.586298 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:40.586286    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:40.586534 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:40.586320    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:40.841433 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:40.841341    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" event={"ID":"7bdd1ad5-7005-4c96-8005-4983545d62d9","Type":"ContainerStarted","Data":"81497d393afbacc718a60b448e561105f35f3a194741df20cb523a4280b61af5"}
Jul 07 04:24:40.863742 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:40.863691    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k7fzv" podStartSLOduration=9.961135993 podStartE2EDuration="40.863676034s" totalImagesPullingTime="30.902540041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:24:40.863455651 +0000 UTC m=+40.750994452" watchObservedRunningTime="2026-07-07 04:24:40.863676034 +0000 UTC m=+40.751214835"
Jul 07 04:24:42.585517 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:42.585486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:42.586009 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:42.585490    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:42.586009 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:42.585591    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:42.586009 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:42.585605    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:42.586009 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:42.585663    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:42.586009 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:42.585753    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:44.585370 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:44.585323    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:44.585370 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:44.585377    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:44.585852 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:44.585467    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:44.585852 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:44.585527    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:44.585852 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:44.585534    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:44.585852 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:44.585586    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:46.585567 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:46.585531    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:46.585567 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:46.585531    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:46.585567 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:46.585569    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:46.586039 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:46.585655    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:46.586039 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:46.585793    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:46.586039 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:46.585861    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:48.586041 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:48.586006    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:48.586041 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:48.586018    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:48.586041 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:48.586018    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:48.586610 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:48.586101    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:48.586610 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:48.586170    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:48.586610 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:48.586240    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:50.587261 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:50.587230    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:50.587630 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:50.587307    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:50.587630 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:50.587369    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:50.587630 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:50.587370    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:50.587630 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:50.587456    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:50.587630 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:50.587552    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:52.585402 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:52.585218    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:52.585923 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:52.585218    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:52.585923 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:52.585502    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:52.585923 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:52.585257    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:52.585923 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:52.585571    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:52.585923 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:52.585670    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:54.585231 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:54.585194    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:54.585633 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:54.585194    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:54.585633 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:54.585299    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qlnzn" podUID="b93b525a-aebf-47a0-a974-319583d88a5d"
Jul 07 04:24:54.585633 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:54.585207    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:54.585633 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:54.585379    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2bll" podUID="15b6ddd6-2b79-440b-8098-20a5252af8bf"
Jul 07 04:24:54.585633 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:24:54.585458    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tp8x8" podUID="74bf3def-bf1b-4616-b263-6053719e4b63"
Jul 07 04:24:56.331822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.331749    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-250.ec2.internal" event="NodeReady"
Jul 07 04:24:56.332155 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.331862    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 04:24:56.389142 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.389109    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-skwl7"]
Jul 07 04:24:56.390990 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.390968    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kjljj"]
Jul 07 04:24:56.391113 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.391073    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.392556 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.392536    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kjljj"
Jul 07 04:24:56.393512 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.393495    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 04:24:56.393610 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.393594    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qn6gg\""
Jul 07 04:24:56.394218 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.394206    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 04:24:56.394925 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.394902    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jlfpx\""
Jul 07 04:24:56.394973 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.394939    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 04:24:56.395447 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.395427    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 04:24:56.395447 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.395445    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 04:24:56.405645 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.405627    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-skwl7"]
Jul 07 04:24:56.412476 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.412451    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kjljj"]
Jul 07 04:24:56.516538 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.516503    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5bzd\" (UniqueName: \"kubernetes.io/projected/a8f14ab7-2568-41dd-a26d-def63b5b0991-kube-api-access-k5bzd\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.516538 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.516544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f14ab7-2568-41dd-a26d-def63b5b0991-metrics-tls\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.516747 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.516600    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7rnp\" (UniqueName: \"kubernetes.io/projected/ac4060ca-fe4c-4777-8a89-1d2c938825df-kube-api-access-s7rnp\") pod \"ingress-canary-kjljj\" (UID: \"ac4060ca-fe4c-4777-8a89-1d2c938825df\") " pod="openshift-ingress-canary/ingress-canary-kjljj"
Jul 07 04:24:56.516747 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.516626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac4060ca-fe4c-4777-8a89-1d2c938825df-cert\") pod \"ingress-canary-kjljj\" (UID: \"ac4060ca-fe4c-4777-8a89-1d2c938825df\") " pod="openshift-ingress-canary/ingress-canary-kjljj"
Jul 07 04:24:56.516747 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.516647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f14ab7-2568-41dd-a26d-def63b5b0991-tmp-dir\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.516747 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.516711    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f14ab7-2568-41dd-a26d-def63b5b0991-config-volume\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.585903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.585815    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:24:56.586056 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.585820    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:24:56.586056 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.585826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:24:56.588527 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.588481    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-krb48\""
Jul 07 04:24:56.588527 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.588481    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-krw7t\""
Jul 07 04:24:56.588527 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.588512    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 04:24:56.588776 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.588555    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 04:24:56.588776 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.588488    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 04:24:56.588776 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.588590    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 04:24:56.617124 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.617102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7rnp\" (UniqueName: \"kubernetes.io/projected/ac4060ca-fe4c-4777-8a89-1d2c938825df-kube-api-access-s7rnp\") pod \"ingress-canary-kjljj\" (UID: \"ac4060ca-fe4c-4777-8a89-1d2c938825df\") " pod="openshift-ingress-canary/ingress-canary-kjljj"
Jul 07 04:24:56.617214 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.617134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac4060ca-fe4c-4777-8a89-1d2c938825df-cert\") pod \"ingress-canary-kjljj\" (UID: \"ac4060ca-fe4c-4777-8a89-1d2c938825df\") " pod="openshift-ingress-canary/ingress-canary-kjljj"
Jul 07 04:24:56.617214 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.617149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f14ab7-2568-41dd-a26d-def63b5b0991-tmp-dir\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.617312 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.617270    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f14ab7-2568-41dd-a26d-def63b5b0991-config-volume\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.617389 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.617371    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5bzd\" (UniqueName: \"kubernetes.io/projected/a8f14ab7-2568-41dd-a26d-def63b5b0991-kube-api-access-k5bzd\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.617447 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.617417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f14ab7-2568-41dd-a26d-def63b5b0991-metrics-tls\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.617499 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.617455    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f14ab7-2568-41dd-a26d-def63b5b0991-tmp-dir\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.617848 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.617829    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f14ab7-2568-41dd-a26d-def63b5b0991-config-volume\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.621018 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.620999    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8f14ab7-2568-41dd-a26d-def63b5b0991-metrics-tls\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.621127 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.621111    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac4060ca-fe4c-4777-8a89-1d2c938825df-cert\") pod \"ingress-canary-kjljj\" (UID: \"ac4060ca-fe4c-4777-8a89-1d2c938825df\") " pod="openshift-ingress-canary/ingress-canary-kjljj"
Jul 07 04:24:56.625138 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.625117    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7rnp\" (UniqueName: \"kubernetes.io/projected/ac4060ca-fe4c-4777-8a89-1d2c938825df-kube-api-access-s7rnp\") pod \"ingress-canary-kjljj\" (UID: \"ac4060ca-fe4c-4777-8a89-1d2c938825df\") " pod="openshift-ingress-canary/ingress-canary-kjljj"
Jul 07 04:24:56.625659 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.625642    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5bzd\" (UniqueName: \"kubernetes.io/projected/a8f14ab7-2568-41dd-a26d-def63b5b0991-kube-api-access-k5bzd\") pod \"dns-default-skwl7\" (UID: \"a8f14ab7-2568-41dd-a26d-def63b5b0991\") " pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.701764 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.701707    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-skwl7"
Jul 07 04:24:56.706243 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.706225    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kjljj"
Jul 07 04:24:56.837488 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.837400    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kjljj"]
Jul 07 04:24:56.843363 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:56.843317    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4060ca_fe4c_4777_8a89_1d2c938825df.slice/crio-14e2e8ab2d2d04292eb51b55e3b933cb1e4e4fcea508e6ad5fd38ff25d13381a WatchSource:0}: Error finding container 14e2e8ab2d2d04292eb51b55e3b933cb1e4e4fcea508e6ad5fd38ff25d13381a: Status 404 returned error can't find the container with id 14e2e8ab2d2d04292eb51b55e3b933cb1e4e4fcea508e6ad5fd38ff25d13381a
Jul 07 04:24:56.851185 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.851160    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-skwl7"]
Jul 07 04:24:56.853622 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:56.853599    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f14ab7_2568_41dd_a26d_def63b5b0991.slice/crio-7a069ecd57cd7bd199a54de9df0a295bcff2ebf7b41aeb2174f81713e4f2973f WatchSource:0}: Error finding container 7a069ecd57cd7bd199a54de9df0a295bcff2ebf7b41aeb2174f81713e4f2973f: Status 404 returned error can't find the container with id 7a069ecd57cd7bd199a54de9df0a295bcff2ebf7b41aeb2174f81713e4f2973f
Jul 07 04:24:56.876877 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.876852    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kjljj" event={"ID":"ac4060ca-fe4c-4777-8a89-1d2c938825df","Type":"ContainerStarted","Data":"14e2e8ab2d2d04292eb51b55e3b933cb1e4e4fcea508e6ad5fd38ff25d13381a"}
Jul 07 04:24:56.877924 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:56.877901    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-skwl7" event={"ID":"a8f14ab7-2568-41dd-a26d-def63b5b0991","Type":"ContainerStarted","Data":"7a069ecd57cd7bd199a54de9df0a295bcff2ebf7b41aeb2174f81713e4f2973f"}
Jul 07 04:24:57.048446 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.048415    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-2p96g"]
Jul 07 04:24:57.050687 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.050673    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-2p96g"
Jul 07 04:24:57.053363 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.053322    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 04:24:57.053587 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.053570    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-c2dxl\""
Jul 07 04:24:57.053659 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.053641    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 04:24:57.066145 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.066126    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-2p96g"]
Jul 07 04:24:57.121891 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.121816    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndqhl\" (UniqueName: \"kubernetes.io/projected/cbb4cf33-73d9-4ea9-b70a-a5f0a3be25e7-kube-api-access-ndqhl\") pod \"downloads-685bfb5f64-2p96g\" (UID: \"cbb4cf33-73d9-4ea9-b70a-a5f0a3be25e7\") " pod="openshift-console/downloads-685bfb5f64-2p96g"
Jul 07 04:24:57.222610 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.222574    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndqhl\" (UniqueName: \"kubernetes.io/projected/cbb4cf33-73d9-4ea9-b70a-a5f0a3be25e7-kube-api-access-ndqhl\") pod \"downloads-685bfb5f64-2p96g\" (UID: \"cbb4cf33-73d9-4ea9-b70a-a5f0a3be25e7\") " pod="openshift-console/downloads-685bfb5f64-2p96g"
Jul 07 04:24:57.231101 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.231075    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndqhl\" (UniqueName: \"kubernetes.io/projected/cbb4cf33-73d9-4ea9-b70a-a5f0a3be25e7-kube-api-access-ndqhl\") pod \"downloads-685bfb5f64-2p96g\" (UID: \"cbb4cf33-73d9-4ea9-b70a-a5f0a3be25e7\") " pod="openshift-console/downloads-685bfb5f64-2p96g"
Jul 07 04:24:57.359292 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.359260    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-2p96g"
Jul 07 04:24:57.512895 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.512862    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-2p96g"]
Jul 07 04:24:57.516795 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:24:57.516755    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb4cf33_73d9_4ea9_b70a_a5f0a3be25e7.slice/crio-efe65e38e06f0028db0f732a036ed94bf94bdc3457efe4f08976bccc2b8f107c WatchSource:0}: Error finding container efe65e38e06f0028db0f732a036ed94bf94bdc3457efe4f08976bccc2b8f107c: Status 404 returned error can't find the container with id efe65e38e06f0028db0f732a036ed94bf94bdc3457efe4f08976bccc2b8f107c
Jul 07 04:24:57.883081 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:24:57.882999    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-2p96g" event={"ID":"cbb4cf33-73d9-4ea9-b70a-a5f0a3be25e7","Type":"ContainerStarted","Data":"efe65e38e06f0028db0f732a036ed94bf94bdc3457efe4f08976bccc2b8f107c"}
Jul 07 04:25:00.892905 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:00.892687    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kjljj" event={"ID":"ac4060ca-fe4c-4777-8a89-1d2c938825df","Type":"ContainerStarted","Data":"6463cfb2a02f738a1b15738a6e90288c3c53184633e28471da2a7b3cd8c19597"}
Jul 07 04:25:00.896023 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:00.895987    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-skwl7" event={"ID":"a8f14ab7-2568-41dd-a26d-def63b5b0991","Type":"ContainerStarted","Data":"ced05576f8ce4c1d0334196ae79ee71c64e9c87dac0496cdd403983cf3c01297"}
Jul 07 04:25:00.896144 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:00.896050    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-skwl7" event={"ID":"a8f14ab7-2568-41dd-a26d-def63b5b0991","Type":"ContainerStarted","Data":"bc12aeb8b1f1a0da7b5e1aeb8e1734065f1ee4073ccbf0e57a719ae076da9c23"}
Jul 07 04:25:00.896300 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:00.896214    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-skwl7"
Jul 07 04:25:00.907745 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:00.907509    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kjljj" podStartSLOduration=1.864347409 podStartE2EDuration="4.907490986s" totalImagesPullingTime="3.043143577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:00.906692907 +0000 UTC m=+60.794231707" watchObservedRunningTime="2026-07-07 04:25:00.907490986 +0000 UTC m=+60.795029789"
Jul 07 04:25:00.923510 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:00.923464    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-skwl7" podStartSLOduration=1.901103934 podStartE2EDuration="4.923448119s" totalImagesPullingTime="3.022344185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:00.92165509 +0000 UTC m=+60.809193892" watchObservedRunningTime="2026-07-07 04:25:00.923448119 +0000 UTC m=+60.810986920"
Jul 07 04:25:02.083234 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.083199    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"]
Jul 07 04:25:02.117744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.117704    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"]
Jul 07 04:25:02.117884 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.117819    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"
Jul 07 04:25:02.120237 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.120220    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 04:25:02.120308 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.120234    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-765tj\""
Jul 07 04:25:02.157554 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.157523    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/122e8c04-6923-4273-b19c-d4ce68a4d2df-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pbxkd\" (UID: \"122e8c04-6923-4273-b19c-d4ce68a4d2df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"
Jul 07 04:25:02.241891 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.241861    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mtng6"]
Jul 07 04:25:02.258038 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.257979    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/122e8c04-6923-4273-b19c-d4ce68a4d2df-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pbxkd\" (UID: \"122e8c04-6923-4273-b19c-d4ce68a4d2df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"
Jul 07 04:25:02.259507 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.259482    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mtng6"]
Jul 07 04:25:02.259634 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.259604    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.261207 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.261156    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/122e8c04-6923-4273-b19c-d4ce68a4d2df-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pbxkd\" (UID: \"122e8c04-6923-4273-b19c-d4ce68a4d2df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"
Jul 07 04:25:02.262115 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.262098    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 04:25:02.262253 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.262148    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xwn6d\""
Jul 07 04:25:02.262253 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.262154    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 04:25:02.262437 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.262422    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 04:25:02.262521 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.262500    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 04:25:02.358982 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.358896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57080347-9922-436d-9437-83ae84d55f24-data-volume\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.358982 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.358934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.358982 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.358963    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.359218 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.359028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xml4x\" (UniqueName: \"kubernetes.io/projected/57080347-9922-436d-9437-83ae84d55f24-kube-api-access-xml4x\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.359218 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.359102    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57080347-9922-436d-9437-83ae84d55f24-crio-socket\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.427451 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.427405    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"
Jul 07 04:25:02.460410 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.460383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57080347-9922-436d-9437-83ae84d55f24-data-volume\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.460545 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.460422    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.460545 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.460459    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.460545 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.460487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xml4x\" (UniqueName: \"kubernetes.io/projected/57080347-9922-436d-9437-83ae84d55f24-kube-api-access-xml4x\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.460689 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.460543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57080347-9922-436d-9437-83ae84d55f24-crio-socket\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.460689 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:02.460552    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 04:25:02.460689 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:02.460585    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 04:25:02.460689 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:02.460661    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm podName:57080347-9922-436d-9437-83ae84d55f24 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:02.960640308 +0000 UTC m=+62.848179088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mtng6" (UID: "57080347-9922-436d-9437-83ae84d55f24") : configmap "kube-rbac-proxy" not found
Jul 07 04:25:02.460689 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:02.460682    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls podName:57080347-9922-436d-9437-83ae84d55f24 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:02.960671679 +0000 UTC m=+62.848210460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mtng6" (UID: "57080347-9922-436d-9437-83ae84d55f24") : secret "insights-runtime-extractor-tls" not found
Jul 07 04:25:02.460934 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.460704    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57080347-9922-436d-9437-83ae84d55f24-crio-socket\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.460934 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.460733    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57080347-9922-436d-9437-83ae84d55f24-data-volume\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.468926 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.468902    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xml4x\" (UniqueName: \"kubernetes.io/projected/57080347-9922-436d-9437-83ae84d55f24-kube-api-access-xml4x\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.580108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.580077    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"]
Jul 07 04:25:02.584211 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:02.584180    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122e8c04_6923_4273_b19c_d4ce68a4d2df.slice/crio-a81f49f25cfabc494358a6e290f7dcfe7b6ab47f0789f524902e9119577746f6 WatchSource:0}: Error finding container a81f49f25cfabc494358a6e290f7dcfe7b6ab47f0789f524902e9119577746f6: Status 404 returned error can't find the container with id a81f49f25cfabc494358a6e290f7dcfe7b6ab47f0789f524902e9119577746f6
Jul 07 04:25:02.902554 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.902514    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd" event={"ID":"122e8c04-6923-4273-b19c-d4ce68a4d2df","Type":"ContainerStarted","Data":"a81f49f25cfabc494358a6e290f7dcfe7b6ab47f0789f524902e9119577746f6"}
Jul 07 04:25:02.965244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.965204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.965455 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:02.965256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:02.965455 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:02.965326    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 04:25:02.965455 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:02.965410    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm podName:57080347-9922-436d-9437-83ae84d55f24 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:03.965394386 +0000 UTC m=+63.852933164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mtng6" (UID: "57080347-9922-436d-9437-83ae84d55f24") : configmap "kube-rbac-proxy" not found
Jul 07 04:25:02.965455 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:02.965420    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 04:25:02.965610 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:02.965475    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls podName:57080347-9922-436d-9437-83ae84d55f24 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:03.965457899 +0000 UTC m=+63.852996698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mtng6" (UID: "57080347-9922-436d-9437-83ae84d55f24") : secret "insights-runtime-extractor-tls" not found
Jul 07 04:25:03.741403 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:03.741370    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-skwl7_a8f14ab7-2568-41dd-a26d-def63b5b0991/dns/0.log"
Jul 07 04:25:03.924847 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:03.924817    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-skwl7_a8f14ab7-2568-41dd-a26d-def63b5b0991/kube-rbac-proxy/0.log"
Jul 07 04:25:03.973557 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:03.973527    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:03.973689 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:03.973577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:03.973689 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:03.973624    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 04:25:03.973689 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:03.973686    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm podName:57080347-9922-436d-9437-83ae84d55f24 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:05.973667899 +0000 UTC m=+65.861206689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mtng6" (UID: "57080347-9922-436d-9437-83ae84d55f24") : configmap "kube-rbac-proxy" not found
Jul 07 04:25:03.973864 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:03.973703    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 04:25:03.973864 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:03.973745    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls podName:57080347-9922-436d-9437-83ae84d55f24 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:05.973727442 +0000 UTC m=+65.861266233 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mtng6" (UID: "57080347-9922-436d-9437-83ae84d55f24") : secret "insights-runtime-extractor-tls" not found
Jul 07 04:25:04.523665 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:04.523631    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xv5rb_607766ce-6c56-44f6-9d7e-4f250460b207/dns-node-resolver/0.log"
Jul 07 04:25:04.910636 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:04.910591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd" event={"ID":"122e8c04-6923-4273-b19c-d4ce68a4d2df","Type":"ContainerStarted","Data":"017ef3d45d86af11efe30d2648ce702a5a713871a3d839598d0b0131c72d4c73"}
Jul 07 04:25:04.911041 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:04.910830    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"
Jul 07 04:25:04.916335 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:04.916310    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd"
Jul 07 04:25:04.926285 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:04.926234    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pbxkd" podStartSLOduration=1.578593709 podStartE2EDuration="2.926216925s" totalImagesPullingTime="1.347623216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:04.92521842 +0000 UTC m=+64.812757224" watchObservedRunningTime="2026-07-07 04:25:04.926216925 +0000 UTC m=+64.813755718"
Jul 07 04:25:05.125018 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.124991    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7bqc5_23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d/node-ca/0.log"
Jul 07 04:25:05.140434 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.140407    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"]
Jul 07 04:25:05.142687 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.142668    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.145064 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.144933    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 04:25:05.145174 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.145064    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 04:25:05.145253 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.145230    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-z7dhn\""
Jul 07 04:25:05.145377 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.145332    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 04:25:05.145449 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.145332    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 04:25:05.145570 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.145555    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 04:25:05.153917 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.153898    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"]
Jul 07 04:25:05.185879 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.185805    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5004aad3-41a5-4c1f-a866-f859f222c789-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.186004 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.185913    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5004aad3-41a5-4c1f-a866-f859f222c789-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.186004 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.185942    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5004aad3-41a5-4c1f-a866-f859f222c789-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.186004 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.185964    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzfrj\" (UniqueName: \"kubernetes.io/projected/5004aad3-41a5-4c1f-a866-f859f222c789-kube-api-access-nzfrj\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.287203 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.287167    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5004aad3-41a5-4c1f-a866-f859f222c789-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.287412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.287240    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5004aad3-41a5-4c1f-a866-f859f222c789-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.287412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.287260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5004aad3-41a5-4c1f-a866-f859f222c789-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.287412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.287276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzfrj\" (UniqueName: \"kubernetes.io/projected/5004aad3-41a5-4c1f-a866-f859f222c789-kube-api-access-nzfrj\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.287586 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:05.287467    2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 07 04:25:05.287586 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:05.287527    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5004aad3-41a5-4c1f-a866-f859f222c789-prometheus-operator-tls podName:5004aad3-41a5-4c1f-a866-f859f222c789 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:05.787508547 +0000 UTC m=+65.675047334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5004aad3-41a5-4c1f-a866-f859f222c789-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-mfsgv" (UID: "5004aad3-41a5-4c1f-a866-f859f222c789") : secret "prometheus-operator-tls" not found
Jul 07 04:25:05.287955 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.287938    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5004aad3-41a5-4c1f-a866-f859f222c789-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.289540 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.289518    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5004aad3-41a5-4c1f-a866-f859f222c789-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.295482 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.295460    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzfrj\" (UniqueName: \"kubernetes.io/projected/5004aad3-41a5-4c1f-a866-f859f222c789-kube-api-access-nzfrj\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.792089 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.792048    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5004aad3-41a5-4c1f-a866-f859f222c789-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.794412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.794379    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5004aad3-41a5-4c1f-a866-f859f222c789-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-mfsgv\" (UID: \"5004aad3-41a5-4c1f-a866-f859f222c789\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:05.830658 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.830628    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-npkcf"
Jul 07 04:25:05.923396 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.923371    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kjljj_ac4060ca-fe4c-4777-8a89-1d2c938825df/serve-healthcheck-canary/0.log"
Jul 07 04:25:05.994179 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.994147    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:05.994364 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:05.994204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:05.994364 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:05.994265    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 04:25:05.994364 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:05.994337    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm podName:57080347-9922-436d-9437-83ae84d55f24 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:09.994317814 +0000 UTC m=+69.881856593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mtng6" (UID: "57080347-9922-436d-9437-83ae84d55f24") : configmap "kube-rbac-proxy" not found
Jul 07 04:25:05.994528 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:05.994394    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 04:25:05.994528 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:05.994451    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls podName:57080347-9922-436d-9437-83ae84d55f24 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:09.99443618 +0000 UTC m=+69.881974966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mtng6" (UID: "57080347-9922-436d-9437-83ae84d55f24") : secret "insights-runtime-extractor-tls" not found
Jul 07 04:25:06.052879 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.052811    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"
Jul 07 04:25:06.185099 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.185068    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv"]
Jul 07 04:25:06.188270 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:06.188239    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5004aad3_41a5_4c1f_a866_f859f222c789.slice/crio-5e097c86ae85f99cb41172e2e987614a96b8ab180bac1f3adb85dfab324d5427 WatchSource:0}: Error finding container 5e097c86ae85f99cb41172e2e987614a96b8ab180bac1f3adb85dfab324d5427: Status 404 returned error can't find the container with id 5e097c86ae85f99cb41172e2e987614a96b8ab180bac1f3adb85dfab324d5427
Jul 07 04:25:06.397475 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.397446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:25:06.397626 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.397497    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:25:06.400079 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.400052    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 04:25:06.400209 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.400106    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 04:25:06.410427 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.410401    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74bf3def-bf1b-4616-b263-6053719e4b63-metrics-certs\") pod \"network-metrics-daemon-tp8x8\" (UID: \"74bf3def-bf1b-4616-b263-6053719e4b63\") " pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:25:06.410427 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.410420    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b93b525a-aebf-47a0-a974-319583d88a5d-original-pull-secret\") pod \"global-pull-secret-syncer-qlnzn\" (UID: \"b93b525a-aebf-47a0-a974-319583d88a5d\") " pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:25:06.495891 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.495851    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qlnzn"
Jul 07 04:25:06.498134 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.498104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:25:06.500805 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.500782    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 04:25:06.510321 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.510297    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-krb48\""
Jul 07 04:25:06.511014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.510995    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 04:25:06.518811 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.518793    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tp8x8"
Jul 07 04:25:06.522755 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.522731    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hwm2\" (UniqueName: \"kubernetes.io/projected/15b6ddd6-2b79-440b-8098-20a5252af8bf-kube-api-access-4hwm2\") pod \"network-check-target-f2bll\" (UID: \"15b6ddd6-2b79-440b-8098-20a5252af8bf\") " pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:25:06.637101 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.637068    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qlnzn"]
Jul 07 04:25:06.641692 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:06.641662    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93b525a_aebf_47a0_a974_319583d88a5d.slice/crio-894e3f5a6b601cb9ec3ca888f810d1b6c41f92042443ead39c00c17abf6bee30 WatchSource:0}: Error finding container 894e3f5a6b601cb9ec3ca888f810d1b6c41f92042443ead39c00c17abf6bee30: Status 404 returned error can't find the container with id 894e3f5a6b601cb9ec3ca888f810d1b6c41f92042443ead39c00c17abf6bee30
Jul 07 04:25:06.659607 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.659501    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tp8x8"]
Jul 07 04:25:06.663982 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:06.663958    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74bf3def_bf1b_4616_b263_6053719e4b63.slice/crio-2d852af7ba757729a437b27f157605e4655c6c1288e6b62cc6b911aa08a68a16 WatchSource:0}: Error finding container 2d852af7ba757729a437b27f157605e4655c6c1288e6b62cc6b911aa08a68a16: Status 404 returned error can't find the container with id 2d852af7ba757729a437b27f157605e4655c6c1288e6b62cc6b911aa08a68a16
Jul 07 04:25:06.806893 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.806861    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-krw7t\""
Jul 07 04:25:06.815109 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.814867    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:25:06.919231 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.919199    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qlnzn" event={"ID":"b93b525a-aebf-47a0-a974-319583d88a5d","Type":"ContainerStarted","Data":"894e3f5a6b601cb9ec3ca888f810d1b6c41f92042443ead39c00c17abf6bee30"}
Jul 07 04:25:06.921926 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.921896    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv" event={"ID":"5004aad3-41a5-4c1f-a866-f859f222c789","Type":"ContainerStarted","Data":"5e097c86ae85f99cb41172e2e987614a96b8ab180bac1f3adb85dfab324d5427"}
Jul 07 04:25:06.923991 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.923959    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tp8x8" event={"ID":"74bf3def-bf1b-4616-b263-6053719e4b63","Type":"ContainerStarted","Data":"2d852af7ba757729a437b27f157605e4655c6c1288e6b62cc6b911aa08a68a16"}
Jul 07 04:25:06.964052 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:06.964012    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f2bll"]
Jul 07 04:25:06.967050 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:06.967020    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b6ddd6_2b79_440b_8098_20a5252af8bf.slice/crio-110ca548eecf869a89b00f142eb49a4ab848490fcaa6771fc8f85a6ab13fecbf WatchSource:0}: Error finding container 110ca548eecf869a89b00f142eb49a4ab848490fcaa6771fc8f85a6ab13fecbf: Status 404 returned error can't find the container with id 110ca548eecf869a89b00f142eb49a4ab848490fcaa6771fc8f85a6ab13fecbf
Jul 07 04:25:07.929724 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:07.929684    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f2bll" event={"ID":"15b6ddd6-2b79-440b-8098-20a5252af8bf","Type":"ContainerStarted","Data":"110ca548eecf869a89b00f142eb49a4ab848490fcaa6771fc8f85a6ab13fecbf"}
Jul 07 04:25:09.545742 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.545700    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d4fc99cb-9pc4m"]
Jul 07 04:25:09.560275 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.560244    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d4fc99cb-9pc4m"]
Jul 07 04:25:09.560451 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.560397    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.564141 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.564118    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 04:25:09.564282 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.564177    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n4kp4\""
Jul 07 04:25:09.564282 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.564118    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 04:25:09.564282 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.564120    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 04:25:09.565100 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.565059    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 04:25:09.567083 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.567056    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 04:25:09.574400 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.574377    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 04:25:09.621944 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.621908    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-config\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.622112 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.621971    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-oauth-serving-cert\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.622112 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.622057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-serving-cert\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.622112 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.622098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-oauth-config\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.622234 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.622121    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-service-ca\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.622234 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.622140    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-trusted-ca-bundle\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.622234 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.622156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-955j9\" (UniqueName: \"kubernetes.io/projected/97ae3311-d68a-4b67-8767-3b40036ac4f0-kube-api-access-955j9\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.723235 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.723197    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-trusted-ca-bundle\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.723235 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.723235    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-955j9\" (UniqueName: \"kubernetes.io/projected/97ae3311-d68a-4b67-8767-3b40036ac4f0-kube-api-access-955j9\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.723465 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.723287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-config\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.723465 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.723361    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-oauth-serving-cert\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.723465 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.723402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-serving-cert\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.723465 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.723438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-oauth-config\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.723465 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.723462    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-service-ca\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.724126 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.724093    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-config\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.724247 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.724215    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-service-ca\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.724530 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.724471    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-oauth-serving-cert\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.724750 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.724725    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-trusted-ca-bundle\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.726336 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.726313    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-serving-cert\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.726683 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.726658    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-oauth-config\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.734079 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.734058    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-955j9\" (UniqueName: \"kubernetes.io/projected/97ae3311-d68a-4b67-8767-3b40036ac4f0-kube-api-access-955j9\") pod \"console-86d4fc99cb-9pc4m\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") " pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:09.874313 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:09.874230    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:10.025631 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:10.025591    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:10.025823 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:10.025642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:10.026249 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:10.026222    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57080347-9922-436d-9437-83ae84d55f24-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:10.028298 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:10.028272    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57080347-9922-436d-9437-83ae84d55f24-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtng6\" (UID: \"57080347-9922-436d-9437-83ae84d55f24\") " pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:10.074215 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:10.074185    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mtng6"
Jul 07 04:25:10.901277 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:10.901246    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-skwl7"
Jul 07 04:25:18.093378 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.093313    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d4fc99cb-9pc4m"]
Jul 07 04:25:18.105120 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.105091    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mtng6"]
Jul 07 04:25:18.136582 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:18.136414    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ae3311_d68a_4b67_8767_3b40036ac4f0.slice/crio-60b83d6f67a0d326552a00be1393c05bb3bf287d630e15544267256a9a9e8274 WatchSource:0}: Error finding container 60b83d6f67a0d326552a00be1393c05bb3bf287d630e15544267256a9a9e8274: Status 404 returned error can't find the container with id 60b83d6f67a0d326552a00be1393c05bb3bf287d630e15544267256a9a9e8274
Jul 07 04:25:18.969913 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.969829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qlnzn" event={"ID":"b93b525a-aebf-47a0-a974-319583d88a5d","Type":"ContainerStarted","Data":"194ce6e262e4b860c9a51e37c799d8962a8133ff3a78e7282b3315e7c92bcc83"}
Jul 07 04:25:18.975512 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.974734    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv" event={"ID":"5004aad3-41a5-4c1f-a866-f859f222c789","Type":"ContainerStarted","Data":"7c02ca3e920224225722ee6471688c2ccdd44b6332d941b13a951bef140011d3"}
Jul 07 04:25:18.975512 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.974793    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv" event={"ID":"5004aad3-41a5-4c1f-a866-f859f222c789","Type":"ContainerStarted","Data":"ebffdfc5fcfeb9a62131157d249740f8eda7acb91688b05808d6b34dd4b0cb8e"}
Jul 07 04:25:18.977916 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.977857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4fc99cb-9pc4m" event={"ID":"97ae3311-d68a-4b67-8767-3b40036ac4f0","Type":"ContainerStarted","Data":"60b83d6f67a0d326552a00be1393c05bb3bf287d630e15544267256a9a9e8274"}
Jul 07 04:25:18.981706 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.981679    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tp8x8" event={"ID":"74bf3def-bf1b-4616-b263-6053719e4b63","Type":"ContainerStarted","Data":"5cecbdf0c3f1dd64d933517406756c5aee600a8a9b139bf42ba31f2d01662e66"}
Jul 07 04:25:18.981820 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.981732    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tp8x8" event={"ID":"74bf3def-bf1b-4616-b263-6053719e4b63","Type":"ContainerStarted","Data":"90c814a4af43a7e839d1c6e204186a971276ba835333485d1a6e3ee39e289a98"}
Jul 07 04:25:18.986201 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.986175    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f2bll" event={"ID":"15b6ddd6-2b79-440b-8098-20a5252af8bf","Type":"ContainerStarted","Data":"2bd340b90e75603e632e4952db53f32181fdcae2dd0d34513c55ee314070fe0a"}
Jul 07 04:25:18.986711 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.986665    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:25:18.988508 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.988419    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtng6" event={"ID":"57080347-9922-436d-9437-83ae84d55f24","Type":"ContainerStarted","Data":"561044dc3cc84f6737bcb8e9c6b97ca51f73742817a8c995903a9da4ac820970"}
Jul 07 04:25:18.992093 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.991342    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-2p96g" event={"ID":"cbb4cf33-73d9-4ea9-b70a-a5f0a3be25e7","Type":"ContainerStarted","Data":"bc93bd110f3d4d45a0b90408c5a6cb004751a5996c29b146148927943a0196a4"}
Jul 07 04:25:18.992093 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.992033    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-2p96g"
Jul 07 04:25:18.995188 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:18.995009    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qlnzn" podStartSLOduration=67.682355694 podStartE2EDuration="1m18.994994728s" totalImagesPullingTime="11.312639034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:18.994842441 +0000 UTC m=+78.882381261" watchObservedRunningTime="2026-07-07 04:25:18.994994728 +0000 UTC m=+78.882533530"
Jul 07 04:25:19.004019 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:19.003966    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-2p96g"
Jul 07 04:25:19.062226 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:19.062161    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f2bll" podStartSLOduration=67.767391983 podStartE2EDuration="1m19.06213838s" totalImagesPullingTime="11.294746397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:19.02470247 +0000 UTC m=+78.912241272" watchObservedRunningTime="2026-07-07 04:25:19.06213838 +0000 UTC m=+78.949677182"
Jul 07 04:25:19.088666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:19.088313    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tp8x8" podStartSLOduration=67.805918452 podStartE2EDuration="1m19.088243921s" totalImagesPullingTime="11.282325469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:19.062764303 +0000 UTC m=+78.950303105" watchObservedRunningTime="2026-07-07 04:25:19.088243921 +0000 UTC m=+78.975782722"
Jul 07 04:25:19.088879 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:19.088735    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-2p96g" podStartSLOduration=1.630085942 podStartE2EDuration="22.088727861s" totalImagesPullingTime="20.458641919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:19.087259879 +0000 UTC m=+78.974798692" watchObservedRunningTime="2026-07-07 04:25:19.088727861 +0000 UTC m=+78.976266663"
Jul 07 04:25:19.120527 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:19.120466    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-mfsgv" podStartSLOduration=2.367662498 podStartE2EDuration="14.120443914s" totalImagesPullingTime="11.752781416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:19.119773488 +0000 UTC m=+79.007312290" watchObservedRunningTime="2026-07-07 04:25:19.120443914 +0000 UTC m=+79.007982717"
Jul 07 04:25:21.499385 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.499313    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"]
Jul 07 04:25:21.525435 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.525398    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"]
Jul 07 04:25:21.525656 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.525633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.530665 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.530460    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 04:25:21.531205 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.531096    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 04:25:21.533975 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.533090    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lk6kt\""
Jul 07 04:25:21.551877 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.551842    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"]
Jul 07 04:25:21.552008 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.551905    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kcxs2"]
Jul 07 04:25:21.552577 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.552552    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.555378 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.555022    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 04:25:21.556017 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.555774    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 04:25:21.556419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.556390    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-68wbb\""
Jul 07 04:25:21.557367 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.557335    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 04:25:21.579921 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.578916    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"]
Jul 07 04:25:21.579921 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.579088    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.585269 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.584284    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 04:25:21.585269 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.584389    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8825k\""
Jul 07 04:25:21.585269 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.584291    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 04:25:21.585269 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.584622    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 04:25:21.619370 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twhd\" (UniqueName: \"kubernetes.io/projected/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-api-access-4twhd\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.619490 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619404    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.619490 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e89c1bd-83c9-44c1-953c-c5b50fe68656-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.619602 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619487    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e89c1bd-83c9-44c1-953c-c5b50fe68656-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.619602 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619513    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3705f8-703d-43ef-8d73-5d2bfd62b023-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.619602 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e89c1bd-83c9-44c1-953c-c5b50fe68656-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.619742 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619673    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.619915 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619894    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.619970 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619933    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4zsx\" (UniqueName: \"kubernetes.io/projected/3e89c1bd-83c9-44c1-953c-c5b50fe68656-kube-api-access-g4zsx\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.620009 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.619972    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e3705f8-703d-43ef-8d73-5d2bfd62b023-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.720555 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d597e577-8198-4c9b-ade3-15d893ec86ae-sys\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.720555 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twhd\" (UniqueName: \"kubernetes.io/projected/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-api-access-4twhd\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.720813 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-wtmp\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.720813 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.720813 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720689    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e89c1bd-83c9-44c1-953c-c5b50fe68656-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.720813 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720731    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-tls\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.720813 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720774    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5mkk\" (UniqueName: \"kubernetes.io/projected/d597e577-8198-4c9b-ade3-15d893ec86ae-kube-api-access-n5mkk\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.721015 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720820    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e89c1bd-83c9-44c1-953c-c5b50fe68656-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.721015 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3705f8-703d-43ef-8d73-5d2bfd62b023-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.721015 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720872    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.721015 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e89c1bd-83c9-44c1-953c-c5b50fe68656-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.721015 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720938    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.721015 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d597e577-8198-4c9b-ade3-15d893ec86ae-root\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.721015 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.720985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d597e577-8198-4c9b-ade3-15d893ec86ae-metrics-client-ca\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.721325 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.721019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-textfile\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.721325 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.721051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.721325 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.721085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4zsx\" (UniqueName: \"kubernetes.io/projected/3e89c1bd-83c9-44c1-953c-c5b50fe68656-kube-api-access-g4zsx\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.721325 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.721131    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.721325 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.721156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e3705f8-703d-43ef-8d73-5d2bfd62b023-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.721590 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.721567    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e3705f8-703d-43ef-8d73-5d2bfd62b023-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.723251 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:21.722918    2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 04:25:21.723251 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:21.722993    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-tls podName:2e3705f8-703d-43ef-8d73-5d2bfd62b023 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:22.22297354 +0000 UTC m=+82.110512339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-zs4rd" (UID: "2e3705f8-703d-43ef-8d73-5d2bfd62b023") : secret "kube-state-metrics-tls" not found
Jul 07 04:25:21.723251 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.723082    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3705f8-703d-43ef-8d73-5d2bfd62b023-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.723811 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.723777    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.724277 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.723912    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e89c1bd-83c9-44c1-953c-c5b50fe68656-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.730671 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.726276    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.730671 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.726316    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e89c1bd-83c9-44c1-953c-c5b50fe68656-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.730671 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.728562    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e89c1bd-83c9-44c1-953c-c5b50fe68656-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.733049 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.733007    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4zsx\" (UniqueName: \"kubernetes.io/projected/3e89c1bd-83c9-44c1-953c-c5b50fe68656-kube-api-access-g4zsx\") pod \"openshift-state-metrics-54cf96dfcf-9nmtb\" (UID: \"3e89c1bd-83c9-44c1-953c-c5b50fe68656\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:21.740733 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.740705    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twhd\" (UniqueName: \"kubernetes.io/projected/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-api-access-4twhd\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.821982    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-wtmp\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822048    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-tls\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5mkk\" (UniqueName: \"kubernetes.io/projected/d597e577-8198-4c9b-ade3-15d893ec86ae-kube-api-access-n5mkk\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822114    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:21.822237    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822249    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-wtmp\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:21.822318    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-tls podName:d597e577-8198-4c9b-ade3-15d893ec86ae nodeName:}" failed. No retries permitted until 2026-07-07 04:25:22.322292897 +0000 UTC m=+82.209831684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-tls") pod "node-exporter-kcxs2" (UID: "d597e577-8198-4c9b-ade3-15d893ec86ae") : secret "node-exporter-tls" not found
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822468    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d597e577-8198-4c9b-ade3-15d893ec86ae-root\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d597e577-8198-4c9b-ade3-15d893ec86ae-metrics-client-ca\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822539    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-textfile\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822543    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d597e577-8198-4c9b-ade3-15d893ec86ae-root\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822610    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822644    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d597e577-8198-4c9b-ade3-15d893ec86ae-sys\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822689    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823851 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822738    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d597e577-8198-4c9b-ade3-15d893ec86ae-sys\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823851 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.822809    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-textfile\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.823851 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.823071    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d597e577-8198-4c9b-ade3-15d893ec86ae-metrics-client-ca\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.826293 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.826250    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.834824 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.834800    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5mkk\" (UniqueName: \"kubernetes.io/projected/d597e577-8198-4c9b-ade3-15d893ec86ae-kube-api-access-n5mkk\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:21.842727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:21.842701    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"
Jul 07 04:25:22.226819 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:22.226750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:22.227091 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:22.226947    2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 04:25:22.227091 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:22.227015    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-tls podName:2e3705f8-703d-43ef-8d73-5d2bfd62b023 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:23.226992584 +0000 UTC m=+83.114531380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-zs4rd" (UID: "2e3705f8-703d-43ef-8d73-5d2bfd62b023") : secret "kube-state-metrics-tls" not found
Jul 07 04:25:22.327620 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:22.327565    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-tls\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:22.330011 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:22.329982    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d597e577-8198-4c9b-ade3-15d893ec86ae-node-exporter-tls\") pod \"node-exporter-kcxs2\" (UID: \"d597e577-8198-4c9b-ade3-15d893ec86ae\") " pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:22.493161 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:22.493093    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcxs2"
Jul 07 04:25:23.234594 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:23.234445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:23.237470 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:23.237444    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e3705f8-703d-43ef-8d73-5d2bfd62b023-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zs4rd\" (UID: \"2e3705f8-703d-43ef-8d73-5d2bfd62b023\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:23.366306 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:23.366176    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"
Jul 07 04:25:25.341023 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:25.340948    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd597e577_8198_4c9b_ade3_15d893ec86ae.slice/crio-509c44c05ceb1d4ac7dc5932620592e6efabd05123d3b5693480ada44eb059c9 WatchSource:0}: Error finding container 509c44c05ceb1d4ac7dc5932620592e6efabd05123d3b5693480ada44eb059c9: Status 404 returned error can't find the container with id 509c44c05ceb1d4ac7dc5932620592e6efabd05123d3b5693480ada44eb059c9
Jul 07 04:25:25.500234 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.500201    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd"]
Jul 07 04:25:25.504150 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:25.504119    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3705f8_703d_43ef_8d73_5d2bfd62b023.slice/crio-64606f38c397c7903026d21e7488d65b667d3e330bd5db9139d3b8d07baf19d7 WatchSource:0}: Error finding container 64606f38c397c7903026d21e7488d65b667d3e330bd5db9139d3b8d07baf19d7: Status 404 returned error can't find the container with id 64606f38c397c7903026d21e7488d65b667d3e330bd5db9139d3b8d07baf19d7
Jul 07 04:25:25.514644 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.514567    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb"]
Jul 07 04:25:25.517860 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:25.517831    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e89c1bd_83c9_44c1_953c_c5b50fe68656.slice/crio-342d418e937020e3de9d865897d16f6a38cd3525adeb9e036f3477e2ed946ecd WatchSource:0}: Error finding container 342d418e937020e3de9d865897d16f6a38cd3525adeb9e036f3477e2ed946ecd: Status 404 returned error can't find the container with id 342d418e937020e3de9d865897d16f6a38cd3525adeb9e036f3477e2ed946ecd
Jul 07 04:25:25.827964 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.823717    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dc5448788-pp4dj"]
Jul 07 04:25:25.848387 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.847684    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dc5448788-pp4dj"]
Jul 07 04:25:25.848387 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.847800    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:25.851531 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.851228    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2wvrp\""
Jul 07 04:25:25.851531 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.851364    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 07 04:25:25.851531 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.851468    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 07 04:25:25.852655 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.852157    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 07 04:25:25.853102 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.852743    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 04:25:25.853102 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.852947    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3fn9bd9lgvfj4\""
Jul 07 04:25:25.960416 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.960312    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c033d94c-efec-4552-955d-5077a9dee85a-secret-metrics-server-client-certs\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:25.960416 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.960396    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c033d94c-efec-4552-955d-5077a9dee85a-audit-log\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:25.960614 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.960429    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c033d94c-efec-4552-955d-5077a9dee85a-client-ca-bundle\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:25.960614 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.960472    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c033d94c-efec-4552-955d-5077a9dee85a-metrics-server-audit-profiles\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:25.960614 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.960507    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c033d94c-efec-4552-955d-5077a9dee85a-secret-metrics-server-tls\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:25.960614 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.960548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c033d94c-efec-4552-955d-5077a9dee85a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:25.960614 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:25.960599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xbrg\" (UniqueName: \"kubernetes.io/projected/c033d94c-efec-4552-955d-5077a9dee85a-kube-api-access-2xbrg\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.025125 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.025046    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtng6" event={"ID":"57080347-9922-436d-9437-83ae84d55f24","Type":"ContainerStarted","Data":"c3d008d82c14425a270df7251f063705f682cb8ac205491c65dfb138edbedea5"}
Jul 07 04:25:26.026970 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.026905    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxs2" event={"ID":"d597e577-8198-4c9b-ade3-15d893ec86ae","Type":"ContainerStarted","Data":"509c44c05ceb1d4ac7dc5932620592e6efabd05123d3b5693480ada44eb059c9"}
Jul 07 04:25:26.028666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.028635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4fc99cb-9pc4m" event={"ID":"97ae3311-d68a-4b67-8767-3b40036ac4f0","Type":"ContainerStarted","Data":"6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1"}
Jul 07 04:25:26.030055 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.029980    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd" event={"ID":"2e3705f8-703d-43ef-8d73-5d2bfd62b023","Type":"ContainerStarted","Data":"64606f38c397c7903026d21e7488d65b667d3e330bd5db9139d3b8d07baf19d7"}
Jul 07 04:25:26.032237 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.032214    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb" event={"ID":"3e89c1bd-83c9-44c1-953c-c5b50fe68656","Type":"ContainerStarted","Data":"a38f004b3d79b5556390bb624a606d3797cd5254a801fd5f8bdeac1995da984d"}
Jul 07 04:25:26.032327 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.032266    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb" event={"ID":"3e89c1bd-83c9-44c1-953c-c5b50fe68656","Type":"ContainerStarted","Data":"6e45d165f3342ca059845f1afe738b19f501f9333b879b1d9898132c884afaf1"}
Jul 07 04:25:26.032327 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.032291    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb" event={"ID":"3e89c1bd-83c9-44c1-953c-c5b50fe68656","Type":"ContainerStarted","Data":"342d418e937020e3de9d865897d16f6a38cd3525adeb9e036f3477e2ed946ecd"}
Jul 07 04:25:26.054327 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.053961    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d4fc99cb-9pc4m" podStartSLOduration=9.856825228 podStartE2EDuration="17.053918911s" totalImagesPullingTime="7.197093683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:26.052055469 +0000 UTC m=+85.939594272" watchObservedRunningTime="2026-07-07 04:25:26.053918911 +0000 UTC m=+85.941457713"
Jul 07 04:25:26.062666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.061978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c033d94c-efec-4552-955d-5077a9dee85a-metrics-server-audit-profiles\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.062666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.062024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c033d94c-efec-4552-955d-5077a9dee85a-secret-metrics-server-tls\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.062666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.062062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c033d94c-efec-4552-955d-5077a9dee85a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.062666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.062105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xbrg\" (UniqueName: \"kubernetes.io/projected/c033d94c-efec-4552-955d-5077a9dee85a-kube-api-access-2xbrg\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.062666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.062143    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c033d94c-efec-4552-955d-5077a9dee85a-secret-metrics-server-client-certs\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.062666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.062183    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c033d94c-efec-4552-955d-5077a9dee85a-audit-log\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.062666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.062208    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c033d94c-efec-4552-955d-5077a9dee85a-client-ca-bundle\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.064143 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.064013    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c033d94c-efec-4552-955d-5077a9dee85a-audit-log\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.064143 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.064094    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c033d94c-efec-4552-955d-5077a9dee85a-metrics-server-audit-profiles\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.064814 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.064789    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c033d94c-efec-4552-955d-5077a9dee85a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.065378 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.065321    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c033d94c-efec-4552-955d-5077a9dee85a-client-ca-bundle\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.066784 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.066744    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c033d94c-efec-4552-955d-5077a9dee85a-secret-metrics-server-client-certs\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.067333 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.067291    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c033d94c-efec-4552-955d-5077a9dee85a-secret-metrics-server-tls\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.074467 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.074424    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xbrg\" (UniqueName: \"kubernetes.io/projected/c033d94c-efec-4552-955d-5077a9dee85a-kube-api-access-2xbrg\") pod \"metrics-server-5dc5448788-pp4dj\" (UID: \"c033d94c-efec-4552-955d-5077a9dee85a\") " pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.163013 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.162969    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:26.745198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:26.745155    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dc5448788-pp4dj"]
Jul 07 04:25:26.908540 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:26.908491    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc033d94c_efec_4552_955d_5077a9dee85a.slice/crio-3bb33e0f413ce0fb59aab0afa7fa1a0fbbc22415f52acf57f2246dc31638e1ba WatchSource:0}: Error finding container 3bb33e0f413ce0fb59aab0afa7fa1a0fbbc22415f52acf57f2246dc31638e1ba: Status 404 returned error can't find the container with id 3bb33e0f413ce0fb59aab0afa7fa1a0fbbc22415f52acf57f2246dc31638e1ba
Jul 07 04:25:27.040635 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.040577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj" event={"ID":"c033d94c-efec-4552-955d-5077a9dee85a","Type":"ContainerStarted","Data":"3bb33e0f413ce0fb59aab0afa7fa1a0fbbc22415f52acf57f2246dc31638e1ba"}
Jul 07 04:25:27.758180 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.758153    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 04:25:27.780502 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.780451    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 04:25:27.780654 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.780618    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.787388 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.783303    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 04:25:27.787388 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.783463    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 04:25:27.787388 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.783487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 04:25:27.787388 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.786765    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 04:25:27.787388 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.787040    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 04:25:27.787388 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.787266    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 04:25:27.787739 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.787591    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vhxbx\""
Jul 07 04:25:27.788180 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.787792    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 04:25:27.788180 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.787890    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 04:25:27.788180 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.788098    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3isp1b83s4tqp\""
Jul 07 04:25:27.789504 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.788908    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 04:25:27.789504 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.789112    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 04:25:27.789504 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.789213    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 04:25:27.789504 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.789305    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 04:25:27.790135 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.789804    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 04:25:27.796228 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.795633    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 04:25:27.880505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880658 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880516    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880658 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880658 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880658 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880623    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880658 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47mp\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-kube-api-access-b47mp\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880841 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880661    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880841 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880727    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-config\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880841 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880755    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880841 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880777    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880841 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880800    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.880841 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.881065 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880848    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.881065 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.881065 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880906    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.881065 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880932    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.881065 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.881065 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.880987    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.881065 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.881044    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.881283 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.881068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981689    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47mp\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-kube-api-access-b47mp\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981801    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981845    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-config\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981878    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.981990    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982013    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.982758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.983707 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982166    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.983707 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.983707 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.983707 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982289    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.983707 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.983707 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.982386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.983988 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.983812    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.983988 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.983891    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.984829 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.984204    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.984930 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.984905    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.988634 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.988612    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.990325 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.989028    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.990325 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.989541    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.990325 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:27.989647    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-trusted-ca-bundle podName:b1ef1a63-2b8d-4092-9732-6f67515ee012 nodeName:}" failed. No retries permitted until 2026-07-07 04:25:28.48962755 +0000 UTC m=+88.377166352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012") : configmap references non-existent config key: ca-bundle.crt
Jul 07 04:25:27.992573 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.992259    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.994936 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.994909    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.998058 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.997520    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.998058 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.998017    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.999535 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.999492    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-config\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:27.999890 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:27.999848    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:28.001050 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.000525    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:28.001050 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.000875    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:28.001967 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.001555    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:28.001967 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.001932    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:28.002780 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.002736    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47mp\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-kube-api-access-b47mp\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:28.002981 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.002940    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:28.050697 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.050562    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd" event={"ID":"2e3705f8-703d-43ef-8d73-5d2bfd62b023","Type":"ContainerStarted","Data":"2fa04d8c4f9970279bfa321538a09b31b8b847054898a8359c60051c569b7567"}
Jul 07 04:25:28.053389 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.053014    2568 generic.go:356] "Generic (PLEG): container finished" podID="d597e577-8198-4c9b-ade3-15d893ec86ae" containerID="c3ba855205ac1ee2a2a1748013dd9339730b4f3427886523cf0dacd443c26bb8" exitCode=0
Jul 07 04:25:28.053389 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.053068    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxs2" event={"ID":"d597e577-8198-4c9b-ade3-15d893ec86ae","Type":"ContainerDied","Data":"c3ba855205ac1ee2a2a1748013dd9339730b4f3427886523cf0dacd443c26bb8"}
Jul 07 04:25:28.185987 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.185894    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d4fc99cb-9pc4m"]
Jul 07 04:25:28.588463 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.588434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:28.589161 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.589133    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:28.701366 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:28.701318    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:29.317497 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:29.317473    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 04:25:29.440464 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:25:29.440439    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ef1a63_2b8d_4092_9732_6f67515ee012.slice/crio-be7df113339f35ab056cac89334a7217f53d3e572f2463b638da3208be346f70 WatchSource:0}: Error finding container be7df113339f35ab056cac89334a7217f53d3e572f2463b638da3208be346f70: Status 404 returned error can't find the container with id be7df113339f35ab056cac89334a7217f53d3e572f2463b638da3208be346f70
Jul 07 04:25:29.874807 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:29.874723    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:30.064454 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.064415    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtng6" event={"ID":"57080347-9922-436d-9437-83ae84d55f24","Type":"ContainerStarted","Data":"091f33e026559913cbfcec071cf5a07ac3b5ba0cd05b840b7a5744e734a7620a"}
Jul 07 04:25:30.066888 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.066860    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxs2" event={"ID":"d597e577-8198-4c9b-ade3-15d893ec86ae","Type":"ContainerStarted","Data":"32d0131bdd0fb4e91c9fb48eb14d63eaccecf5e2431df482199d34e9ab88ba2b"}
Jul 07 04:25:30.067010 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.066915    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxs2" event={"ID":"d597e577-8198-4c9b-ade3-15d893ec86ae","Type":"ContainerStarted","Data":"62228cfafb50444ca1dfaec4401eaabf3e732ee1bc578f2cbcac80d6657c23f6"}
Jul 07 04:25:30.069124 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.068923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj" event={"ID":"c033d94c-efec-4552-955d-5077a9dee85a","Type":"ContainerStarted","Data":"3ba2c40120bbb55b7a005abd531879c013b6ddfae6c5bdde3097e8ffbef2391f"}
Jul 07 04:25:30.070180 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.070141    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerStarted","Data":"be7df113339f35ab056cac89334a7217f53d3e572f2463b638da3208be346f70"}
Jul 07 04:25:30.072417 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.072379    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd" event={"ID":"2e3705f8-703d-43ef-8d73-5d2bfd62b023","Type":"ContainerStarted","Data":"42be09f2aaf07f83afab6eec25041649737567b3ef3d6b751ee939cf1c0fbb34"}
Jul 07 04:25:30.072507 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.072435    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd" event={"ID":"2e3705f8-703d-43ef-8d73-5d2bfd62b023","Type":"ContainerStarted","Data":"57ded2f58faba6558677e9cec099e43078f4019c159e14895cd35f575401ec6c"}
Jul 07 04:25:30.074534 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.074515    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb" event={"ID":"3e89c1bd-83c9-44c1-953c-c5b50fe68656","Type":"ContainerStarted","Data":"1fc881acccac71f5484629d643de0f28d3526a5c29f965b738a9fd641bc66fb3"}
Jul 07 04:25:30.110532 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.110491    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kcxs2" podStartSLOduration=6.963614115 podStartE2EDuration="9.110476874s" totalImagesPullingTime="2.040089363s" totalInitContainerRuntime="106.773396ms" isStatefulPod=true podCreationTimestamp="2026-07-07 04:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:30.108579777 +0000 UTC m=+89.996118579" watchObservedRunningTime="2026-07-07 04:25:30.110476874 +0000 UTC m=+89.998015652"
Jul 07 04:25:30.140031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.139948    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9nmtb" podStartSLOduration=5.96140845 podStartE2EDuration="9.139929637s" totalImagesPullingTime="3.178521187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:30.139573058 +0000 UTC m=+90.027111854" watchObservedRunningTime="2026-07-07 04:25:30.139929637 +0000 UTC m=+90.027468439"
Jul 07 04:25:30.171313 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.171258    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zs4rd" podStartSLOduration=6.984393238 podStartE2EDuration="9.171239315s" totalImagesPullingTime="2.186846077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:30.168769572 +0000 UTC m=+90.056308377" watchObservedRunningTime="2026-07-07 04:25:30.171239315 +0000 UTC m=+90.058778118"
Jul 07 04:25:30.220929 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:30.220872    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj" podStartSLOduration=2.67257603 podStartE2EDuration="5.220854364s" totalImagesPullingTime="2.548278334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:30.220707233 +0000 UTC m=+90.108246037" watchObservedRunningTime="2026-07-07 04:25:30.220854364 +0000 UTC m=+90.108393166"
Jul 07 04:25:33.089942 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:33.089858    2568 generic.go:356] "Generic (PLEG): container finished" podID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerID="a5954ce48c479122b9a410d92943a53c6186535b665db5a62ecd827743faf7dd" exitCode=0
Jul 07 04:25:33.090419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:33.089946    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerDied","Data":"a5954ce48c479122b9a410d92943a53c6186535b665db5a62ecd827743faf7dd"}
Jul 07 04:25:33.092098 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:33.092077    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtng6" event={"ID":"57080347-9922-436d-9437-83ae84d55f24","Type":"ContainerStarted","Data":"1f3fbf6f0f6776400d1dd27d78ef14c0e2f050e1f7aed899c32eb9be364b186e"}
Jul 07 04:25:33.141763 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:33.141714    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mtng6" podStartSLOduration=16.973554808 podStartE2EDuration="31.141699403s" totalImagesPullingTime="14.168144595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 04:25:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:33.140732271 +0000 UTC m=+93.028271072" watchObservedRunningTime="2026-07-07 04:25:33.141699403 +0000 UTC m=+93.029238204"
Jul 07 04:25:37.110313 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:37.110270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerStarted","Data":"3601191c5f93ca8ba1e0334a4d5130ac8d5c14cf455a7d3aafeedd6d329fa120"}
Jul 07 04:25:37.110790 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:37.110384    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerStarted","Data":"8a4c52e7815966fb018209c1c90eb89493017ef73c0a74bc7f783dfcf1fe52ac"}
Jul 07 04:25:40.126288 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:40.126209    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerStarted","Data":"c21e2771db6eee4e90f493c77fb064556c514ef3d4c77e8172c725c0ee4856a6"}
Jul 07 04:25:40.126288 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:40.126270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerStarted","Data":"231ee8e8fec84d647575055c7f868e7b3e112346992b02b2136cc53d312196fb"}
Jul 07 04:25:40.126766 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:40.126296    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerStarted","Data":"e92b542fc3bb8872b057b07fb2d11e513def07248f3a3c35a8d6ffc4fde13964"}
Jul 07 04:25:40.126766 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:40.126325    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerStarted","Data":"c0da4ef7a93f3bbe742dfdc56da1ec634ba8a4ea753665c077f8e3ec39adf065"}
Jul 07 04:25:40.162923 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:40.162877    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.888502923 podStartE2EDuration="13.162862369s" totalImagesPullingTime="9.250044994s" totalInitContainerRuntime="24.314452ms" isStatefulPod=false podCreationTimestamp="2026-07-07 04:25:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:25:40.161712965 +0000 UTC m=+100.049251767" watchObservedRunningTime="2026-07-07 04:25:40.162862369 +0000 UTC m=+100.050401170"
Jul 07 04:25:43.701630 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:43.701594    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:25:46.163327 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:46.163295    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:46.163779 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:46.163386    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:25:51.004626 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:51.004595    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f2bll"
Jul 07 04:25:53.208297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.208242    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86d4fc99cb-9pc4m" podUID="97ae3311-d68a-4b67-8767-3b40036ac4f0" containerName="console" containerID="cri-o://6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1" gracePeriod=15
Jul 07 04:25:53.463057 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.462993    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:53.497544 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.497520    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-955j9\" (UniqueName: \"kubernetes.io/projected/97ae3311-d68a-4b67-8767-3b40036ac4f0-kube-api-access-955j9\") pod \"97ae3311-d68a-4b67-8767-3b40036ac4f0\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") "
Jul 07 04:25:53.497677 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.497551    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-service-ca\") pod \"97ae3311-d68a-4b67-8767-3b40036ac4f0\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") "
Jul 07 04:25:53.497677 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.497571    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-trusted-ca-bundle\") pod \"97ae3311-d68a-4b67-8767-3b40036ac4f0\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") "
Jul 07 04:25:53.497677 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.497592    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-serving-cert\") pod \"97ae3311-d68a-4b67-8767-3b40036ac4f0\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") "
Jul 07 04:25:53.497677 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.497630    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-oauth-config\") pod \"97ae3311-d68a-4b67-8767-3b40036ac4f0\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") "
Jul 07 04:25:53.497677 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.497656    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-oauth-serving-cert\") pod \"97ae3311-d68a-4b67-8767-3b40036ac4f0\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") "
Jul 07 04:25:53.497959 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.497686    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-config\") pod \"97ae3311-d68a-4b67-8767-3b40036ac4f0\" (UID: \"97ae3311-d68a-4b67-8767-3b40036ac4f0\") "
Jul 07 04:25:53.498040 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.498013    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "97ae3311-d68a-4b67-8767-3b40036ac4f0" (UID: "97ae3311-d68a-4b67-8767-3b40036ac4f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:25:53.498553 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.498016    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "97ae3311-d68a-4b67-8767-3b40036ac4f0" (UID: "97ae3311-d68a-4b67-8767-3b40036ac4f0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:25:53.498553 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.498236    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-config" (OuterVolumeSpecName: "console-config") pod "97ae3311-d68a-4b67-8767-3b40036ac4f0" (UID: "97ae3311-d68a-4b67-8767-3b40036ac4f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:25:53.499141 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.499102    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "97ae3311-d68a-4b67-8767-3b40036ac4f0" (UID: "97ae3311-d68a-4b67-8767-3b40036ac4f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:25:53.500198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.500160    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ae3311-d68a-4b67-8767-3b40036ac4f0-kube-api-access-955j9" (OuterVolumeSpecName: "kube-api-access-955j9") pod "97ae3311-d68a-4b67-8767-3b40036ac4f0" (UID: "97ae3311-d68a-4b67-8767-3b40036ac4f0"). InnerVolumeSpecName "kube-api-access-955j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:25:53.500198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.500177    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "97ae3311-d68a-4b67-8767-3b40036ac4f0" (UID: "97ae3311-d68a-4b67-8767-3b40036ac4f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:25:53.500594 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.500570    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "97ae3311-d68a-4b67-8767-3b40036ac4f0" (UID: "97ae3311-d68a-4b67-8767-3b40036ac4f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:25:53.598901 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.598877    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-955j9\" (UniqueName: \"kubernetes.io/projected/97ae3311-d68a-4b67-8767-3b40036ac4f0-kube-api-access-955j9\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:25:53.598901 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.598897    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-service-ca\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:25:53.599033 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.598906    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-trusted-ca-bundle\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:25:53.599033 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.598914    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:25:53.599033 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.598922    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-oauth-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:25:53.599033 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.598930    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-oauth-serving-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:25:53.599033 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:53.598938    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97ae3311-d68a-4b67-8767-3b40036ac4f0-console-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:25:54.182016 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.181980    2568 generic.go:356] "Generic (PLEG): container finished" podID="97ae3311-d68a-4b67-8767-3b40036ac4f0" containerID="6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1" exitCode=0
Jul 07 04:25:54.182205 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.182048    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d4fc99cb-9pc4m"
Jul 07 04:25:54.182205 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.182067    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4fc99cb-9pc4m" event={"ID":"97ae3311-d68a-4b67-8767-3b40036ac4f0","Type":"ContainerDied","Data":"6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1"}
Jul 07 04:25:54.182205 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.182147    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d4fc99cb-9pc4m" event={"ID":"97ae3311-d68a-4b67-8767-3b40036ac4f0","Type":"ContainerDied","Data":"60b83d6f67a0d326552a00be1393c05bb3bf287d630e15544267256a9a9e8274"}
Jul 07 04:25:54.182205 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.182170    2568 scope.go:117] "RemoveContainer" containerID="6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1"
Jul 07 04:25:54.190716 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.190695    2568 scope.go:117] "RemoveContainer" containerID="6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1"
Jul 07 04:25:54.190962 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:25:54.190942    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1\": container with ID starting with 6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1 not found: ID does not exist" containerID="6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1"
Jul 07 04:25:54.191029 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.190974    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1"} err="failed to get container status \"6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1\": rpc error: code = NotFound desc = could not find container \"6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1\": container with ID starting with 6921e582f420653089e973e861a6e9836898d2a5b64af56b7492fd52d937c0d1 not found: ID does not exist"
Jul 07 04:25:54.215814 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.215788    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d4fc99cb-9pc4m"]
Jul 07 04:25:54.224031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.224003    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d4fc99cb-9pc4m"]
Jul 07 04:25:54.590931 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:25:54.590857    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ae3311-d68a-4b67-8767-3b40036ac4f0" path="/var/lib/kubelet/pods/97ae3311-d68a-4b67-8767-3b40036ac4f0/volumes"
Jul 07 04:26:06.168586 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:06.168555    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:26:06.172400 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:06.172383    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dc5448788-pp4dj"
Jul 07 04:26:28.701652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:28.701623    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:28.720450 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:28.720425    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:29.320176 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:29.320148    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:46.161958 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.161926    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 04:26:46.162432 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.162237    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="prometheus" containerID="cri-o://8a4c52e7815966fb018209c1c90eb89493017ef73c0a74bc7f783dfcf1fe52ac" gracePeriod=600
Jul 07 04:26:46.162432 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.162247    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy" containerID="cri-o://231ee8e8fec84d647575055c7f868e7b3e112346992b02b2136cc53d312196fb" gracePeriod=600
Jul 07 04:26:46.162432 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.162304    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy-web" containerID="cri-o://e92b542fc3bb8872b057b07fb2d11e513def07248f3a3c35a8d6ffc4fde13964" gracePeriod=600
Jul 07 04:26:46.162432 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.162323    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c21e2771db6eee4e90f493c77fb064556c514ef3d4c77e8172c725c0ee4856a6" gracePeriod=600
Jul 07 04:26:46.162432 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.162275    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="thanos-sidecar" containerID="cri-o://c0da4ef7a93f3bbe742dfdc56da1ec634ba8a4ea753665c077f8e3ec39adf065" gracePeriod=600
Jul 07 04:26:46.162432 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.162278    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="config-reloader" containerID="cri-o://3601191c5f93ca8ba1e0334a4d5130ac8d5c14cf455a7d3aafeedd6d329fa120" gracePeriod=600
Jul 07 04:26:46.370139 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370106    2568 generic.go:356] "Generic (PLEG): container finished" podID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerID="c21e2771db6eee4e90f493c77fb064556c514ef3d4c77e8172c725c0ee4856a6" exitCode=0
Jul 07 04:26:46.370139 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370136    2568 generic.go:356] "Generic (PLEG): container finished" podID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerID="231ee8e8fec84d647575055c7f868e7b3e112346992b02b2136cc53d312196fb" exitCode=0
Jul 07 04:26:46.370381 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370146    2568 generic.go:356] "Generic (PLEG): container finished" podID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerID="e92b542fc3bb8872b057b07fb2d11e513def07248f3a3c35a8d6ffc4fde13964" exitCode=0
Jul 07 04:26:46.370381 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370155    2568 generic.go:356] "Generic (PLEG): container finished" podID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerID="c0da4ef7a93f3bbe742dfdc56da1ec634ba8a4ea753665c077f8e3ec39adf065" exitCode=0
Jul 07 04:26:46.370381 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370163    2568 generic.go:356] "Generic (PLEG): container finished" podID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerID="3601191c5f93ca8ba1e0334a4d5130ac8d5c14cf455a7d3aafeedd6d329fa120" exitCode=0
Jul 07 04:26:46.370381 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370171    2568 generic.go:356] "Generic (PLEG): container finished" podID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerID="8a4c52e7815966fb018209c1c90eb89493017ef73c0a74bc7f783dfcf1fe52ac" exitCode=0
Jul 07 04:26:46.370381 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerDied","Data":"c21e2771db6eee4e90f493c77fb064556c514ef3d4c77e8172c725c0ee4856a6"}
Jul 07 04:26:46.370381 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370259    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerDied","Data":"231ee8e8fec84d647575055c7f868e7b3e112346992b02b2136cc53d312196fb"}
Jul 07 04:26:46.370381 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370298    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerDied","Data":"e92b542fc3bb8872b057b07fb2d11e513def07248f3a3c35a8d6ffc4fde13964"}
Jul 07 04:26:46.370381 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370338    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerDied","Data":"c0da4ef7a93f3bbe742dfdc56da1ec634ba8a4ea753665c077f8e3ec39adf065"}
Jul 07 04:26:46.370669 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerDied","Data":"3601191c5f93ca8ba1e0334a4d5130ac8d5c14cf455a7d3aafeedd6d329fa120"}
Jul 07 04:26:46.370669 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.370436    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerDied","Data":"8a4c52e7815966fb018209c1c90eb89493017ef73c0a74bc7f783dfcf1fe52ac"}
Jul 07 04:26:46.418265 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.418206    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:46.496043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496007    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496059    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-config\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496094    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-1\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496125    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-config-out\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496161    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-db\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496190    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-tls-assets\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496223    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-trusted-ca-bundle\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496251    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-0\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496283    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-kubelet-serving-ca-bundle\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496312    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-tls\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496342    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-thanos-prometheus-http-client-file\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496388    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-metrics-client-certs\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496438    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-kube-rbac-proxy\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496481 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496466    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b47mp\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-kube-api-access-b47mp\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496869 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496490    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-2\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496869 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496513    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-grpc-tls\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496869 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496538    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-serving-certs-ca-bundle\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496869 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496576    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-metrics-client-ca\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496869 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496608    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.496869 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.496636    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-web-config\") pod \"b1ef1a63-2b8d-4092-9732-6f67515ee012\" (UID: \"b1ef1a63-2b8d-4092-9732-6f67515ee012\") "
Jul 07 04:26:46.498925 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.498278    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:26:46.498925 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.498295    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:26:46.498925 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.498383    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:26:46.498925 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.498489    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:26:46.498925 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.498800    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:26:46.498925 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.498852    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:26:46.499469 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.499200    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:26:46.499528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.499500    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:26:46.499588 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.499506    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-config" (OuterVolumeSpecName: "config") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:26:46.499644 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.499597    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:26:46.500012 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.499985    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-config-out" (OuterVolumeSpecName: "config-out") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:26:46.501267 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.501221    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:26:46.501415 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.501282    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:26:46.501598 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.501558    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-kube-api-access-b47mp" (OuterVolumeSpecName: "kube-api-access-b47mp") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "kube-api-access-b47mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:26:46.502068 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.502039    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:26:46.502193 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.502172    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:26:46.502263 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.502194    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:26:46.502526 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.502492    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:26:46.503068 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.503043    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:26:46.510484 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.510466    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-web-config" (OuterVolumeSpecName: "web-config") pod "b1ef1a63-2b8d-4092-9732-6f67515ee012" (UID: "b1ef1a63-2b8d-4092-9732-6f67515ee012"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 04:26:46.597421 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597400    2568 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597426    2568 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-metrics-client-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597440    2568 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-kube-rbac-proxy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597453    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b47mp\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-kube-api-access-b47mp\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597466    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597479    2568 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-grpc-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597492    2568 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597508    2568 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-metrics-client-ca\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597522    2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597534    2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-web-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597549    2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597562    2568 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-config\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597576    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597590    2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-config-out\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597610    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-db\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597624    2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1ef1a63-2b8d-4092-9732-6f67515ee012-tls-assets\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597638    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597651    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597665    2568 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1ef1a63-2b8d-4092-9732-6f67515ee012-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:46.597832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:46.597680    2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1ef1a63-2b8d-4092-9732-6f67515ee012-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:26:47.376616 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.376582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1ef1a63-2b8d-4092-9732-6f67515ee012","Type":"ContainerDied","Data":"be7df113339f35ab056cac89334a7217f53d3e572f2463b638da3208be346f70"}
Jul 07 04:26:47.377009 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.376628    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.377009 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.376668    2568 scope.go:117] "RemoveContainer" containerID="c21e2771db6eee4e90f493c77fb064556c514ef3d4c77e8172c725c0ee4856a6"
Jul 07 04:26:47.384342 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.384324    2568 scope.go:117] "RemoveContainer" containerID="231ee8e8fec84d647575055c7f868e7b3e112346992b02b2136cc53d312196fb"
Jul 07 04:26:47.391063 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.391046    2568 scope.go:117] "RemoveContainer" containerID="e92b542fc3bb8872b057b07fb2d11e513def07248f3a3c35a8d6ffc4fde13964"
Jul 07 04:26:47.397298 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.397279    2568 scope.go:117] "RemoveContainer" containerID="c0da4ef7a93f3bbe742dfdc56da1ec634ba8a4ea753665c077f8e3ec39adf065"
Jul 07 04:26:47.400649 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.400627    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 04:26:47.404027 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.404012    2568 scope.go:117] "RemoveContainer" containerID="3601191c5f93ca8ba1e0334a4d5130ac8d5c14cf455a7d3aafeedd6d329fa120"
Jul 07 04:26:47.410306 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.409684    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 04:26:47.414079 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.414041    2568 scope.go:117] "RemoveContainer" containerID="8a4c52e7815966fb018209c1c90eb89493017ef73c0a74bc7f783dfcf1fe52ac"
Jul 07 04:26:47.421024 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.421005    2568 scope.go:117] "RemoveContainer" containerID="a5954ce48c479122b9a410d92943a53c6186535b665db5a62ecd827743faf7dd"
Jul 07 04:26:47.434679 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434659    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 04:26:47.434924 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434913    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ae3311-d68a-4b67-8767-3b40036ac4f0" containerName="console"
Jul 07 04:26:47.434963 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434925    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ae3311-d68a-4b67-8767-3b40036ac4f0" containerName="console"
Jul 07 04:26:47.434963 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434935    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="init-config-reloader"
Jul 07 04:26:47.434963 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434941    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="init-config-reloader"
Jul 07 04:26:47.434963 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434952    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="config-reloader"
Jul 07 04:26:47.434963 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434958    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="config-reloader"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434966    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="prometheus"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434971    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="prometheus"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434981    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434986    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434993    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy-web"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.434998    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy-web"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435004    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="thanos-sidecar"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435009    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="thanos-sidecar"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435016    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy-thanos"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435021    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy-thanos"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435057    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="97ae3311-d68a-4b67-8767-3b40036ac4f0" containerName="console"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435066    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435072    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="config-reloader"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435078    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy-web"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435084    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="prometheus"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435090    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="thanos-sidecar"
Jul 07 04:26:47.435108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.435095    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" containerName="kube-rbac-proxy-thanos"
Jul 07 04:26:47.438519 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.438505    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.441315 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.441292    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3isp1b83s4tqp\""
Jul 07 04:26:47.441434 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.441293    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 04:26:47.441862 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.441844    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 04:26:47.441862 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.441855    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 04:26:47.442171 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.442154    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 04:26:47.442253 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.442221    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 04:26:47.442505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.442484    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 04:26:47.442505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.442499    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vhxbx\""
Jul 07 04:26:47.442633 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.442489    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 04:26:47.442633 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.442543    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 04:26:47.442633 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.442496    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 04:26:47.442833 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.442820    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 04:26:47.442980 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.442967    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 04:26:47.443229 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.443216    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 04:26:47.445441 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.445390    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 04:26:47.449091 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.449073    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 04:26:47.456540 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.456519    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 04:26:47.503319 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503292    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503319 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503325    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503522 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503374    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-config-out\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503522 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503419    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503522 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503458    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503522 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503522 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503703 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503552    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-config\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503703 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503585    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503703 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503614    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503703 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503649    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503703 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503680    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503711    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503725    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503743    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503802    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503834    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-web-config\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.503922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.503888    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jbgn\" (UniqueName: \"kubernetes.io/projected/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-kube-api-access-5jbgn\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.604775 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.604746    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-config-out\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.604775 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.604776    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.604977 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.604793    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.604977 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.604813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.604977 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.604966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605136 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-config\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605136 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605136 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605090    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605136 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605124    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605336 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605154    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605336 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605336 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605336 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605259    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605336 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605336 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605319    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-web-config\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605406    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605433    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jbgn\" (UniqueName: \"kubernetes.io/projected/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-kube-api-access-5jbgn\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605477    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605482    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.605891 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.605828    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.606042 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.606020    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.606300 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.606154    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.606300 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.606175    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.606706 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.606474    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.607970 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.607942    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.608452 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.608116    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.608452 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.608118    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.608452 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.608340    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-config\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.608649 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.608518    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.608876 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.608855    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-config-out\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.609001 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.608881    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.609328 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.609301    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.609443 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.609308    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.609976 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.609952    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.610637 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.610618    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.610877 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.610855    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.611072 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.611055    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-web-config\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.611672 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.611655    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.618016 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.617993    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jbgn\" (UniqueName: \"kubernetes.io/projected/48b1c3ea-7afe-4fa8-81e1-db71cc63a869-kube-api-access-5jbgn\") pod \"prometheus-k8s-0\" (UID: \"48b1c3ea-7afe-4fa8-81e1-db71cc63a869\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.749443 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.749334    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:26:47.893295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:47.893271    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 04:26:47.895031 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:26:47.895012    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b1c3ea_7afe_4fa8_81e1_db71cc63a869.slice/crio-a1a9c2bcff978af66b3329e467ed297d891bb86bb3431f1884d9759e764c9682 WatchSource:0}: Error finding container a1a9c2bcff978af66b3329e467ed297d891bb86bb3431f1884d9759e764c9682: Status 404 returned error can't find the container with id a1a9c2bcff978af66b3329e467ed297d891bb86bb3431f1884d9759e764c9682
Jul 07 04:26:48.381509 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:48.381477    2568 generic.go:356] "Generic (PLEG): container finished" podID="48b1c3ea-7afe-4fa8-81e1-db71cc63a869" containerID="a34116512b5dff6cac3045b4cfc10dc3be5fc5437e44a6c269d5cc9922afdd0a" exitCode=0
Jul 07 04:26:48.381997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:48.381569    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48b1c3ea-7afe-4fa8-81e1-db71cc63a869","Type":"ContainerDied","Data":"a34116512b5dff6cac3045b4cfc10dc3be5fc5437e44a6c269d5cc9922afdd0a"}
Jul 07 04:26:48.381997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:48.381662    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48b1c3ea-7afe-4fa8-81e1-db71cc63a869","Type":"ContainerStarted","Data":"a1a9c2bcff978af66b3329e467ed297d891bb86bb3431f1884d9759e764c9682"}
Jul 07 04:26:48.593061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:48.592909    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1ef1a63-2b8d-4092-9732-6f67515ee012" path="/var/lib/kubelet/pods/b1ef1a63-2b8d-4092-9732-6f67515ee012/volumes"
Jul 07 04:26:49.393576 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:49.393533    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48b1c3ea-7afe-4fa8-81e1-db71cc63a869","Type":"ContainerStarted","Data":"1fcdbab3d5db0a202430a403b6c886d573b356a0a399542774b134b957517183"}
Jul 07 04:26:49.393989 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:49.393687    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48b1c3ea-7afe-4fa8-81e1-db71cc63a869","Type":"ContainerStarted","Data":"ab618ad70c277becb66675128ccacb6c1a29d44f3fc9299e55de36b1fd7ceae7"}
Jul 07 04:26:49.393989 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:49.393732    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48b1c3ea-7afe-4fa8-81e1-db71cc63a869","Type":"ContainerStarted","Data":"0359a60f763fa3bb08f555a5f0f121855b7bfe4c11630b554cc056e2b4c7e5ba"}
Jul 07 04:26:49.393989 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:49.393766    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48b1c3ea-7afe-4fa8-81e1-db71cc63a869","Type":"ContainerStarted","Data":"560f75836245ffd3d91b9556cc7ef9bab75c23d4bba3b482679d9d65862a242a"}
Jul 07 04:26:49.393989 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:49.393801    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48b1c3ea-7afe-4fa8-81e1-db71cc63a869","Type":"ContainerStarted","Data":"1c261046458549f1fac6947199db7e36938598873585d7aa47a112a1a8d03610"}
Jul 07 04:26:49.393989 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:49.393826    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48b1c3ea-7afe-4fa8-81e1-db71cc63a869","Type":"ContainerStarted","Data":"0e58c735417be81aed6c95c067467894f632f2041586a585da490a49d4856bcd"}
Jul 07 04:26:49.423041 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:49.422990    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4033714010000002 podStartE2EDuration="2.422975067s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.603666ms" isStatefulPod=false podCreationTimestamp="2026-07-07 04:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:26:49.421093327 +0000 UTC m=+169.308632140" watchObservedRunningTime="2026-07-07 04:26:49.422975067 +0000 UTC m=+169.310513868"
Jul 07 04:26:52.750030 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:26:52.749996    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:27:43.855283 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.855251    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"]
Jul 07 04:27:43.857412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.857393    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:43.860266 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.860240    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 04:27:43.860397 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.860273    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 04:27:43.860397 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.860291    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 04:27:43.860397 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.860299    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 04:27:43.861700 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.861669    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 04:27:43.861797 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.861719    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 04:27:43.861797 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.861735    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 04:27:43.869563 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:43.869543    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"]
Jul 07 04:27:44.040034 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.039998    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.040034 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.040032    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.040247 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.040054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6e1843-58cd-4ad7-921f-18181d2b9178-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.040247 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.040083    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-ca\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.040247 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.040106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfdzl\" (UniqueName: \"kubernetes.io/projected/cf6e1843-58cd-4ad7-921f-18181d2b9178-kube-api-access-qfdzl\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.040247 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.040134    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-hub\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.140974 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.140877    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.140974 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.140918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.140974 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.140948    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6e1843-58cd-4ad7-921f-18181d2b9178-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.141251 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.140987    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-ca\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.141251 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.141010    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfdzl\" (UniqueName: \"kubernetes.io/projected/cf6e1843-58cd-4ad7-921f-18181d2b9178-kube-api-access-qfdzl\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.141251 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.141040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-hub\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.141753 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.141726    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6e1843-58cd-4ad7-921f-18181d2b9178-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.143412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.143386    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.143412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.143399    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-ca\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.143803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.143783    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-hub\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.143871 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.143824    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf6e1843-58cd-4ad7-921f-18181d2b9178-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.149247 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.149229    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfdzl\" (UniqueName: \"kubernetes.io/projected/cf6e1843-58cd-4ad7-921f-18181d2b9178-kube-api-access-qfdzl\") pod \"cluster-proxy-proxy-agent-78798f5c84-zb9rn\" (UID: \"cf6e1843-58cd-4ad7-921f-18181d2b9178\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.174247 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.174224    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"
Jul 07 04:27:44.300818 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.300796    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn"]
Jul 07 04:27:44.303219 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:27:44.303189    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf6e1843_58cd_4ad7_921f_18181d2b9178.slice/crio-053f2919376dd6d039f951facd2ddd2da0cbc8a3bff246a757560b9cb985409c WatchSource:0}: Error finding container 053f2919376dd6d039f951facd2ddd2da0cbc8a3bff246a757560b9cb985409c: Status 404 returned error can't find the container with id 053f2919376dd6d039f951facd2ddd2da0cbc8a3bff246a757560b9cb985409c
Jul 07 04:27:44.591310 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:44.591278    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn" event={"ID":"cf6e1843-58cd-4ad7-921f-18181d2b9178","Type":"ContainerStarted","Data":"053f2919376dd6d039f951facd2ddd2da0cbc8a3bff246a757560b9cb985409c"}
Jul 07 04:27:47.605174 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:47.605150    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn" event={"ID":"cf6e1843-58cd-4ad7-921f-18181d2b9178","Type":"ContainerStarted","Data":"6ddf6fdf6673babdc8f645c57d15e2880542eef2550b4d628ab678918629e1c0"}
Jul 07 04:27:47.605491 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:47.605190    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn" event={"ID":"cf6e1843-58cd-4ad7-921f-18181d2b9178","Type":"ContainerStarted","Data":"5120eb04d7613853731a3bd98d7a833f6b4e9b7ba9b4a061ed7d07418da37389"}
Jul 07 04:27:47.750022 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:47.749938    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:27:47.765068 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:47.765043    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:27:48.609858 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:48.609822    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn" event={"ID":"cf6e1843-58cd-4ad7-921f-18181d2b9178","Type":"ContainerStarted","Data":"90a68064d863a36fcc479ad4902d7103b1a2671f16c5fa5d5b032b72948d2552"}
Jul 07 04:27:48.624703 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:48.624676    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 04:27:48.630038 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:27:48.629997    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78798f5c84-zb9rn" podStartSLOduration=2.447783212 podStartE2EDuration="5.62998372s" totalImagesPullingTime="3.182200508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:27:48.628249783 +0000 UTC m=+228.515788581" watchObservedRunningTime="2026-07-07 04:27:48.62998372 +0000 UTC m=+228.517522520"
Jul 07 04:28:47.226989 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.226955    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"]
Jul 07 04:28:47.229261 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.229240    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.231919 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.231901    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 04:28:47.232032 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.231928    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 04:28:47.232032 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.231945    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 04:28:47.232455 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.232440    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ftdh2\""
Jul 07 04:28:47.241702 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.241685    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 04:28:47.254302 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.254283    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"]
Jul 07 04:28:47.343958 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.343926    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4daa6319-36d1-435e-8b38-e6622dbf6202-tmp\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.344103 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.343962    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4daa6319-36d1-435e-8b38-e6622dbf6202-apiservice-cert\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.344103 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.343989    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4daa6319-36d1-435e-8b38-e6622dbf6202-webhook-cert\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.344103 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.344045    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4daa6319-36d1-435e-8b38-e6622dbf6202-manifests\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.344103 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.344073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trxmn\" (UniqueName: \"kubernetes.io/projected/4daa6319-36d1-435e-8b38-e6622dbf6202-kube-api-access-trxmn\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.445035 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.445001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4daa6319-36d1-435e-8b38-e6622dbf6202-apiservice-cert\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.445210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.445042    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4daa6319-36d1-435e-8b38-e6622dbf6202-webhook-cert\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.445210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.445067    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4daa6319-36d1-435e-8b38-e6622dbf6202-manifests\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.445210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.445093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trxmn\" (UniqueName: \"kubernetes.io/projected/4daa6319-36d1-435e-8b38-e6622dbf6202-kube-api-access-trxmn\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.445210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.445134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4daa6319-36d1-435e-8b38-e6622dbf6202-tmp\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.445540 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.445519    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4daa6319-36d1-435e-8b38-e6622dbf6202-manifests\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.447517 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.447495    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4daa6319-36d1-435e-8b38-e6622dbf6202-tmp\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.447622 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.447520    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4daa6319-36d1-435e-8b38-e6622dbf6202-apiservice-cert\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.447732 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.447712    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4daa6319-36d1-435e-8b38-e6622dbf6202-webhook-cert\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.452853 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.452831    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trxmn\" (UniqueName: \"kubernetes.io/projected/4daa6319-36d1-435e-8b38-e6622dbf6202-kube-api-access-trxmn\") pod \"opendatahub-operator-controller-manager-787b7c66b5-w7qbj\" (UID: \"4daa6319-36d1-435e-8b38-e6622dbf6202\") " pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.539667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.539601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:47.671064 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.671037    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"]
Jul 07 04:28:47.673488 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:28:47.673461    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4daa6319_36d1_435e_8b38_e6622dbf6202.slice/crio-133780f17b5fe1cbec2ca18708f81be4d1a6c20dd809a03141094cfee22df4e8 WatchSource:0}: Error finding container 133780f17b5fe1cbec2ca18708f81be4d1a6c20dd809a03141094cfee22df4e8: Status 404 returned error can't find the container with id 133780f17b5fe1cbec2ca18708f81be4d1a6c20dd809a03141094cfee22df4e8
Jul 07 04:28:47.829423 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:47.829328    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj" event={"ID":"4daa6319-36d1-435e-8b38-e6622dbf6202","Type":"ContainerStarted","Data":"133780f17b5fe1cbec2ca18708f81be4d1a6c20dd809a03141094cfee22df4e8"}
Jul 07 04:28:50.844774 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:50.844735    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj" event={"ID":"4daa6319-36d1-435e-8b38-e6622dbf6202","Type":"ContainerStarted","Data":"2d7ffb9df4200ea1edde46a72d0caac4af3d1d92dcae3eb660ab3157385a50ac"}
Jul 07 04:28:51.850282 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:51.850244    2568 generic.go:356] "Generic (PLEG): container finished" podID="4daa6319-36d1-435e-8b38-e6622dbf6202" containerID="2d7ffb9df4200ea1edde46a72d0caac4af3d1d92dcae3eb660ab3157385a50ac" exitCode=0
Jul 07 04:28:51.850700 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:51.850302    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj" event={"ID":"4daa6319-36d1-435e-8b38-e6622dbf6202","Type":"ContainerDied","Data":"2d7ffb9df4200ea1edde46a72d0caac4af3d1d92dcae3eb660ab3157385a50ac"}
Jul 07 04:28:52.856589 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:52.856557    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj" event={"ID":"4daa6319-36d1-435e-8b38-e6622dbf6202","Type":"ContainerStarted","Data":"4551baa1af01e8311db6d7a197fb4eebf5d08b122d8d24b3f9fb32a8bda36844"}
Jul 07 04:28:52.857080 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:52.856707    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:28:52.877630 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:28:52.877569    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj" podStartSLOduration=1.571102958 podStartE2EDuration="5.877548359s" totalImagesPullingTime="3.258414162s" totalInitContainerRuntime="1.048031239s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:28:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:28:52.876402002 +0000 UTC m=+292.763940804" watchObservedRunningTime="2026-07-07 04:28:52.877548359 +0000 UTC m=+292.765087160"
Jul 07 04:29:00.496176 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:00.496147    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:29:00.500114 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:00.500097    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 04:29:00.500887 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:00.500870    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:29:03.862672 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:03.862644    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-787b7c66b5-w7qbj"
Jul 07 04:29:14.386791 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.386756    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"]
Jul 07 04:29:14.389619 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.389597    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.392042 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.392020    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 04:29:14.392149 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.392104    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 04:29:14.392231 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.392216    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lxbtn\""
Jul 07 04:29:14.392308 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.392288    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 04:29:14.401129 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.401107    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"]
Jul 07 04:29:14.453611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.453577    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rr59\" (UniqueName: \"kubernetes.io/projected/139d6ebd-2a9d-41ad-8c72-cbd457d56818-kube-api-access-4rr59\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.453611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.453624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.453810 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.453647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.453810 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.453716    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.453810 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.453761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.453810 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.453806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.453944 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.453827    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.453944 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.453845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.453944 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.453871    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.554453 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554412    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.554611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554464    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.554611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.554611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554510    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.554611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.554611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554581    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.554611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.554894 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554677    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.554894 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rr59\" (UniqueName: \"kubernetes.io/projected/139d6ebd-2a9d-41ad-8c72-cbd457d56818-kube-api-access-4rr59\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.555003 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.554984    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.555055 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.555020    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.555110 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.555092    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.555307 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.555287    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.555502 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.555481    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.556915 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.556894    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.557014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.556901    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.570427 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.570392    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rr59\" (UniqueName: \"kubernetes.io/projected/139d6ebd-2a9d-41ad-8c72-cbd457d56818-kube-api-access-4rr59\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.570822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.570798    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/139d6ebd-2a9d-41ad-8c72-cbd457d56818-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w9l4s\" (UID: \"139d6ebd-2a9d-41ad-8c72-cbd457d56818\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.699857 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.699816    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:14.878382 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.878329    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"]
Jul 07 04:29:14.880665 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.880639    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:14.886860 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:29:14.886835    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139d6ebd_2a9d_41ad_8c72_cbd457d56818.slice/crio-59e93cc6e5e4267baf635ddbf9db994344b1e66aeb3569a285590a87c4adf8a4 WatchSource:0}: Error finding container 59e93cc6e5e4267baf635ddbf9db994344b1e66aeb3569a285590a87c4adf8a4: Status 404 returned error can't find the container with id 59e93cc6e5e4267baf635ddbf9db994344b1e66aeb3569a285590a87c4adf8a4
Jul 07 04:29:14.888305 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.888282    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"]
Jul 07 04:29:14.888785 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.888707    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 04:29:14.889045 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.889028    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 04:29:14.889132 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.889064    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 04:29:14.889254 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.889238    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-45rl8\""
Jul 07 04:29:14.890066 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.889673    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 04:29:14.890066 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.889710    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 04:29:14.890066 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.889922    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 04:29:14.910118 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.910094    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"]
Jul 07 04:29:14.945009 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.944965    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s" event={"ID":"139d6ebd-2a9d-41ad-8c72-cbd457d56818","Type":"ContainerStarted","Data":"59e93cc6e5e4267baf635ddbf9db994344b1e66aeb3569a285590a87c4adf8a4"}
Jul 07 04:29:14.958511 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.958453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r69z5\" (UniqueName: \"kubernetes.io/projected/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-kube-api-access-r69z5\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:14.958511 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.958501    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-cert\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:14.958652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.958519    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-manager-config\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:14.958652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:14.958589    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-metrics-cert\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.059852 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.059818    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-cert\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.059852 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.059856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-manager-config\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.060083 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.059878    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-metrics-cert\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.060083 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.059918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r69z5\" (UniqueName: \"kubernetes.io/projected/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-kube-api-access-r69z5\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.060471 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.060444    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-manager-config\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.062285 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.062262    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-cert\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.062393 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.062314    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-metrics-cert\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.068364 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.068322    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r69z5\" (UniqueName: \"kubernetes.io/projected/5bab7cc6-eb43-4fc7-abde-2c07f3421d1f-kube-api-access-r69z5\") pod \"lws-controller-manager-687876b94d-45hmc\" (UID: \"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f\") " pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.192981 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.192950    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:15.335060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.335038    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"]
Jul 07 04:29:15.336670 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:29:15.336643    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bab7cc6_eb43_4fc7_abde_2c07f3421d1f.slice/crio-a5289a60894ebb46076dea6c7e8d8c6441dd861619ed55b6045efb86381c04ac WatchSource:0}: Error finding container a5289a60894ebb46076dea6c7e8d8c6441dd861619ed55b6045efb86381c04ac: Status 404 returned error can't find the container with id a5289a60894ebb46076dea6c7e8d8c6441dd861619ed55b6045efb86381c04ac
Jul 07 04:29:15.952804 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:15.952759    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc" event={"ID":"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f","Type":"ContainerStarted","Data":"a5289a60894ebb46076dea6c7e8d8c6441dd861619ed55b6045efb86381c04ac"}
Jul 07 04:29:17.025703 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.025594    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"]
Jul 07 04:29:17.033105 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.033083    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:17.036126 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.036082    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 04:29:17.036291 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.036177    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rndhz\""
Jul 07 04:29:17.043625 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.043600    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"]
Jul 07 04:29:17.086246 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.086219    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rllsj\" (UniqueName: \"kubernetes.io/projected/9eaab48d-a857-48cc-9b42-695c96119a49-kube-api-access-rllsj\") pod \"kserve-controller-manager-d6f4b65b8-r96qx\" (UID: \"9eaab48d-a857-48cc-9b42-695c96119a49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:17.086397 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.086369    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eaab48d-a857-48cc-9b42-695c96119a49-cert\") pod \"kserve-controller-manager-d6f4b65b8-r96qx\" (UID: \"9eaab48d-a857-48cc-9b42-695c96119a49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:17.187419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.187382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eaab48d-a857-48cc-9b42-695c96119a49-cert\") pod \"kserve-controller-manager-d6f4b65b8-r96qx\" (UID: \"9eaab48d-a857-48cc-9b42-695c96119a49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:17.187652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.187445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rllsj\" (UniqueName: \"kubernetes.io/projected/9eaab48d-a857-48cc-9b42-695c96119a49-kube-api-access-rllsj\") pod \"kserve-controller-manager-d6f4b65b8-r96qx\" (UID: \"9eaab48d-a857-48cc-9b42-695c96119a49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:17.187652 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:29:17.187532    2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 07 04:29:17.187652 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:29:17.187612    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eaab48d-a857-48cc-9b42-695c96119a49-cert podName:9eaab48d-a857-48cc-9b42-695c96119a49 nodeName:}" failed. No retries permitted until 2026-07-07 04:29:17.687591312 +0000 UTC m=+317.575130092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9eaab48d-a857-48cc-9b42-695c96119a49-cert") pod "kserve-controller-manager-d6f4b65b8-r96qx" (UID: "9eaab48d-a857-48cc-9b42-695c96119a49") : secret "kserve-webhook-server-cert" not found
Jul 07 04:29:17.204806 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.204782    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rllsj\" (UniqueName: \"kubernetes.io/projected/9eaab48d-a857-48cc-9b42-695c96119a49-kube-api-access-rllsj\") pod \"kserve-controller-manager-d6f4b65b8-r96qx\" (UID: \"9eaab48d-a857-48cc-9b42-695c96119a49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:17.543492 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.543444    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:29:17.543590 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.543530    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:29:17.543590 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.543559    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:29:17.693304 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.693266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eaab48d-a857-48cc-9b42-695c96119a49-cert\") pod \"kserve-controller-manager-d6f4b65b8-r96qx\" (UID: \"9eaab48d-a857-48cc-9b42-695c96119a49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:17.696161 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.696133    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eaab48d-a857-48cc-9b42-695c96119a49-cert\") pod \"kserve-controller-manager-d6f4b65b8-r96qx\" (UID: \"9eaab48d-a857-48cc-9b42-695c96119a49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:17.946721 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.946683    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:17.964132 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:17.964104    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s" event={"ID":"139d6ebd-2a9d-41ad-8c72-cbd457d56818","Type":"ContainerStarted","Data":"c6a3fbb3ded7485f074e626202e117169e098c2a8226a89be099f033f8b6c94b"}
Jul 07 04:29:18.016340 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:18.016292    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s" podStartSLOduration=1.362374506 podStartE2EDuration="4.016276507s" totalImagesPullingTime="2.653902001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:29:18.014291616 +0000 UTC m=+317.901830418" watchObservedRunningTime="2026-07-07 04:29:18.016276507 +0000 UTC m=+317.903815308"
Jul 07 04:29:18.090550 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:18.090518    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"]
Jul 07 04:29:18.093782 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:29:18.093755    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eaab48d_a857_48cc_9b42_695c96119a49.slice/crio-777c387e799f6bf63dbb1ba5bcb417787adcce3e5e136b9864f765bef6dd424c WatchSource:0}: Error finding container 777c387e799f6bf63dbb1ba5bcb417787adcce3e5e136b9864f765bef6dd424c: Status 404 returned error can't find the container with id 777c387e799f6bf63dbb1ba5bcb417787adcce3e5e136b9864f765bef6dd424c
Jul 07 04:29:18.700486 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:18.700446    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:18.705040 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:18.705018    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:18.970054 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:18.969955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx" event={"ID":"9eaab48d-a857-48cc-9b42-695c96119a49","Type":"ContainerStarted","Data":"777c387e799f6bf63dbb1ba5bcb417787adcce3e5e136b9864f765bef6dd424c"}
Jul 07 04:29:18.970233 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:18.970156    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:18.971036 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:18.971015    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w9l4s"
Jul 07 04:29:20.980692 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:20.980599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx" event={"ID":"9eaab48d-a857-48cc-9b42-695c96119a49","Type":"ContainerStarted","Data":"87feded38966f043c1475d5803f1f116e286eb5bc5afaf83ac053e167a9f3311"}
Jul 07 04:29:20.998363 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:20.998301    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx" podStartSLOduration=2.441879118 podStartE2EDuration="4.998286482s" totalImagesPullingTime="2.556407364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:29:20.99715821 +0000 UTC m=+320.884697012" watchObservedRunningTime="2026-07-07 04:29:20.998286482 +0000 UTC m=+320.885825283"
Jul 07 04:29:21.984380 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:21.984338    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:29:26.005283 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:26.005240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc" event={"ID":"5bab7cc6-eb43-4fc7-abde-2c07f3421d1f","Type":"ContainerStarted","Data":"c31f4405a625d41595c4e0374c57e9607fd314c41e110d185ee1c3f91acd623d"}
Jul 07 04:29:26.005700 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:26.005383    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:26.023500 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:26.023368    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc" podStartSLOduration=1.970801023 podStartE2EDuration="12.023336577s" totalImagesPullingTime="10.052535554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:29:26.023098584 +0000 UTC m=+325.910637386" watchObservedRunningTime="2026-07-07 04:29:26.023336577 +0000 UTC m=+325.910875379"
Jul 07 04:29:37.011605 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:37.011570    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-687876b94d-45hmc"
Jul 07 04:29:52.992940 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:29:52.992908    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r96qx"
Jul 07 04:30:07.719630 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:07.719592    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2vhg"]
Jul 07 04:30:07.721902 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:07.721885    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg"
Jul 07 04:30:07.725548 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:07.725508    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 04:30:07.725548 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:07.725519    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9q7hf\""
Jul 07 04:30:07.726508 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:07.726486    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 04:30:07.733111 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:07.733085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2vhg"]
Jul 07 04:30:07.824339 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:07.824299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlkk4\" (UniqueName: \"kubernetes.io/projected/f3fad526-fdc1-4b24-8240-7e0ea363d337-kube-api-access-wlkk4\") pod \"kuadrant-operator-catalog-x2vhg\" (UID: \"f3fad526-fdc1-4b24-8240-7e0ea363d337\") " pod="kuadrant-system/kuadrant-operator-catalog-x2vhg"
Jul 07 04:30:07.925704 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:07.925669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlkk4\" (UniqueName: \"kubernetes.io/projected/f3fad526-fdc1-4b24-8240-7e0ea363d337-kube-api-access-wlkk4\") pod \"kuadrant-operator-catalog-x2vhg\" (UID: \"f3fad526-fdc1-4b24-8240-7e0ea363d337\") " pod="kuadrant-system/kuadrant-operator-catalog-x2vhg"
Jul 07 04:30:07.933625 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:07.933602    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlkk4\" (UniqueName: \"kubernetes.io/projected/f3fad526-fdc1-4b24-8240-7e0ea363d337-kube-api-access-wlkk4\") pod \"kuadrant-operator-catalog-x2vhg\" (UID: \"f3fad526-fdc1-4b24-8240-7e0ea363d337\") " pod="kuadrant-system/kuadrant-operator-catalog-x2vhg"
Jul 07 04:30:08.032809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.032712    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg"
Jul 07 04:30:08.067028 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.066991    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2vhg"]
Jul 07 04:30:08.158954 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.158920    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2vhg"]
Jul 07 04:30:08.161689 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:30:08.161660    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fad526_fdc1_4b24_8240_7e0ea363d337.slice/crio-65c01d01088c86d0d0225b08aac8de9a723f09d4b17242ba7c1e3916dffe2855 WatchSource:0}: Error finding container 65c01d01088c86d0d0225b08aac8de9a723f09d4b17242ba7c1e3916dffe2855: Status 404 returned error can't find the container with id 65c01d01088c86d0d0225b08aac8de9a723f09d4b17242ba7c1e3916dffe2855
Jul 07 04:30:08.189250 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.189219    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg" event={"ID":"f3fad526-fdc1-4b24-8240-7e0ea363d337","Type":"ContainerStarted","Data":"65c01d01088c86d0d0225b08aac8de9a723f09d4b17242ba7c1e3916dffe2855"}
Jul 07 04:30:08.274880 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.274845    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tb6c"]
Jul 07 04:30:08.277590 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.277573    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tb6c"
Jul 07 04:30:08.285528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.285507    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tb6c"]
Jul 07 04:30:08.329878 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.329844    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks255\" (UniqueName: \"kubernetes.io/projected/d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a-kube-api-access-ks255\") pod \"kuadrant-operator-catalog-4tb6c\" (UID: \"d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a\") " pod="kuadrant-system/kuadrant-operator-catalog-4tb6c"
Jul 07 04:30:08.430766 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.430729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks255\" (UniqueName: \"kubernetes.io/projected/d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a-kube-api-access-ks255\") pod \"kuadrant-operator-catalog-4tb6c\" (UID: \"d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a\") " pod="kuadrant-system/kuadrant-operator-catalog-4tb6c"
Jul 07 04:30:08.440503 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.440471    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks255\" (UniqueName: \"kubernetes.io/projected/d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a-kube-api-access-ks255\") pod \"kuadrant-operator-catalog-4tb6c\" (UID: \"d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a\") " pod="kuadrant-system/kuadrant-operator-catalog-4tb6c"
Jul 07 04:30:08.587083 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.586997    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tb6c"
Jul 07 04:30:08.714459 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:08.714432    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tb6c"]
Jul 07 04:30:08.716666 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:30:08.716638    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b52f0a_78ee_4cfc_8ea1_224b33fd8f9a.slice/crio-032b5ebe277f1527633a7377ea3d3964ac8bdf94edb073ce68510b02bb0fdf37 WatchSource:0}: Error finding container 032b5ebe277f1527633a7377ea3d3964ac8bdf94edb073ce68510b02bb0fdf37: Status 404 returned error can't find the container with id 032b5ebe277f1527633a7377ea3d3964ac8bdf94edb073ce68510b02bb0fdf37
Jul 07 04:30:09.194818 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:09.194782    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tb6c" event={"ID":"d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a","Type":"ContainerStarted","Data":"032b5ebe277f1527633a7377ea3d3964ac8bdf94edb073ce68510b02bb0fdf37"}
Jul 07 04:30:11.205820 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:11.205781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg" event={"ID":"f3fad526-fdc1-4b24-8240-7e0ea363d337","Type":"ContainerStarted","Data":"3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb"}
Jul 07 04:30:11.205820 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:11.205808    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg" podUID="f3fad526-fdc1-4b24-8240-7e0ea363d337" containerName="registry-server" containerID="cri-o://3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb" gracePeriod=2
Jul 07 04:30:11.207403 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:11.207329    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tb6c" event={"ID":"d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a","Type":"ContainerStarted","Data":"7b9efe8cf1f3990dfac210769e1e6898a7c7261068c990771a57f80d59ae3641"}
Jul 07 04:30:11.222310 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:11.222264    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg" podStartSLOduration=1.906417794 podStartE2EDuration="4.222250463s" totalImagesPullingTime="2.315832669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:30:11.220794206 +0000 UTC m=+371.108333019" watchObservedRunningTime="2026-07-07 04:30:11.222250463 +0000 UTC m=+371.109789263"
Jul 07 04:30:11.236942 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:11.236897    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4tb6c" podStartSLOduration=1.4716112 podStartE2EDuration="3.236882132s" totalImagesPullingTime="1.765270932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:30:11.235549394 +0000 UTC m=+371.123088198" watchObservedRunningTime="2026-07-07 04:30:11.236882132 +0000 UTC m=+371.124420933"
Jul 07 04:30:11.450660 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:11.450638    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg"
Jul 07 04:30:11.560030 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:11.559955    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlkk4\" (UniqueName: \"kubernetes.io/projected/f3fad526-fdc1-4b24-8240-7e0ea363d337-kube-api-access-wlkk4\") pod \"f3fad526-fdc1-4b24-8240-7e0ea363d337\" (UID: \"f3fad526-fdc1-4b24-8240-7e0ea363d337\") "
Jul 07 04:30:11.562070 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:11.562040    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3fad526-fdc1-4b24-8240-7e0ea363d337-kube-api-access-wlkk4" (OuterVolumeSpecName: "kube-api-access-wlkk4") pod "f3fad526-fdc1-4b24-8240-7e0ea363d337" (UID: "f3fad526-fdc1-4b24-8240-7e0ea363d337"). InnerVolumeSpecName "kube-api-access-wlkk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:30:11.661312 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:11.661276    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlkk4\" (UniqueName: \"kubernetes.io/projected/f3fad526-fdc1-4b24-8240-7e0ea363d337-kube-api-access-wlkk4\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:30:12.212233 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.212198    2568 generic.go:356] "Generic (PLEG): container finished" podID="f3fad526-fdc1-4b24-8240-7e0ea363d337" containerID="3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb" exitCode=0
Jul 07 04:30:12.212645 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.212237    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg"
Jul 07 04:30:12.212645 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.212285    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg" event={"ID":"f3fad526-fdc1-4b24-8240-7e0ea363d337","Type":"ContainerDied","Data":"3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb"}
Jul 07 04:30:12.212645 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.212322    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x2vhg" event={"ID":"f3fad526-fdc1-4b24-8240-7e0ea363d337","Type":"ContainerDied","Data":"65c01d01088c86d0d0225b08aac8de9a723f09d4b17242ba7c1e3916dffe2855"}
Jul 07 04:30:12.212645 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.212368    2568 scope.go:117] "RemoveContainer" containerID="3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb"
Jul 07 04:30:12.221327 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.221310    2568 scope.go:117] "RemoveContainer" containerID="3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb"
Jul 07 04:30:12.221623 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:30:12.221605    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb\": container with ID starting with 3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb not found: ID does not exist" containerID="3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb"
Jul 07 04:30:12.221674 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.221631    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb"} err="failed to get container status \"3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb\": rpc error: code = NotFound desc = could not find container \"3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb\": container with ID starting with 3de788603c84bfc855acc9353bd50cd51e4e30e92fa24eff1a03b1bba278c5fb not found: ID does not exist"
Jul 07 04:30:12.232729 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.232707    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2vhg"]
Jul 07 04:30:12.235246 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.235222    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2vhg"]
Jul 07 04:30:12.591477 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:12.591400    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3fad526-fdc1-4b24-8240-7e0ea363d337" path="/var/lib/kubelet/pods/f3fad526-fdc1-4b24-8240-7e0ea363d337/volumes"
Jul 07 04:30:18.590619 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:18.590587    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4tb6c"
Jul 07 04:30:18.591001 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:18.590639    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4tb6c"
Jul 07 04:30:18.610387 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:18.610345    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4tb6c"
Jul 07 04:30:19.264652 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:19.264625    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4tb6c"
Jul 07 04:30:31.911802 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.911761    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d864cbc48-dn4hc"]
Jul 07 04:30:31.912231 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.912214    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3fad526-fdc1-4b24-8240-7e0ea363d337" containerName="registry-server"
Jul 07 04:30:31.912278 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.912233    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3fad526-fdc1-4b24-8240-7e0ea363d337" containerName="registry-server"
Jul 07 04:30:31.912315 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.912284    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3fad526-fdc1-4b24-8240-7e0ea363d337" containerName="registry-server"
Jul 07 04:30:31.914488 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.914472    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:31.917219 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.917189    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 04:30:31.917801 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.917785    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n4kp4\""
Jul 07 04:30:31.918214 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.918199    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 04:30:31.919168 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.919150    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 04:30:31.919259 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.919188    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 04:30:31.919259 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.919246    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 04:30:31.926614 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.926597    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 04:30:31.931571 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.931551    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d864cbc48-dn4hc"]
Jul 07 04:30:31.935373 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.935333    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-service-ca\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:31.935456 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.935384    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-console-oauth-config\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:31.935509 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.935460    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-console-config\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:31.935509 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.935482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-console-serving-cert\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:31.935509 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.935505    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-trusted-ca-bundle\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:31.935619 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.935526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77cxr\" (UniqueName: \"kubernetes.io/projected/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-kube-api-access-77cxr\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:31.935619 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:31.935579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-oauth-serving-cert\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.036172 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.036137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-console-config\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.036172 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.036170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-console-serving-cert\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.036497 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.036191    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-trusted-ca-bundle\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.036497 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.036280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77cxr\" (UniqueName: \"kubernetes.io/projected/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-kube-api-access-77cxr\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.036497 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.036307    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-oauth-serving-cert\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.036497 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.036368    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-service-ca\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.036497 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.036400    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-console-oauth-config\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.036995 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.036965    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-console-config\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.037098 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.036969    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-oauth-serving-cert\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.037151 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.037114    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-service-ca\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.037337 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.037319    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-trusted-ca-bundle\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.038764 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.038739    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-console-oauth-config\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.038883 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.038864    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-console-serving-cert\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.044961 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.044921    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77cxr\" (UniqueName: \"kubernetes.io/projected/ed2b19cb-2b2a-4128-8241-b518f4c76d0d-kube-api-access-77cxr\") pod \"console-5d864cbc48-dn4hc\" (UID: \"ed2b19cb-2b2a-4128-8241-b518f4c76d0d\") " pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.224202 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.224108    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:32.351307 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:32.351280    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d864cbc48-dn4hc"]
Jul 07 04:30:32.353381 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:30:32.353344    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2b19cb_2b2a_4128_8241_b518f4c76d0d.slice/crio-e6cf09aad0257ee4a4254d84b6380e0a90050158899f993809b9b5de55a892ab WatchSource:0}: Error finding container e6cf09aad0257ee4a4254d84b6380e0a90050158899f993809b9b5de55a892ab: Status 404 returned error can't find the container with id e6cf09aad0257ee4a4254d84b6380e0a90050158899f993809b9b5de55a892ab
Jul 07 04:30:33.309482 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:33.309448    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d864cbc48-dn4hc" event={"ID":"ed2b19cb-2b2a-4128-8241-b518f4c76d0d","Type":"ContainerStarted","Data":"75484d7b180ab2fe25ab9ce948f741fbb7b4c7ca106aa159512630bb44234f07"}
Jul 07 04:30:33.309863 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:33.309498    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d864cbc48-dn4hc" event={"ID":"ed2b19cb-2b2a-4128-8241-b518f4c76d0d","Type":"ContainerStarted","Data":"e6cf09aad0257ee4a4254d84b6380e0a90050158899f993809b9b5de55a892ab"}
Jul 07 04:30:33.330574 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:33.330528    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d864cbc48-dn4hc" podStartSLOduration=2.330509128 podStartE2EDuration="2.330509128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:30:33.329449815 +0000 UTC m=+393.216988615" watchObservedRunningTime="2026-07-07 04:30:33.330509128 +0000 UTC m=+393.218047929"
Jul 07 04:30:42.224459 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:42.224416    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:42.225042 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:42.224489    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:42.229022 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:42.228999    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:42.349624 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:42.349596    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d864cbc48-dn4hc"
Jul 07 04:30:45.501527 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.501491    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"]
Jul 07 04:30:45.509886 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.509865    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:30:45.512503 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.512483    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m5r5j\""
Jul 07 04:30:45.525607 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.525584    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"]
Jul 07 04:30:45.553579 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.553550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" (UID: \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:30:45.553718 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.553615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg687\" (UniqueName: \"kubernetes.io/projected/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-kube-api-access-fg687\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" (UID: \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:30:45.654976 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.654944    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" (UID: \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:30:45.655135 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.655005    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg687\" (UniqueName: \"kubernetes.io/projected/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-kube-api-access-fg687\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" (UID: \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:30:45.655435 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.655412    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" (UID: \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:30:45.666202 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.666178    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg687\" (UniqueName: \"kubernetes.io/projected/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-kube-api-access-fg687\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" (UID: \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:30:45.820547 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.820459    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:30:45.958453 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:45.958429    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"]
Jul 07 04:30:45.961079 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:30:45.961046    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda928a2ee_1554_4415_bd86_f2f06ac8d0fa.slice/crio-bbd5255e43f4c6e6ba0d19ad49e9781616583e43a5ed7ada38f998845753e43b WatchSource:0}: Error finding container bbd5255e43f4c6e6ba0d19ad49e9781616583e43a5ed7ada38f998845753e43b: Status 404 returned error can't find the container with id bbd5255e43f4c6e6ba0d19ad49e9781616583e43a5ed7ada38f998845753e43b
Jul 07 04:30:46.369779 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:46.369743    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m" event={"ID":"a928a2ee-1554-4415-bd86-f2f06ac8d0fa","Type":"ContainerStarted","Data":"bbd5255e43f4c6e6ba0d19ad49e9781616583e43a5ed7ada38f998845753e43b"}
Jul 07 04:30:48.616902 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:48.616871    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"]
Jul 07 04:30:48.620401 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:48.620379    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"
Jul 07 04:30:48.622780 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:48.622758    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rxgcc\""
Jul 07 04:30:48.622915 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:48.622814    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 04:30:48.631230 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:48.631204    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"]
Jul 07 04:30:48.681130 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:48.681085    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bnfk\" (UniqueName: \"kubernetes.io/projected/005e4338-5bb5-48eb-a0ad-7150608bf8d4-kube-api-access-2bnfk\") pod \"dns-operator-controller-manager-864dd78c4c-5bgld\" (UID: \"005e4338-5bb5-48eb-a0ad-7150608bf8d4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"
Jul 07 04:30:48.782552 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:48.782517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bnfk\" (UniqueName: \"kubernetes.io/projected/005e4338-5bb5-48eb-a0ad-7150608bf8d4-kube-api-access-2bnfk\") pod \"dns-operator-controller-manager-864dd78c4c-5bgld\" (UID: \"005e4338-5bb5-48eb-a0ad-7150608bf8d4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"
Jul 07 04:30:48.795072 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:48.795050    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bnfk\" (UniqueName: \"kubernetes.io/projected/005e4338-5bb5-48eb-a0ad-7150608bf8d4-kube-api-access-2bnfk\") pod \"dns-operator-controller-manager-864dd78c4c-5bgld\" (UID: \"005e4338-5bb5-48eb-a0ad-7150608bf8d4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"
Jul 07 04:30:48.931996 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:48.931948    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"
Jul 07 04:30:49.106871 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:49.106845    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"]
Jul 07 04:30:49.109315 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:30:49.109285    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005e4338_5bb5_48eb_a0ad_7150608bf8d4.slice/crio-a73c2afd6fd01f11a65dd99b7b85c956e08a4577afb263a7c803c1bfc0bc5d3a WatchSource:0}: Error finding container a73c2afd6fd01f11a65dd99b7b85c956e08a4577afb263a7c803c1bfc0bc5d3a: Status 404 returned error can't find the container with id a73c2afd6fd01f11a65dd99b7b85c956e08a4577afb263a7c803c1bfc0bc5d3a
Jul 07 04:30:49.384713 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:49.384639    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld" event={"ID":"005e4338-5bb5-48eb-a0ad-7150608bf8d4","Type":"ContainerStarted","Data":"a73c2afd6fd01f11a65dd99b7b85c956e08a4577afb263a7c803c1bfc0bc5d3a"}
Jul 07 04:30:51.397695 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:51.397651    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld" event={"ID":"005e4338-5bb5-48eb-a0ad-7150608bf8d4","Type":"ContainerStarted","Data":"3f8fa7077a9034ff8c47498bb443735e7bab7de60bcb65ee0da2f9a9c1e7039b"}
Jul 07 04:30:51.398109 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:51.397776    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"
Jul 07 04:30:51.437224 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:51.437169    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld" podStartSLOduration=1.28480309 podStartE2EDuration="3.437148712s" totalImagesPullingTime="2.152345622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:30:51.435285909 +0000 UTC m=+411.322824711" watchObservedRunningTime="2026-07-07 04:30:51.437148712 +0000 UTC m=+411.324687514"
Jul 07 04:30:53.408617 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:53.408577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m" event={"ID":"a928a2ee-1554-4415-bd86-f2f06ac8d0fa","Type":"ContainerStarted","Data":"84507b7710dea3f358608df96e99b5a9d287e37ffa40f91f3461c9aa49212247"}
Jul 07 04:30:53.409098 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:53.408708    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:30:53.429366 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:30:53.429308    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m" podStartSLOduration=1.778629956 podStartE2EDuration="8.429293119s" totalImagesPullingTime="6.650663163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:30:53.427074868 +0000 UTC m=+413.314613691" watchObservedRunningTime="2026-07-07 04:30:53.429293119 +0000 UTC m=+413.316831968"
Jul 07 04:31:02.405124 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:02.405094    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5bgld"
Jul 07 04:31:04.416031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:04.415999    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:31:05.700035 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.700004    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"]
Jul 07 04:31:05.704637 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.704618    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:05.716628 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.716602    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"]
Jul 07 04:31:05.836766 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.836738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzg74\" (UniqueName: \"kubernetes.io/projected/ce725326-9795-4eab-9963-74426f165710-kube-api-access-tzg74\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" (UID: \"ce725326-9795-4eab-9963-74426f165710\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:05.836959 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.836782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce725326-9795-4eab-9963-74426f165710-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" (UID: \"ce725326-9795-4eab-9963-74426f165710\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:05.840749 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.840721    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"]
Jul 07 04:31:05.840992 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:05.840972    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-tzg74], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx" podUID="ce725326-9795-4eab-9963-74426f165710"
Jul 07 04:31:05.937623 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.937589    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzg74\" (UniqueName: \"kubernetes.io/projected/ce725326-9795-4eab-9963-74426f165710-kube-api-access-tzg74\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" (UID: \"ce725326-9795-4eab-9963-74426f165710\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:05.937795 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.937631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce725326-9795-4eab-9963-74426f165710-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" (UID: \"ce725326-9795-4eab-9963-74426f165710\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:05.938120 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.938094    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce725326-9795-4eab-9963-74426f165710-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" (UID: \"ce725326-9795-4eab-9963-74426f165710\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:05.947641 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:05.947610    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzg74\" (UniqueName: \"kubernetes.io/projected/ce725326-9795-4eab-9963-74426f165710-kube-api-access-tzg74\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" (UID: \"ce725326-9795-4eab-9963-74426f165710\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:06.305894 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.305854    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"]
Jul 07 04:31:06.309123 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.309106    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:06.313600 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.313571    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"]
Jul 07 04:31:06.319945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.319923    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"]
Jul 07 04:31:06.323727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.323708    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"]
Jul 07 04:31:06.333571 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.333548    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"]
Jul 07 04:31:06.333754 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.333733    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" containerName="manager" containerID="cri-o://84507b7710dea3f358608df96e99b5a9d287e37ffa40f91f3461c9aa49212247" gracePeriod=2
Jul 07 04:31:06.336619 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.336597    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"]
Jul 07 04:31:06.348963 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:06.348927    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:31:06.364807 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.364782    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"]
Jul 07 04:31:06.365127 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.365114    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" containerName="manager"
Jul 07 04:31:06.365162 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.365129    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" containerName="manager"
Jul 07 04:31:06.365204 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.365176    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" containerName="manager"
Jul 07 04:31:06.367978 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.367962    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:06.379958 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.379930    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"]
Jul 07 04:31:06.403729 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:06.403695    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:31:06.441300 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.441254    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnbvp\" (UniqueName: \"kubernetes.io/projected/df41b9a2-2afa-45cc-acb1-f0ff680d1227-kube-api-access-nnbvp\") pod \"kuadrant-operator-controller-manager-55467d9f7-8xxrr\" (UID: \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:06.441471 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.441446    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df41b9a2-2afa-45cc-acb1-f0ff680d1227-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8xxrr\" (UID: \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:06.468041 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.468009    2568 generic.go:356] "Generic (PLEG): container finished" podID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" containerID="84507b7710dea3f358608df96e99b5a9d287e37ffa40f91f3461c9aa49212247" exitCode=0
Jul 07 04:31:06.468169 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.468142    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:06.470555 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:06.470517    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object" podUID="ce725326-9795-4eab-9963-74426f165710" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:06.472746 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:06.472716    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:31:06.475804 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.474929    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:06.477098 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:06.477073    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object" podUID="ce725326-9795-4eab-9963-74426f165710" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:06.479083 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:06.479063    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:31:06.542922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.542888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df41b9a2-2afa-45cc-acb1-f0ff680d1227-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8xxrr\" (UID: \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:06.543106 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.542967    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58646360-9512-4a59-84f7-80e0a7ed68bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2xkz7\" (UID: \"58646360-9512-4a59-84f7-80e0a7ed68bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:06.543106 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.543013    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnbvp\" (UniqueName: \"kubernetes.io/projected/df41b9a2-2afa-45cc-acb1-f0ff680d1227-kube-api-access-nnbvp\") pod \"kuadrant-operator-controller-manager-55467d9f7-8xxrr\" (UID: \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:06.543106 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.543058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg5ng\" (UniqueName: \"kubernetes.io/projected/58646360-9512-4a59-84f7-80e0a7ed68bb-kube-api-access-mg5ng\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2xkz7\" (UID: \"58646360-9512-4a59-84f7-80e0a7ed68bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:06.543366 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.543335    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df41b9a2-2afa-45cc-acb1-f0ff680d1227-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8xxrr\" (UID: \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:06.551306 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.551282    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnbvp\" (UniqueName: \"kubernetes.io/projected/df41b9a2-2afa-45cc-acb1-f0ff680d1227-kube-api-access-nnbvp\") pod \"kuadrant-operator-controller-manager-55467d9f7-8xxrr\" (UID: \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:06.570316 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.570265    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:31:06.572708 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:06.572684    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object" podUID="ce725326-9795-4eab-9963-74426f165710" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:06.574919 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:06.574897    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jm25m\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:31:06.620757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.620728    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:06.643660 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.643626    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce725326-9795-4eab-9963-74426f165710-extensions-socket-volume\") pod \"ce725326-9795-4eab-9963-74426f165710\" (UID: \"ce725326-9795-4eab-9963-74426f165710\") "
Jul 07 04:31:06.643774 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.643682    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzg74\" (UniqueName: \"kubernetes.io/projected/ce725326-9795-4eab-9963-74426f165710-kube-api-access-tzg74\") pod \"ce725326-9795-4eab-9963-74426f165710\" (UID: \"ce725326-9795-4eab-9963-74426f165710\") "
Jul 07 04:31:06.643894 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.643875    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58646360-9512-4a59-84f7-80e0a7ed68bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2xkz7\" (UID: \"58646360-9512-4a59-84f7-80e0a7ed68bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:06.643936 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.643896    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce725326-9795-4eab-9963-74426f165710-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ce725326-9795-4eab-9963-74426f165710" (UID: "ce725326-9795-4eab-9963-74426f165710"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:31:06.643999 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.643981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg5ng\" (UniqueName: \"kubernetes.io/projected/58646360-9512-4a59-84f7-80e0a7ed68bb-kube-api-access-mg5ng\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2xkz7\" (UID: \"58646360-9512-4a59-84f7-80e0a7ed68bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:06.644079 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.644064    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce725326-9795-4eab-9963-74426f165710-extensions-socket-volume\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:31:06.644246 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.644229    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58646360-9512-4a59-84f7-80e0a7ed68bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2xkz7\" (UID: \"58646360-9512-4a59-84f7-80e0a7ed68bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:06.645740 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.645723    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce725326-9795-4eab-9963-74426f165710-kube-api-access-tzg74" (OuterVolumeSpecName: "kube-api-access-tzg74") pod "ce725326-9795-4eab-9963-74426f165710" (UID: "ce725326-9795-4eab-9963-74426f165710"). InnerVolumeSpecName "kube-api-access-tzg74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:31:06.654152 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.654132    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg5ng\" (UniqueName: \"kubernetes.io/projected/58646360-9512-4a59-84f7-80e0a7ed68bb-kube-api-access-mg5ng\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2xkz7\" (UID: \"58646360-9512-4a59-84f7-80e0a7ed68bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:06.701806 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.701773    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:06.745027 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.744995    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-extensions-socket-volume\") pod \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\" (UID: \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\") "
Jul 07 04:31:06.745249 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.745098    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg687\" (UniqueName: \"kubernetes.io/projected/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-kube-api-access-fg687\") pod \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\" (UID: \"a928a2ee-1554-4415-bd86-f2f06ac8d0fa\") "
Jul 07 04:31:06.745326 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.745280    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzg74\" (UniqueName: \"kubernetes.io/projected/ce725326-9795-4eab-9963-74426f165710-kube-api-access-tzg74\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:31:06.745473 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.745447    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a928a2ee-1554-4415-bd86-f2f06ac8d0fa" (UID: "a928a2ee-1554-4415-bd86-f2f06ac8d0fa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:31:06.747105 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.747079    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-kube-api-access-fg687" (OuterVolumeSpecName: "kube-api-access-fg687") pod "a928a2ee-1554-4415-bd86-f2f06ac8d0fa" (UID: "a928a2ee-1554-4415-bd86-f2f06ac8d0fa"). InnerVolumeSpecName "kube-api-access-fg687". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:31:06.754467 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.754151    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"]
Jul 07 04:31:06.758078 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:31:06.758036    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf41b9a2_2afa_45cc_acb1_f0ff680d1227.slice/crio-8bc84af200c8f722975c2e475b631e531d1c61425a797db551087a2295673c56 WatchSource:0}: Error finding container 8bc84af200c8f722975c2e475b631e531d1c61425a797db551087a2295673c56: Status 404 returned error can't find the container with id 8bc84af200c8f722975c2e475b631e531d1c61425a797db551087a2295673c56
Jul 07 04:31:06.846000 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.845933    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg687\" (UniqueName: \"kubernetes.io/projected/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-kube-api-access-fg687\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:31:06.846000 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.845960    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a928a2ee-1554-4415-bd86-f2f06ac8d0fa-extensions-socket-volume\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:31:06.849162 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:06.849077    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"]
Jul 07 04:31:06.851908 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:31:06.851876    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58646360_9512_4a59_84f7_80e0a7ed68bb.slice/crio-c8cf2534e6dd074e30a896bfed53da7b128dca2009bdc2b1bb591f4490e0f7f3 WatchSource:0}: Error finding container c8cf2534e6dd074e30a896bfed53da7b128dca2009bdc2b1bb591f4490e0f7f3: Status 404 returned error can't find the container with id c8cf2534e6dd074e30a896bfed53da7b128dca2009bdc2b1bb591f4490e0f7f3
Jul 07 04:31:07.479156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.479124    2568 scope.go:117] "RemoveContainer" containerID="84507b7710dea3f358608df96e99b5a9d287e37ffa40f91f3461c9aa49212247"
Jul 07 04:31:07.479156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.479143    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jm25m"
Jul 07 04:31:07.481058 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.481026    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7" event={"ID":"58646360-9512-4a59-84f7-80e0a7ed68bb","Type":"ContainerStarted","Data":"e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479"}
Jul 07 04:31:07.481218 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.481207    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:07.481287 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.481235    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7" event={"ID":"58646360-9512-4a59-84f7-80e0a7ed68bb","Type":"ContainerStarted","Data":"c8cf2534e6dd074e30a896bfed53da7b128dca2009bdc2b1bb591f4490e0f7f3"}
Jul 07 04:31:07.482648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.482627    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr" event={"ID":"df41b9a2-2afa-45cc-acb1-f0ff680d1227","Type":"ContainerStarted","Data":"a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1"}
Jul 07 04:31:07.482744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.482666    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr" event={"ID":"df41b9a2-2afa-45cc-acb1-f0ff680d1227","Type":"ContainerStarted","Data":"8bc84af200c8f722975c2e475b631e531d1c61425a797db551087a2295673c56"}
Jul 07 04:31:07.482744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.482702    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:07.482744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.482725    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:07.508136 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.508094    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7" podStartSLOduration=1.508081388 podStartE2EDuration="1.508081388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:31:07.50670616 +0000 UTC m=+427.394244962" watchObservedRunningTime="2026-07-07 04:31:07.508081388 +0000 UTC m=+427.395620262"
Jul 07 04:31:07.508835 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:07.508804    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mzdgx\" is forbidden: User \"system:node:ip-10-0-128-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-250.ec2.internal' and this object" podUID="ce725326-9795-4eab-9963-74426f165710" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzdgx"
Jul 07 04:31:07.561688 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:07.561636    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr" podStartSLOduration=1.561617274 podStartE2EDuration="1.561617274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:31:07.554162658 +0000 UTC m=+427.441701460" watchObservedRunningTime="2026-07-07 04:31:07.561617274 +0000 UTC m=+427.449156077"
Jul 07 04:31:08.591656 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:08.591625    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a928a2ee-1554-4415-bd86-f2f06ac8d0fa" path="/var/lib/kubelet/pods/a928a2ee-1554-4415-bd86-f2f06ac8d0fa/volumes"
Jul 07 04:31:08.591990 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:08.591960    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce725326-9795-4eab-9963-74426f165710" path="/var/lib/kubelet/pods/ce725326-9795-4eab-9963-74426f165710/volumes"
Jul 07 04:31:18.490791 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.490757    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:18.491235 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.490936    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:18.579730 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.579689    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"]
Jul 07 04:31:18.579925 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.579900    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7" podUID="58646360-9512-4a59-84f7-80e0a7ed68bb" containerName="manager" containerID="cri-o://e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479" gracePeriod=10
Jul 07 04:31:18.802190 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.802158    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"]
Jul 07 04:31:18.806118 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.806095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:18.823731 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.823697    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"]
Jul 07 04:31:18.836199 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.836178    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:18.847374 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.847329    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58646360-9512-4a59-84f7-80e0a7ed68bb-extensions-socket-volume\") pod \"58646360-9512-4a59-84f7-80e0a7ed68bb\" (UID: \"58646360-9512-4a59-84f7-80e0a7ed68bb\") "
Jul 07 04:31:18.847483 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.847408    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg5ng\" (UniqueName: \"kubernetes.io/projected/58646360-9512-4a59-84f7-80e0a7ed68bb-kube-api-access-mg5ng\") pod \"58646360-9512-4a59-84f7-80e0a7ed68bb\" (UID: \"58646360-9512-4a59-84f7-80e0a7ed68bb\") "
Jul 07 04:31:18.847626 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.847606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhxzr\" (UniqueName: \"kubernetes.io/projected/0279f314-d4fd-450f-a1d0-4c63fdde128d-kube-api-access-qhxzr\") pod \"kuadrant-operator-controller-manager-86878c769f-q57sn\" (UID: \"0279f314-d4fd-450f-a1d0-4c63fdde128d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:18.847698 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.847681    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0279f314-d4fd-450f-a1d0-4c63fdde128d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q57sn\" (UID: \"0279f314-d4fd-450f-a1d0-4c63fdde128d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:18.847752 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.847724    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58646360-9512-4a59-84f7-80e0a7ed68bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "58646360-9512-4a59-84f7-80e0a7ed68bb" (UID: "58646360-9512-4a59-84f7-80e0a7ed68bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:31:18.847847 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.847826    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58646360-9512-4a59-84f7-80e0a7ed68bb-extensions-socket-volume\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:31:18.849452 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.849430    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58646360-9512-4a59-84f7-80e0a7ed68bb-kube-api-access-mg5ng" (OuterVolumeSpecName: "kube-api-access-mg5ng") pod "58646360-9512-4a59-84f7-80e0a7ed68bb" (UID: "58646360-9512-4a59-84f7-80e0a7ed68bb"). InnerVolumeSpecName "kube-api-access-mg5ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:31:18.948566 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.948531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhxzr\" (UniqueName: \"kubernetes.io/projected/0279f314-d4fd-450f-a1d0-4c63fdde128d-kube-api-access-qhxzr\") pod \"kuadrant-operator-controller-manager-86878c769f-q57sn\" (UID: \"0279f314-d4fd-450f-a1d0-4c63fdde128d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:18.948727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.948596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0279f314-d4fd-450f-a1d0-4c63fdde128d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q57sn\" (UID: \"0279f314-d4fd-450f-a1d0-4c63fdde128d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:18.948727 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.948680    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg5ng\" (UniqueName: \"kubernetes.io/projected/58646360-9512-4a59-84f7-80e0a7ed68bb-kube-api-access-mg5ng\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:31:18.949003 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.948984    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0279f314-d4fd-450f-a1d0-4c63fdde128d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q57sn\" (UID: \"0279f314-d4fd-450f-a1d0-4c63fdde128d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:18.967629 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:18.967596    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhxzr\" (UniqueName: \"kubernetes.io/projected/0279f314-d4fd-450f-a1d0-4c63fdde128d-kube-api-access-qhxzr\") pod \"kuadrant-operator-controller-manager-86878c769f-q57sn\" (UID: \"0279f314-d4fd-450f-a1d0-4c63fdde128d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:19.132683 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.132595    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:19.271840 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.271658    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"]
Jul 07 04:31:19.274632 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:31:19.274602    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0279f314_d4fd_450f_a1d0_4c63fdde128d.slice/crio-2a026fe969566a88d3adf9b75469a10253b36d57b067b8cc7d6efa81d41d5f72 WatchSource:0}: Error finding container 2a026fe969566a88d3adf9b75469a10253b36d57b067b8cc7d6efa81d41d5f72: Status 404 returned error can't find the container with id 2a026fe969566a88d3adf9b75469a10253b36d57b067b8cc7d6efa81d41d5f72
Jul 07 04:31:19.541680 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.541644    2568 generic.go:356] "Generic (PLEG): container finished" podID="58646360-9512-4a59-84f7-80e0a7ed68bb" containerID="e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479" exitCode=0
Jul 07 04:31:19.542138 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.541723    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"
Jul 07 04:31:19.542138 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.541736    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7" event={"ID":"58646360-9512-4a59-84f7-80e0a7ed68bb","Type":"ContainerDied","Data":"e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479"}
Jul 07 04:31:19.542138 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.541800    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7" event={"ID":"58646360-9512-4a59-84f7-80e0a7ed68bb","Type":"ContainerDied","Data":"c8cf2534e6dd074e30a896bfed53da7b128dca2009bdc2b1bb591f4490e0f7f3"}
Jul 07 04:31:19.542138 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.541831    2568 scope.go:117] "RemoveContainer" containerID="e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479"
Jul 07 04:31:19.543528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.543496    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn" event={"ID":"0279f314-d4fd-450f-a1d0-4c63fdde128d","Type":"ContainerStarted","Data":"7bfb546ae16ec2eb63f3fff9a7327b55e859fa3cf1292f523da4ca7591c9625e"}
Jul 07 04:31:19.543648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.543547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn" event={"ID":"0279f314-d4fd-450f-a1d0-4c63fdde128d","Type":"ContainerStarted","Data":"2a026fe969566a88d3adf9b75469a10253b36d57b067b8cc7d6efa81d41d5f72"}
Jul 07 04:31:19.543648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.543591    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:19.551427 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.551405    2568 scope.go:117] "RemoveContainer" containerID="e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479"
Jul 07 04:31:19.551705 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:19.551685    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479\": container with ID starting with e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479 not found: ID does not exist" containerID="e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479"
Jul 07 04:31:19.551758 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.551713    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479"} err="failed to get container status \"e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479\": rpc error: code = NotFound desc = could not find container \"e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479\": container with ID starting with e3caf02d91b950354d2be1605d07391d4ae747ae3b1d00e4ff1da20f1c7fc479 not found: ID does not exist"
Jul 07 04:31:19.603987 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.603935    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn" podStartSLOduration=1.603918852 podStartE2EDuration="1.603918852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:31:19.602241496 +0000 UTC m=+439.489780297" watchObservedRunningTime="2026-07-07 04:31:19.603918852 +0000 UTC m=+439.491457652"
Jul 07 04:31:19.631108 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.631076    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"]
Jul 07 04:31:19.636173 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:19.636149    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2xkz7"]
Jul 07 04:31:20.590413 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:20.590379    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58646360-9512-4a59-84f7-80e0a7ed68bb" path="/var/lib/kubelet/pods/58646360-9512-4a59-84f7-80e0a7ed68bb/volumes"
Jul 07 04:31:30.551962 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:30.551881    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:31:30.601427 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:30.601131    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"]
Jul 07 04:31:30.602139 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:30.602105    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr" podUID="df41b9a2-2afa-45cc-acb1-f0ff680d1227" containerName="manager" containerID="cri-o://a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1" gracePeriod=10
Jul 07 04:31:30.844722 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:30.844697    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:30.954862 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:30.954834    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df41b9a2-2afa-45cc-acb1-f0ff680d1227-extensions-socket-volume\") pod \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\" (UID: \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\") "
Jul 07 04:31:30.955020 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:30.954947    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnbvp\" (UniqueName: \"kubernetes.io/projected/df41b9a2-2afa-45cc-acb1-f0ff680d1227-kube-api-access-nnbvp\") pod \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\" (UID: \"df41b9a2-2afa-45cc-acb1-f0ff680d1227\") "
Jul 07 04:31:30.955293 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:30.955262    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df41b9a2-2afa-45cc-acb1-f0ff680d1227-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "df41b9a2-2afa-45cc-acb1-f0ff680d1227" (UID: "df41b9a2-2afa-45cc-acb1-f0ff680d1227"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:31:30.956989 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:30.956965    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df41b9a2-2afa-45cc-acb1-f0ff680d1227-kube-api-access-nnbvp" (OuterVolumeSpecName: "kube-api-access-nnbvp") pod "df41b9a2-2afa-45cc-acb1-f0ff680d1227" (UID: "df41b9a2-2afa-45cc-acb1-f0ff680d1227"). InnerVolumeSpecName "kube-api-access-nnbvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:31:31.055967 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.055928    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df41b9a2-2afa-45cc-acb1-f0ff680d1227-extensions-socket-volume\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:31:31.055967 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.055960    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnbvp\" (UniqueName: \"kubernetes.io/projected/df41b9a2-2afa-45cc-acb1-f0ff680d1227-kube-api-access-nnbvp\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:31:31.602339 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.602299    2568 generic.go:356] "Generic (PLEG): container finished" podID="df41b9a2-2afa-45cc-acb1-f0ff680d1227" containerID="a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1" exitCode=0
Jul 07 04:31:31.602760 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.602344    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"
Jul 07 04:31:31.602760 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.602384    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr" event={"ID":"df41b9a2-2afa-45cc-acb1-f0ff680d1227","Type":"ContainerDied","Data":"a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1"}
Jul 07 04:31:31.602760 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.602436    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr" event={"ID":"df41b9a2-2afa-45cc-acb1-f0ff680d1227","Type":"ContainerDied","Data":"8bc84af200c8f722975c2e475b631e531d1c61425a797db551087a2295673c56"}
Jul 07 04:31:31.602760 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.602461    2568 scope.go:117] "RemoveContainer" containerID="a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1"
Jul 07 04:31:31.613218 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.613197    2568 scope.go:117] "RemoveContainer" containerID="a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1"
Jul 07 04:31:31.613527 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:31:31.613508    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1\": container with ID starting with a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1 not found: ID does not exist" containerID="a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1"
Jul 07 04:31:31.613591 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.613541    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1"} err="failed to get container status \"a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1\": rpc error: code = NotFound desc = could not find container \"a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1\": container with ID starting with a3dfb89069b674797e49fb7db9ff2c72701b20008ba46021ed63f529c62bb7f1 not found: ID does not exist"
Jul 07 04:31:31.640520 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.640486    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"]
Jul 07 04:31:31.652292 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:31.652265    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8xxrr"]
Jul 07 04:31:32.591607 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:32.591572    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df41b9a2-2afa-45cc-acb1-f0ff680d1227" path="/var/lib/kubelet/pods/df41b9a2-2afa-45cc-acb1-f0ff680d1227/volumes"
Jul 07 04:31:34.971771 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.971741    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"]
Jul 07 04:31:34.972149 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.972074    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58646360-9512-4a59-84f7-80e0a7ed68bb" containerName="manager"
Jul 07 04:31:34.972149 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.972084    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58646360-9512-4a59-84f7-80e0a7ed68bb" containerName="manager"
Jul 07 04:31:34.972149 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.972110    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df41b9a2-2afa-45cc-acb1-f0ff680d1227" containerName="manager"
Jul 07 04:31:34.972149 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.972115    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="df41b9a2-2afa-45cc-acb1-f0ff680d1227" containerName="manager"
Jul 07 04:31:34.972289 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.972162    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="df41b9a2-2afa-45cc-acb1-f0ff680d1227" containerName="manager"
Jul 07 04:31:34.972289 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.972174    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="58646360-9512-4a59-84f7-80e0a7ed68bb" containerName="manager"
Jul 07 04:31:34.974895 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.974878    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:34.977776 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.977753    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4gdmx\""
Jul 07 04:31:34.985593 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:34.985570    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"]
Jul 07 04:31:35.091477 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.091441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.091477 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.091474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57c96426-1f87-443e-910d-5a5cd63ec822-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.091670 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.091538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn47p\" (UniqueName: \"kubernetes.io/projected/57c96426-1f87-443e-910d-5a5cd63ec822-kube-api-access-pn47p\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.091670 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.091596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.091670 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.091614    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.091769 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.091686    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57c96426-1f87-443e-910d-5a5cd63ec822-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.091769 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.091702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57c96426-1f87-443e-910d-5a5cd63ec822-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.091769 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.091732    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.091769 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.091757    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.192739 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.192699    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57c96426-1f87-443e-910d-5a5cd63ec822-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.192739 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.192740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57c96426-1f87-443e-910d-5a5cd63ec822-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.192928 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.192771    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.192928 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.192797    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.192928 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.192823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.192928 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.192839    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57c96426-1f87-443e-910d-5a5cd63ec822-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.192928 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.192875    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn47p\" (UniqueName: \"kubernetes.io/projected/57c96426-1f87-443e-910d-5a5cd63ec822-kube-api-access-pn47p\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.192928 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.192916    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.193227 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.192939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.193282 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.193225    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.193334 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.193285    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.193434 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.193414    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.193434 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.193416    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.193791 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.193771    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57c96426-1f87-443e-910d-5a5cd63ec822-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.195396 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.195371    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57c96426-1f87-443e-910d-5a5cd63ec822-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.195489 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.195475    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57c96426-1f87-443e-910d-5a5cd63ec822-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.201602 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.201575    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57c96426-1f87-443e-910d-5a5cd63ec822-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.201852 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.201833    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn47p\" (UniqueName: \"kubernetes.io/projected/57c96426-1f87-443e-910d-5a5cd63ec822-kube-api-access-pn47p\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9jx4n\" (UID: \"57c96426-1f87-443e-910d-5a5cd63ec822\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.285607 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.285519    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:35.421778 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.421752    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"]
Jul 07 04:31:35.423670 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:31:35.423642    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c96426_1f87_443e_910d_5a5cd63ec822.slice/crio-fcd8781ed5809cf947a05c23395f55c9a89df4d85a57540a4b595b76eb77caeb WatchSource:0}: Error finding container fcd8781ed5809cf947a05c23395f55c9a89df4d85a57540a4b595b76eb77caeb: Status 404 returned error can't find the container with id fcd8781ed5809cf947a05c23395f55c9a89df4d85a57540a4b595b76eb77caeb
Jul 07 04:31:35.426101 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.426072    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:31:35.426171 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.426133    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:31:35.426171 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.426160    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:31:35.629907 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.629809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n" event={"ID":"57c96426-1f87-443e-910d-5a5cd63ec822","Type":"ContainerStarted","Data":"d3d431a4c0aef0bd29a4f2a9b41f4734c6553ce50aca96fddf13786fd57d8f6c"}
Jul 07 04:31:35.629907 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.629895    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n" event={"ID":"57c96426-1f87-443e-910d-5a5cd63ec822","Type":"ContainerStarted","Data":"fcd8781ed5809cf947a05c23395f55c9a89df4d85a57540a4b595b76eb77caeb"}
Jul 07 04:31:35.650408 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:35.650334    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n" podStartSLOduration=1.650316895 podStartE2EDuration="1.650316895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:31:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:31:35.648976712 +0000 UTC m=+455.536515536" watchObservedRunningTime="2026-07-07 04:31:35.650316895 +0000 UTC m=+455.537855701"
Jul 07 04:31:36.286275 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:36.286238    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:36.290753 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:36.290728    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:36.634168 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:36.634093    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:36.635120 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:36.635098    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:31:51.894458 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:51.894423    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"]
Jul 07 04:31:51.898044 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:51.898028    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:31:51.900613 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:51.900587    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 04:31:51.900742 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:51.900646    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mlfbb\""
Jul 07 04:31:51.908540 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:51.908517    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"]
Jul 07 04:31:51.988905 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:51.988865    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"]
Jul 07 04:31:52.047087 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:52.047054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbtqv\" (UniqueName: \"kubernetes.io/projected/b4dc3278-d145-4578-b524-7de9fdd0c2a1-kube-api-access-bbtqv\") pod \"limitador-limitador-64c94fd64f-vdmq7\" (UID: \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:31:52.047244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:52.047102    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4dc3278-d145-4578-b524-7de9fdd0c2a1-config-file\") pod \"limitador-limitador-64c94fd64f-vdmq7\" (UID: \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:31:52.148491 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:52.148398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbtqv\" (UniqueName: \"kubernetes.io/projected/b4dc3278-d145-4578-b524-7de9fdd0c2a1-kube-api-access-bbtqv\") pod \"limitador-limitador-64c94fd64f-vdmq7\" (UID: \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:31:52.148491 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:52.148451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4dc3278-d145-4578-b524-7de9fdd0c2a1-config-file\") pod \"limitador-limitador-64c94fd64f-vdmq7\" (UID: \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:31:52.149152 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:52.149126    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4dc3278-d145-4578-b524-7de9fdd0c2a1-config-file\") pod \"limitador-limitador-64c94fd64f-vdmq7\" (UID: \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:31:52.156993 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:52.156952    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbtqv\" (UniqueName: \"kubernetes.io/projected/b4dc3278-d145-4578-b524-7de9fdd0c2a1-kube-api-access-bbtqv\") pod \"limitador-limitador-64c94fd64f-vdmq7\" (UID: \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:31:52.208898 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:52.208860    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:31:52.341649 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:52.341624    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"]
Jul 07 04:31:52.343996 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:31:52.343962    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4dc3278_d145_4578_b524_7de9fdd0c2a1.slice/crio-02090e2d46e5990127be9c5b2dd4da03880e17e7c8a8e8de20ae400f625834f8 WatchSource:0}: Error finding container 02090e2d46e5990127be9c5b2dd4da03880e17e7c8a8e8de20ae400f625834f8: Status 404 returned error can't find the container with id 02090e2d46e5990127be9c5b2dd4da03880e17e7c8a8e8de20ae400f625834f8
Jul 07 04:31:52.707577 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:52.707542    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7" event={"ID":"b4dc3278-d145-4578-b524-7de9fdd0c2a1","Type":"ContainerStarted","Data":"02090e2d46e5990127be9c5b2dd4da03880e17e7c8a8e8de20ae400f625834f8"}
Jul 07 04:31:58.742170 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:58.742129    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7" event={"ID":"b4dc3278-d145-4578-b524-7de9fdd0c2a1","Type":"ContainerStarted","Data":"af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a"}
Jul 07 04:31:58.742655 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:58.742325    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:31:58.770384 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:31:58.770324    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7" podStartSLOduration=2.355076276 podStartE2EDuration="7.770311483s" totalImagesPullingTime="5.415235207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:31:58.769062052 +0000 UTC m=+478.656600855" watchObservedRunningTime="2026-07-07 04:31:58.770311483 +0000 UTC m=+478.657850283"
Jul 07 04:32:09.520594 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:09.520557    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"]
Jul 07 04:32:09.521076 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:09.520768    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7" podUID="b4dc3278-d145-4578-b524-7de9fdd0c2a1" containerName="limitador" containerID="cri-o://af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a" gracePeriod=30
Jul 07 04:32:09.521478 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:09.521452    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:32:10.070560 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.070536    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:32:10.101120 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.100954    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbtqv\" (UniqueName: \"kubernetes.io/projected/b4dc3278-d145-4578-b524-7de9fdd0c2a1-kube-api-access-bbtqv\") pod \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\" (UID: \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\") "
Jul 07 04:32:10.101120 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.101111    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4dc3278-d145-4578-b524-7de9fdd0c2a1-config-file\") pod \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\" (UID: \"b4dc3278-d145-4578-b524-7de9fdd0c2a1\") "
Jul 07 04:32:10.101444 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.101421    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4dc3278-d145-4578-b524-7de9fdd0c2a1-config-file" (OuterVolumeSpecName: "config-file") pod "b4dc3278-d145-4578-b524-7de9fdd0c2a1" (UID: "b4dc3278-d145-4578-b524-7de9fdd0c2a1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:32:10.103711 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.103672    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4dc3278-d145-4578-b524-7de9fdd0c2a1-kube-api-access-bbtqv" (OuterVolumeSpecName: "kube-api-access-bbtqv") pod "b4dc3278-d145-4578-b524-7de9fdd0c2a1" (UID: "b4dc3278-d145-4578-b524-7de9fdd0c2a1"). InnerVolumeSpecName "kube-api-access-bbtqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:32:10.202613 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.202577    2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4dc3278-d145-4578-b524-7de9fdd0c2a1-config-file\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:32:10.202613 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.202608    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbtqv\" (UniqueName: \"kubernetes.io/projected/b4dc3278-d145-4578-b524-7de9fdd0c2a1-kube-api-access-bbtqv\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:32:10.799609 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.799579    2568 generic.go:356] "Generic (PLEG): container finished" podID="b4dc3278-d145-4578-b524-7de9fdd0c2a1" containerID="af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a" exitCode=0
Jul 07 04:32:10.800067 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.799623    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"
Jul 07 04:32:10.800067 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.799671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7" event={"ID":"b4dc3278-d145-4578-b524-7de9fdd0c2a1","Type":"ContainerDied","Data":"af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a"}
Jul 07 04:32:10.800067 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.799728    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdmq7" event={"ID":"b4dc3278-d145-4578-b524-7de9fdd0c2a1","Type":"ContainerDied","Data":"02090e2d46e5990127be9c5b2dd4da03880e17e7c8a8e8de20ae400f625834f8"}
Jul 07 04:32:10.800067 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.799761    2568 scope.go:117] "RemoveContainer" containerID="af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a"
Jul 07 04:32:10.807736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.807719    2568 scope.go:117] "RemoveContainer" containerID="af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a"
Jul 07 04:32:10.807989 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:32:10.807967    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a\": container with ID starting with af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a not found: ID does not exist" containerID="af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a"
Jul 07 04:32:10.808047 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.807994    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a"} err="failed to get container status \"af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a\": rpc error: code = NotFound desc = could not find container \"af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a\": container with ID starting with af84920899ee3613ea4b286ed35f5a7b0531974045202a60c9cf719c7f84ed1a not found: ID does not exist"
Jul 07 04:32:10.818105 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.818067    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"]
Jul 07 04:32:10.820146 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:10.820126    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdmq7"]
Jul 07 04:32:12.591042 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:12.591009    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4dc3278-d145-4578-b524-7de9fdd0c2a1" path="/var/lib/kubelet/pods/b4dc3278-d145-4578-b524-7de9fdd0c2a1/volumes"
Jul 07 04:32:13.635326 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.635296    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-vmvjg"]
Jul 07 04:32:13.635698 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.635684    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4dc3278-d145-4578-b524-7de9fdd0c2a1" containerName="limitador"
Jul 07 04:32:13.635805 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.635701    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4dc3278-d145-4578-b524-7de9fdd0c2a1" containerName="limitador"
Jul 07 04:32:13.635805 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.635774    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4dc3278-d145-4578-b524-7de9fdd0c2a1" containerName="limitador"
Jul 07 04:32:13.639082 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.639057    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:32:13.641661 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.641641    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 04:32:13.641773 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.641723    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-86zhm\""
Jul 07 04:32:13.646956 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.646784    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vmvjg"]
Jul 07 04:32:13.740015 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.739979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a182e427-d216-4124-a3b9-86dfa71fcadf-data\") pod \"postgres-69fb4594cf-vmvjg\" (UID: \"a182e427-d216-4124-a3b9-86dfa71fcadf\") " pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:32:13.740180 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.740057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvdgq\" (UniqueName: \"kubernetes.io/projected/a182e427-d216-4124-a3b9-86dfa71fcadf-kube-api-access-bvdgq\") pod \"postgres-69fb4594cf-vmvjg\" (UID: \"a182e427-d216-4124-a3b9-86dfa71fcadf\") " pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:32:13.841531 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.841498    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvdgq\" (UniqueName: \"kubernetes.io/projected/a182e427-d216-4124-a3b9-86dfa71fcadf-kube-api-access-bvdgq\") pod \"postgres-69fb4594cf-vmvjg\" (UID: \"a182e427-d216-4124-a3b9-86dfa71fcadf\") " pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:32:13.841684 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.841579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a182e427-d216-4124-a3b9-86dfa71fcadf-data\") pod \"postgres-69fb4594cf-vmvjg\" (UID: \"a182e427-d216-4124-a3b9-86dfa71fcadf\") " pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:32:13.841952 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.841933    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a182e427-d216-4124-a3b9-86dfa71fcadf-data\") pod \"postgres-69fb4594cf-vmvjg\" (UID: \"a182e427-d216-4124-a3b9-86dfa71fcadf\") " pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:32:13.850086 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.850064    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvdgq\" (UniqueName: \"kubernetes.io/projected/a182e427-d216-4124-a3b9-86dfa71fcadf-kube-api-access-bvdgq\") pod \"postgres-69fb4594cf-vmvjg\" (UID: \"a182e427-d216-4124-a3b9-86dfa71fcadf\") " pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:32:13.953287 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:13.953253    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:32:14.081281 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:14.081256    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vmvjg"]
Jul 07 04:32:14.083521 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:32:14.083495    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda182e427_d216_4124_a3b9_86dfa71fcadf.slice/crio-1f53d961ae59590c672d3ad3e426b0042f64c1ca0ccd86ffe2e4006095242a23 WatchSource:0}: Error finding container 1f53d961ae59590c672d3ad3e426b0042f64c1ca0ccd86ffe2e4006095242a23: Status 404 returned error can't find the container with id 1f53d961ae59590c672d3ad3e426b0042f64c1ca0ccd86ffe2e4006095242a23
Jul 07 04:32:14.819671 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:14.819636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vmvjg" event={"ID":"a182e427-d216-4124-a3b9-86dfa71fcadf","Type":"ContainerStarted","Data":"1f53d961ae59590c672d3ad3e426b0042f64c1ca0ccd86ffe2e4006095242a23"}
Jul 07 04:32:19.846858 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:19.846818    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vmvjg" event={"ID":"a182e427-d216-4124-a3b9-86dfa71fcadf","Type":"ContainerStarted","Data":"d6c7bc9fe309dc3963e15657c596dc9c6ab02206e2232ff8dd4e064cb2c83575"}
Jul 07 04:32:19.847220 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:19.846893    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:32:19.864364 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:19.864291    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-vmvjg" podStartSLOduration=1.9989170189999999 podStartE2EDuration="6.864274121s" totalImagesPullingTime="4.865357102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:32:19.863188355 +0000 UTC m=+499.750727158" watchObservedRunningTime="2026-07-07 04:32:19.864274121 +0000 UTC m=+499.751812927"
Jul 07 04:32:25.881006 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:32:25.880977    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-vmvjg"
Jul 07 04:33:08.847746 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.847710    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qpgxh"]
Jul 07 04:33:08.850624 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.850601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:08.853271 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.853212    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 04:33:08.853271 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.853223    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hpv6w\""
Jul 07 04:33:08.862272 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.862248    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qpgxh"]
Jul 07 04:33:08.883567 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.883536    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dz6wf"]
Jul 07 04:33:08.885709 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.885686    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:08.895527 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.895503    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dz6wf"]
Jul 07 04:33:08.962080 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.962044    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xpjz\" (UniqueName: \"kubernetes.io/projected/27152c28-10b1-4c4b-9267-66e6ff8e4300-kube-api-access-9xpjz\") pod \"payload-pre-processing-7964457696-qpgxh\" (UID: \"27152c28-10b1-4c4b-9267-66e6ff8e4300\") " pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:08.962239 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:08.962194    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27152c28-10b1-4c4b-9267-66e6ff8e4300-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qpgxh\" (UID: \"27152c28-10b1-4c4b-9267-66e6ff8e4300\") " pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:09.063109 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.063072    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef36e489-2c3a-4c5a-a51c-04db26044234-plugins-config-volume\") pod \"payload-processing-58f86c7798-dz6wf\" (UID: \"ef36e489-2c3a-4c5a-a51c-04db26044234\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:09.063109 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.063112    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27152c28-10b1-4c4b-9267-66e6ff8e4300-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qpgxh\" (UID: \"27152c28-10b1-4c4b-9267-66e6ff8e4300\") " pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:09.063330 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.063133    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t88xh\" (UniqueName: \"kubernetes.io/projected/ef36e489-2c3a-4c5a-a51c-04db26044234-kube-api-access-t88xh\") pod \"payload-processing-58f86c7798-dz6wf\" (UID: \"ef36e489-2c3a-4c5a-a51c-04db26044234\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:09.063330 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.063198    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xpjz\" (UniqueName: \"kubernetes.io/projected/27152c28-10b1-4c4b-9267-66e6ff8e4300-kube-api-access-9xpjz\") pod \"payload-pre-processing-7964457696-qpgxh\" (UID: \"27152c28-10b1-4c4b-9267-66e6ff8e4300\") " pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:09.063862 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.063844    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27152c28-10b1-4c4b-9267-66e6ff8e4300-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qpgxh\" (UID: \"27152c28-10b1-4c4b-9267-66e6ff8e4300\") " pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:09.071881 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.071841    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xpjz\" (UniqueName: \"kubernetes.io/projected/27152c28-10b1-4c4b-9267-66e6ff8e4300-kube-api-access-9xpjz\") pod \"payload-pre-processing-7964457696-qpgxh\" (UID: \"27152c28-10b1-4c4b-9267-66e6ff8e4300\") " pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:09.161545 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.161507    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:09.163812 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.163784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef36e489-2c3a-4c5a-a51c-04db26044234-plugins-config-volume\") pod \"payload-processing-58f86c7798-dz6wf\" (UID: \"ef36e489-2c3a-4c5a-a51c-04db26044234\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:09.163878 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.163828    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88xh\" (UniqueName: \"kubernetes.io/projected/ef36e489-2c3a-4c5a-a51c-04db26044234-kube-api-access-t88xh\") pod \"payload-processing-58f86c7798-dz6wf\" (UID: \"ef36e489-2c3a-4c5a-a51c-04db26044234\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:09.164520 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.164495    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef36e489-2c3a-4c5a-a51c-04db26044234-plugins-config-volume\") pod \"payload-processing-58f86c7798-dz6wf\" (UID: \"ef36e489-2c3a-4c5a-a51c-04db26044234\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:09.173569 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.173548    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88xh\" (UniqueName: \"kubernetes.io/projected/ef36e489-2c3a-4c5a-a51c-04db26044234-kube-api-access-t88xh\") pod \"payload-processing-58f86c7798-dz6wf\" (UID: \"ef36e489-2c3a-4c5a-a51c-04db26044234\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:09.196121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.196092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:09.317862 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.316812    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qpgxh"]
Jul 07 04:33:09.321328 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:33:09.321295    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27152c28_10b1_4c4b_9267_66e6ff8e4300.slice/crio-cb39ec48302a242625ea5f7f0770d257e71b94d8b0b69dec46d45cfcd4a66779 WatchSource:0}: Error finding container cb39ec48302a242625ea5f7f0770d257e71b94d8b0b69dec46d45cfcd4a66779: Status 404 returned error can't find the container with id cb39ec48302a242625ea5f7f0770d257e71b94d8b0b69dec46d45cfcd4a66779
Jul 07 04:33:09.353670 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:09.353629    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dz6wf"]
Jul 07 04:33:09.357007 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:33:09.356979    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef36e489_2c3a_4c5a_a51c_04db26044234.slice/crio-c8fd33c02f574d3c5169cccf5e39009c95fbf783291f1dafd38c201345fc6c64 WatchSource:0}: Error finding container c8fd33c02f574d3c5169cccf5e39009c95fbf783291f1dafd38c201345fc6c64: Status 404 returned error can't find the container with id c8fd33c02f574d3c5169cccf5e39009c95fbf783291f1dafd38c201345fc6c64
Jul 07 04:33:10.081607 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:10.081567    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh" event={"ID":"27152c28-10b1-4c4b-9267-66e6ff8e4300","Type":"ContainerStarted","Data":"cb39ec48302a242625ea5f7f0770d257e71b94d8b0b69dec46d45cfcd4a66779"}
Jul 07 04:33:10.083648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:10.083582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dz6wf" event={"ID":"ef36e489-2c3a-4c5a-a51c-04db26044234","Type":"ContainerStarted","Data":"c8fd33c02f574d3c5169cccf5e39009c95fbf783291f1dafd38c201345fc6c64"}
Jul 07 04:33:12.093606 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:12.093570    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh" event={"ID":"27152c28-10b1-4c4b-9267-66e6ff8e4300","Type":"ContainerStarted","Data":"fd25954f27c1a85bfcec92ddcba48833ea5d41617af1875863e664fbc5971a03"}
Jul 07 04:33:12.094102 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:12.093691    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:12.095237 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:12.095214    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dz6wf" event={"ID":"ef36e489-2c3a-4c5a-a51c-04db26044234","Type":"ContainerStarted","Data":"e37d5bf61bd6f71271c27590710a1a22c429f17efff795d918b2bc3e6490800b"}
Jul 07 04:33:12.095339 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:12.095278    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:12.113226 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:12.113185    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh" podStartSLOduration=2.401908447 podStartE2EDuration="4.113170936s" totalImagesPullingTime="1.711262489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:33:12.112909021 +0000 UTC m=+552.000447822" watchObservedRunningTime="2026-07-07 04:33:12.113170936 +0000 UTC m=+552.000709750"
Jul 07 04:33:12.131789 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:12.131742    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-dz6wf" podStartSLOduration=2.458543147 podStartE2EDuration="4.131727615s" totalImagesPullingTime="1.673184468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:33:12.130245062 +0000 UTC m=+552.017783865" watchObservedRunningTime="2026-07-07 04:33:12.131727615 +0000 UTC m=+552.019266434"
Jul 07 04:33:16.116307 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:16.116277    2568 generic.go:356] "Generic (PLEG): container finished" podID="57c96426-1f87-443e-910d-5a5cd63ec822" containerID="d3d431a4c0aef0bd29a4f2a9b41f4734c6553ce50aca96fddf13786fd57d8f6c" exitCode=0
Jul 07 04:33:16.116714 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:16.116364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n" event={"ID":"57c96426-1f87-443e-910d-5a5cd63ec822","Type":"ContainerDied","Data":"d3d431a4c0aef0bd29a4f2a9b41f4734c6553ce50aca96fddf13786fd57d8f6c"}
Jul 07 04:33:16.116774 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:16.116765    2568 scope.go:117] "RemoveContainer" containerID="d3d431a4c0aef0bd29a4f2a9b41f4734c6553ce50aca96fddf13786fd57d8f6c"
Jul 07 04:33:16.117691 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:16.117668    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:33:16.117743 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:16.117729    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:33:16.117784 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:16.117758    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:33:17.123269 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:17.123236    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n" event={"ID":"57c96426-1f87-443e-910d-5a5cd63ec822","Type":"ContainerStarted","Data":"0cdff87de7995af107a5a720f6776decd78b97c30686f6d77e72e8680041f682"}
Jul 07 04:33:17.286026 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:17.285989    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:33:17.287179 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:17.287153    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9jx4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 04:33:17.287290 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:17.287217    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n" podUID="57c96426-1f87-443e-910d-5a5cd63ec822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 04:33:18.286848 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:18.286812    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9jx4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 04:33:18.287243 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:18.286867    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n" podUID="57c96426-1f87-443e-910d-5a5cd63ec822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 04:33:19.285880 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:19.285842    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9jx4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 04:33:19.286037 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:19.285912    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n" podUID="57c96426-1f87-443e-910d-5a5cd63ec822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 04:33:20.286268 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:20.286232    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9jx4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 04:33:20.286662 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:20.286291    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n" podUID="57c96426-1f87-443e-910d-5a5cd63ec822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 04:33:21.290249 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:21.290215    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:33:21.290624 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:21.290567    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:33:21.291268 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:21.291250    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9jx4n"
Jul 07 04:33:23.102339 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:23.102307    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-dz6wf"
Jul 07 04:33:23.102757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:23.102629    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-qpgxh"
Jul 07 04:33:45.784732 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.784699    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"]
Jul 07 04:33:45.790395 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.790369    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.793082 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.793060    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xnb2g\""
Jul 07 04:33:45.793211 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.793109    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 04:33:45.793211 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.793109    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 04:33:45.794510 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.794486    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 04:33:45.800120 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.800099    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"]
Jul 07 04:33:45.887444 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.887415    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.887600 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.887474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.887600 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.887509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00fe8dd-9b1b-492a-beca-c250b3d4a485-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.887600 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.887530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.887600 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.887561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52grq\" (UniqueName: \"kubernetes.io/projected/a00fe8dd-9b1b-492a-beca-c250b3d4a485-kube-api-access-52grq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.887600 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.887590    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.989022 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.988972    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.989221 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.989039    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.989221 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.989108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.989221 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.989134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00fe8dd-9b1b-492a-beca-c250b3d4a485-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.989221 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.989167    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.989221 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.989211    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52grq\" (UniqueName: \"kubernetes.io/projected/a00fe8dd-9b1b-492a-beca-c250b3d4a485-kube-api-access-52grq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.989503 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.989391    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.989503 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.989450    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.989503 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.989492    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.991378 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.991320    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a00fe8dd-9b1b-492a-beca-c250b3d4a485-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.991601 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.991586    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00fe8dd-9b1b-492a-beca-c250b3d4a485-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:45.997793 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:45.997770    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52grq\" (UniqueName: \"kubernetes.io/projected/a00fe8dd-9b1b-492a-beca-c250b3d4a485-kube-api-access-52grq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g6gbh\" (UID: \"a00fe8dd-9b1b-492a-beca-c250b3d4a485\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:46.102602 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:46.102507    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:46.251868 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:46.251838    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"]
Jul 07 04:33:46.252789 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:33:46.252763    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00fe8dd_9b1b_492a_beca_c250b3d4a485.slice/crio-dd1980ee91f302bba141b91b052924c4a63a7f476f908522cff1e4c4d4061a81 WatchSource:0}: Error finding container dd1980ee91f302bba141b91b052924c4a63a7f476f908522cff1e4c4d4061a81: Status 404 returned error can't find the container with id dd1980ee91f302bba141b91b052924c4a63a7f476f908522cff1e4c4d4061a81
Jul 07 04:33:47.263625 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:47.263557    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh" event={"ID":"a00fe8dd-9b1b-492a-beca-c250b3d4a485","Type":"ContainerStarted","Data":"dd1980ee91f302bba141b91b052924c4a63a7f476f908522cff1e4c4d4061a81"}
Jul 07 04:33:48.270309 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:48.270271    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh" event={"ID":"a00fe8dd-9b1b-492a-beca-c250b3d4a485","Type":"ContainerStarted","Data":"5fe76db78a906ab09dd39065e78990f50c5a25d90a224a23218de54324257967"}
Jul 07 04:33:48.287898 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:48.287849    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh" podStartSLOduration=2.2596193749999998 podStartE2EDuration="3.287833843s" totalImagesPullingTime="1.028214468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:33:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:33:48.286616564 +0000 UTC m=+588.174155367" watchObservedRunningTime="2026-07-07 04:33:48.287833843 +0000 UTC m=+588.175372643"
Jul 07 04:33:56.103054 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:56.103013    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:56.103482 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:56.103100    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:56.115269 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:56.115244    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:33:56.324504 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:33:56.324476    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g6gbh"
Jul 07 04:34:00.532125 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:00.532099    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:34:00.533432 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:00.533413    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:34:03.771045 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.771013    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"]
Jul 07 04:34:03.774746 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.774720    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:03.777101 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.777082    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 04:34:03.783585 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.783559    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"]
Jul 07 04:34:03.950090 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.950053    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:03.950271 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.950119    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:03.950271 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.950141    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:03.950271 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.950156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:03.950271 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.950174    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhhh\" (UniqueName: \"kubernetes.io/projected/9d6ac7d9-4b23-4764-befe-4717ab56c983-kube-api-access-jhhhh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:03.950271 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:03.950253    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d6ac7d9-4b23-4764-befe-4717ab56c983-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.050969 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.050886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d6ac7d9-4b23-4764-befe-4717ab56c983-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.050969 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.050961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.051179 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.051038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.051179 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.051067    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.051179 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.051090    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.051179 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.051113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhhh\" (UniqueName: \"kubernetes.io/projected/9d6ac7d9-4b23-4764-befe-4717ab56c983-kube-api-access-jhhhh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.051499 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.051475    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.051499 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.051489    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.051626 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.051570    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.053438 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.053412    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d6ac7d9-4b23-4764-befe-4717ab56c983-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.053569 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.053530    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d6ac7d9-4b23-4764-befe-4717ab56c983-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.058992 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.058970    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhhh\" (UniqueName: \"kubernetes.io/projected/9d6ac7d9-4b23-4764-befe-4717ab56c983-kube-api-access-jhhhh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2g6jz\" (UID: \"9d6ac7d9-4b23-4764-befe-4717ab56c983\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.085413 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.085384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:04.219530 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.219504    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"]
Jul 07 04:34:04.221271 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:34:04.221246    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6ac7d9_4b23_4764_befe_4717ab56c983.slice/crio-c01fb725defd3ae80be309402bfb1f9413d4920d612e9e6c15660b752e9020ef WatchSource:0}: Error finding container c01fb725defd3ae80be309402bfb1f9413d4920d612e9e6c15660b752e9020ef: Status 404 returned error can't find the container with id c01fb725defd3ae80be309402bfb1f9413d4920d612e9e6c15660b752e9020ef
Jul 07 04:34:04.345396 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:04.345289    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz" event={"ID":"9d6ac7d9-4b23-4764-befe-4717ab56c983","Type":"ContainerStarted","Data":"c01fb725defd3ae80be309402bfb1f9413d4920d612e9e6c15660b752e9020ef"}
Jul 07 04:34:05.351406 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:05.351373    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz" event={"ID":"9d6ac7d9-4b23-4764-befe-4717ab56c983","Type":"ContainerStarted","Data":"e6713d00658ddba6e01cbfeafa713b967465c38029e02005009546c00fd19cd0"}
Jul 07 04:34:05.381832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:05.381778    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz" podStartSLOduration=2.206515393 podStartE2EDuration="2.38176241s" totalImagesPullingTime="175.247017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:34:05.379012277 +0000 UTC m=+605.266551078" watchObservedRunningTime="2026-07-07 04:34:05.38176241 +0000 UTC m=+605.269301251"
Jul 07 04:34:14.086548 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:14.086509    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:14.086928 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:14.086593    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:14.099138 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:14.099110    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:14.404532 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:14.404506    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2g6jz"
Jul 07 04:34:49.278239 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.278201    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"]
Jul 07 04:34:49.288841 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.288763    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.291368 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.291322    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 04:34:49.291840 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.291817    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"]
Jul 07 04:34:49.370270 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.370237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.370270 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.370271    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.370485 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.370303    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.370485 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.370329    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrzg7\" (UniqueName: \"kubernetes.io/projected/a829ec32-34ca-4045-8399-0a1614fac1cc-kube-api-access-qrzg7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.370485 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.370402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a829ec32-34ca-4045-8399-0a1614fac1cc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.370485 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.370425    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.471640 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.471607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.471640 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.471639    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.471876 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.471667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.471876 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.471688    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrzg7\" (UniqueName: \"kubernetes.io/projected/a829ec32-34ca-4045-8399-0a1614fac1cc-kube-api-access-qrzg7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.471876 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.471728    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a829ec32-34ca-4045-8399-0a1614fac1cc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.471876 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.471752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.472103 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.472035    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.472163 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.472133    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.472204 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.472187    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.474116 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.474097    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a829ec32-34ca-4045-8399-0a1614fac1cc-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.474191 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.474173    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a829ec32-34ca-4045-8399-0a1614fac1cc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.479285 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.479264    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrzg7\" (UniqueName: \"kubernetes.io/projected/a829ec32-34ca-4045-8399-0a1614fac1cc-kube-api-access-qrzg7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v\" (UID: \"a829ec32-34ca-4045-8399-0a1614fac1cc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.599138 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.599054    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:49.732839 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.732814    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"]
Jul 07 04:34:49.734398 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:34:49.734371    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda829ec32_34ca_4045_8399_0a1614fac1cc.slice/crio-70c889ac8254bde46d856d6593a06641b08a45248083654b5147b1d736e8b4ac WatchSource:0}: Error finding container 70c889ac8254bde46d856d6593a06641b08a45248083654b5147b1d736e8b4ac: Status 404 returned error can't find the container with id 70c889ac8254bde46d856d6593a06641b08a45248083654b5147b1d736e8b4ac
Jul 07 04:34:49.735681 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:49.735663    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 04:34:50.574757 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:50.574717    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v" event={"ID":"a829ec32-34ca-4045-8399-0a1614fac1cc","Type":"ContainerStarted","Data":"86ac864b7d6bc9124d5b7a0c800f95f9c2c709240682873efb233c3e8a5e1904"}
Jul 07 04:34:50.575315 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:50.574765    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v" event={"ID":"a829ec32-34ca-4045-8399-0a1614fac1cc","Type":"ContainerStarted","Data":"70c889ac8254bde46d856d6593a06641b08a45248083654b5147b1d736e8b4ac"}
Jul 07 04:34:50.592104 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:50.592006    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v" podStartSLOduration=1.398536607 podStartE2EDuration="1.591987744s" totalImagesPullingTime="193.451137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:34:50.591598954 +0000 UTC m=+650.479137756" watchObservedRunningTime="2026-07-07 04:34:50.591987744 +0000 UTC m=+650.479526546"
Jul 07 04:34:59.599211 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:59.599172    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:59.599211 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:59.599218    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:59.611379 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:59.611336    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:34:59.626751 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:34:59.626726    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v"
Jul 07 04:39:00.562952 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:39:00.562874    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:39:00.562952 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:39:00.562930    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:41:35.260737 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:35.260700    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"]
Jul 07 04:41:35.261251 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:35.260894    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn" podUID="0279f314-d4fd-450f-a1d0-4c63fdde128d" containerName="manager" containerID="cri-o://7bfb546ae16ec2eb63f3fff9a7327b55e859fa3cf1292f523da4ca7591c9625e" gracePeriod=10
Jul 07 04:41:37.536426 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:37.536394    2568 generic.go:356] "Generic (PLEG): container finished" podID="0279f314-d4fd-450f-a1d0-4c63fdde128d" containerID="7bfb546ae16ec2eb63f3fff9a7327b55e859fa3cf1292f523da4ca7591c9625e" exitCode=0
Jul 07 04:41:37.536715 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:37.536445    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn" event={"ID":"0279f314-d4fd-450f-a1d0-4c63fdde128d","Type":"ContainerDied","Data":"7bfb546ae16ec2eb63f3fff9a7327b55e859fa3cf1292f523da4ca7591c9625e"}
Jul 07 04:41:37.618527 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:37.618505    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:41:37.713748 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:37.713676    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0279f314-d4fd-450f-a1d0-4c63fdde128d-extensions-socket-volume\") pod \"0279f314-d4fd-450f-a1d0-4c63fdde128d\" (UID: \"0279f314-d4fd-450f-a1d0-4c63fdde128d\") "
Jul 07 04:41:37.713748 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:37.713732    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhxzr\" (UniqueName: \"kubernetes.io/projected/0279f314-d4fd-450f-a1d0-4c63fdde128d-kube-api-access-qhxzr\") pod \"0279f314-d4fd-450f-a1d0-4c63fdde128d\" (UID: \"0279f314-d4fd-450f-a1d0-4c63fdde128d\") "
Jul 07 04:41:37.714054 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:37.714027    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0279f314-d4fd-450f-a1d0-4c63fdde128d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0279f314-d4fd-450f-a1d0-4c63fdde128d" (UID: "0279f314-d4fd-450f-a1d0-4c63fdde128d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:41:37.715683 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:37.715663    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0279f314-d4fd-450f-a1d0-4c63fdde128d-kube-api-access-qhxzr" (OuterVolumeSpecName: "kube-api-access-qhxzr") pod "0279f314-d4fd-450f-a1d0-4c63fdde128d" (UID: "0279f314-d4fd-450f-a1d0-4c63fdde128d"). InnerVolumeSpecName "kube-api-access-qhxzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:41:37.815420 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:37.815393    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0279f314-d4fd-450f-a1d0-4c63fdde128d-extensions-socket-volume\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:41:37.815420 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:37.815417    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhxzr\" (UniqueName: \"kubernetes.io/projected/0279f314-d4fd-450f-a1d0-4c63fdde128d-kube-api-access-qhxzr\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:41:38.542508 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:38.542479    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"
Jul 07 04:41:38.542957 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:38.542506    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn" event={"ID":"0279f314-d4fd-450f-a1d0-4c63fdde128d","Type":"ContainerDied","Data":"2a026fe969566a88d3adf9b75469a10253b36d57b067b8cc7d6efa81d41d5f72"}
Jul 07 04:41:38.542957 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:38.542576    2568 scope.go:117] "RemoveContainer" containerID="7bfb546ae16ec2eb63f3fff9a7327b55e859fa3cf1292f523da4ca7591c9625e"
Jul 07 04:41:38.566743 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:38.566719    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"]
Jul 07 04:41:38.572965 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:38.572937    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q57sn"]
Jul 07 04:41:38.591947 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:41:38.591919    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0279f314-d4fd-450f-a1d0-4c63fdde128d" path="/var/lib/kubelet/pods/0279f314-d4fd-450f-a1d0-4c63fdde128d/volumes"
Jul 07 04:42:36.402372 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.402317    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"]
Jul 07 04:42:36.402877 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.402730    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0279f314-d4fd-450f-a1d0-4c63fdde128d" containerName="manager"
Jul 07 04:42:36.402877 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.402743    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0279f314-d4fd-450f-a1d0-4c63fdde128d" containerName="manager"
Jul 07 04:42:36.402877 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.402799    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0279f314-d4fd-450f-a1d0-4c63fdde128d" containerName="manager"
Jul 07 04:42:36.405660 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.405640    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:42:36.408474 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.408453    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m5r5j\""
Jul 07 04:42:36.418985 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.418958    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"]
Jul 07 04:42:36.520576 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.520544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6xgp\" (UniqueName: \"kubernetes.io/projected/f4176ab9-959b-4a08-8725-44025fc86184-kube-api-access-f6xgp\") pod \"kuadrant-operator-controller-manager-86878c769f-4j5vx\" (UID: \"f4176ab9-959b-4a08-8725-44025fc86184\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:42:36.520735 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.520713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4176ab9-959b-4a08-8725-44025fc86184-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4j5vx\" (UID: \"f4176ab9-959b-4a08-8725-44025fc86184\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:42:36.621611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.621577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6xgp\" (UniqueName: \"kubernetes.io/projected/f4176ab9-959b-4a08-8725-44025fc86184-kube-api-access-f6xgp\") pod \"kuadrant-operator-controller-manager-86878c769f-4j5vx\" (UID: \"f4176ab9-959b-4a08-8725-44025fc86184\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:42:36.621747 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.621727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4176ab9-959b-4a08-8725-44025fc86184-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4j5vx\" (UID: \"f4176ab9-959b-4a08-8725-44025fc86184\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:42:36.622072 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.622050    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4176ab9-959b-4a08-8725-44025fc86184-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4j5vx\" (UID: \"f4176ab9-959b-4a08-8725-44025fc86184\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:42:36.631039 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.631012    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6xgp\" (UniqueName: \"kubernetes.io/projected/f4176ab9-959b-4a08-8725-44025fc86184-kube-api-access-f6xgp\") pod \"kuadrant-operator-controller-manager-86878c769f-4j5vx\" (UID: \"f4176ab9-959b-4a08-8725-44025fc86184\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:42:36.715790 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.715728    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:42:36.854008 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:36.853982    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"]
Jul 07 04:42:36.856141 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:42:36.856106    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4176ab9_959b_4a08_8725_44025fc86184.slice/crio-980eb1f73662e67bdea63adefa8a3d8cf1780b339354b87c8a76b45dba9923be WatchSource:0}: Error finding container 980eb1f73662e67bdea63adefa8a3d8cf1780b339354b87c8a76b45dba9923be: Status 404 returned error can't find the container with id 980eb1f73662e67bdea63adefa8a3d8cf1780b339354b87c8a76b45dba9923be
Jul 07 04:42:37.820994 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:37.820955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx" event={"ID":"f4176ab9-959b-4a08-8725-44025fc86184","Type":"ContainerStarted","Data":"ee78f06c6608d46c3d23bd037c9c840acbe4b13fead0665e589bacaea131290f"}
Jul 07 04:42:37.821437 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:37.821050    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx" event={"ID":"f4176ab9-959b-4a08-8725-44025fc86184","Type":"ContainerStarted","Data":"980eb1f73662e67bdea63adefa8a3d8cf1780b339354b87c8a76b45dba9923be"}
Jul 07 04:42:37.821437 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:37.821079    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:42:37.844074 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:37.844026    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx" podStartSLOduration=1.8440121889999999 podStartE2EDuration="1.844012189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:42:37.841135862 +0000 UTC m=+1117.728674666" watchObservedRunningTime="2026-07-07 04:42:37.844012189 +0000 UTC m=+1117.731550989"
Jul 07 04:42:48.828205 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:42:48.828168    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4j5vx"
Jul 07 04:44:00.601896 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:44:00.601793    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:44:00.604857 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:44:00.602403    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:48:43.707881 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.707850    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"]
Jul 07 04:48:43.711634 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.711612    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.714070 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.714045    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b11dd824-openshift-default-dockercfg-bgsg6\""
Jul 07 04:48:43.738360 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.738322    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"]
Jul 07 04:48:43.791202 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.791174    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-certs\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.791341 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.791214    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-istio-token\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.791341 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.791235    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-data\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.791341 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.791313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-credential-socket\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.791341 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.791362    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956f6003-8207-47f3-b194-63a24744f1bb-istio-podinfo\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.791528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.791406    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-socket\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.791528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.791444    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb5j8\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-kube-api-access-rb5j8\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.791528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.791476    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-envoy\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.791528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.791504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956f6003-8207-47f3-b194-63a24744f1bb-istiod-ca-cert\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.892663 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.892633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-socket\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.892835 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.892678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb5j8\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-kube-api-access-rb5j8\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.892835 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.892709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-envoy\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.892835 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.892730    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956f6003-8207-47f3-b194-63a24744f1bb-istiod-ca-cert\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.892835 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.892760    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-certs\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.892835 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.892798    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-istio-token\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.892835 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.892832    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-data\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.893142 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.892879    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-credential-socket\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.893142 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.892910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956f6003-8207-47f3-b194-63a24744f1bb-istio-podinfo\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.893142 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.893066    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-socket\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.893289 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.893229    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-certs\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.893426 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.893407    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-credential-socket\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.893509 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.893448    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-data\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.893509 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.893491    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956f6003-8207-47f3-b194-63a24744f1bb-istiod-ca-cert\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.895069 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.895048    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-envoy\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.895297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.895278    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956f6003-8207-47f3-b194-63a24744f1bb-istio-podinfo\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.902955 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.902932    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-istio-token\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:43.903238 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:43.903221    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb5j8\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-kube-api-access-rb5j8\") pod \"e2e-ait-b11dd824-openshift-default-86f76df679-wvs76\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") " pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:44.022228 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:44.022152    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:44.162648 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:44.162619    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"]
Jul 07 04:48:44.164318 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:48:44.164292    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956f6003_8207_47f3_b194_63a24744f1bb.slice/crio-11676967406ab6da57305438f6a5ff306031f9037d63e3b7bf4280d2401841c4 WatchSource:0}: Error finding container 11676967406ab6da57305438f6a5ff306031f9037d63e3b7bf4280d2401841c4: Status 404 returned error can't find the container with id 11676967406ab6da57305438f6a5ff306031f9037d63e3b7bf4280d2401841c4
Jul 07 04:48:44.166503 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:44.166473    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:48:44.166577 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:44.166537    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:48:44.166577 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:44.166562    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:48:44.571410 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:44.571375    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76" event={"ID":"956f6003-8207-47f3-b194-63a24744f1bb","Type":"ContainerStarted","Data":"6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6"}
Jul 07 04:48:44.571575 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:44.571451    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76" event={"ID":"956f6003-8207-47f3-b194-63a24744f1bb","Type":"ContainerStarted","Data":"11676967406ab6da57305438f6a5ff306031f9037d63e3b7bf4280d2401841c4"}
Jul 07 04:48:44.595645 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:44.595594    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76" podStartSLOduration=1.595581269 podStartE2EDuration="1.595581269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:48:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:48:44.593692125 +0000 UTC m=+1484.481230926" watchObservedRunningTime="2026-07-07 04:48:44.595581269 +0000 UTC m=+1484.483120072"
Jul 07 04:48:45.022607 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:45.022574    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:45.027269 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:45.027244    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:45.576741 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:45.576714    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:45.577518 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:45.577498    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:50.279321 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:50.279282    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"]
Jul 07 04:48:50.279811 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:50.279480    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76" podUID="956f6003-8207-47f3-b194-63a24744f1bb" containerName="istio-proxy" containerID="cri-o://6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6" gracePeriod=30
Jul 07 04:48:55.531832 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.531806    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:55.606109 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606029    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-envoy\") pod \"956f6003-8207-47f3-b194-63a24744f1bb\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") "
Jul 07 04:48:55.606109 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606072    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956f6003-8207-47f3-b194-63a24744f1bb-istio-podinfo\") pod \"956f6003-8207-47f3-b194-63a24744f1bb\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") "
Jul 07 04:48:55.606109 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606092    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-credential-socket\") pod \"956f6003-8207-47f3-b194-63a24744f1bb\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") "
Jul 07 04:48:55.606390 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606135    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb5j8\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-kube-api-access-rb5j8\") pod \"956f6003-8207-47f3-b194-63a24744f1bb\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") "
Jul 07 04:48:55.606390 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606167    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-data\") pod \"956f6003-8207-47f3-b194-63a24744f1bb\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") "
Jul 07 04:48:55.606390 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606191    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-istio-token\") pod \"956f6003-8207-47f3-b194-63a24744f1bb\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") "
Jul 07 04:48:55.606390 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606227    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-certs\") pod \"956f6003-8207-47f3-b194-63a24744f1bb\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") "
Jul 07 04:48:55.606390 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606290    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956f6003-8207-47f3-b194-63a24744f1bb-istiod-ca-cert\") pod \"956f6003-8207-47f3-b194-63a24744f1bb\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") "
Jul 07 04:48:55.606390 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606337    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-socket\") pod \"956f6003-8207-47f3-b194-63a24744f1bb\" (UID: \"956f6003-8207-47f3-b194-63a24744f1bb\") "
Jul 07 04:48:55.606694 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606486    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "956f6003-8207-47f3-b194-63a24744f1bb" (UID: "956f6003-8207-47f3-b194-63a24744f1bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:48:55.606694 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606507    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "956f6003-8207-47f3-b194-63a24744f1bb" (UID: "956f6003-8207-47f3-b194-63a24744f1bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:48:55.606792 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606689    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "956f6003-8207-47f3-b194-63a24744f1bb" (UID: "956f6003-8207-47f3-b194-63a24744f1bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:48:55.606792 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606708    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "956f6003-8207-47f3-b194-63a24744f1bb" (UID: "956f6003-8207-47f3-b194-63a24744f1bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:48:55.606893 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606826    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:48:55.606893 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606865    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:48:55.606893 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606881    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:48:55.606996 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606895    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:48:55.607029 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.606996    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/956f6003-8207-47f3-b194-63a24744f1bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "956f6003-8207-47f3-b194-63a24744f1bb" (UID: "956f6003-8207-47f3-b194-63a24744f1bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:48:55.608445 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.608421    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/956f6003-8207-47f3-b194-63a24744f1bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "956f6003-8207-47f3-b194-63a24744f1bb" (UID: "956f6003-8207-47f3-b194-63a24744f1bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 04:48:55.608545 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.608473    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-kube-api-access-rb5j8" (OuterVolumeSpecName: "kube-api-access-rb5j8") pod "956f6003-8207-47f3-b194-63a24744f1bb" (UID: "956f6003-8207-47f3-b194-63a24744f1bb"). InnerVolumeSpecName "kube-api-access-rb5j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:48:55.608642 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.608622    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "956f6003-8207-47f3-b194-63a24744f1bb" (UID: "956f6003-8207-47f3-b194-63a24744f1bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:48:55.608718 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.608642    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "956f6003-8207-47f3-b194-63a24744f1bb" (UID: "956f6003-8207-47f3-b194-63a24744f1bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:48:55.625457 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.625430    2568 generic.go:356] "Generic (PLEG): container finished" podID="956f6003-8207-47f3-b194-63a24744f1bb" containerID="6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6" exitCode=0
Jul 07 04:48:55.625568 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.625474    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"
Jul 07 04:48:55.625568 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.625514    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76" event={"ID":"956f6003-8207-47f3-b194-63a24744f1bb","Type":"ContainerDied","Data":"6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6"}
Jul 07 04:48:55.625679 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.625574    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76" event={"ID":"956f6003-8207-47f3-b194-63a24744f1bb","Type":"ContainerDied","Data":"11676967406ab6da57305438f6a5ff306031f9037d63e3b7bf4280d2401841c4"}
Jul 07 04:48:55.625679 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.625604    2568 scope.go:117] "RemoveContainer" containerID="6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6"
Jul 07 04:48:55.635950 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.635931    2568 scope.go:117] "RemoveContainer" containerID="6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6"
Jul 07 04:48:55.636190 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:48:55.636171    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6\": container with ID starting with 6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6 not found: ID does not exist" containerID="6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6"
Jul 07 04:48:55.636248 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.636203    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6"} err="failed to get container status \"6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6\": rpc error: code = NotFound desc = could not find container \"6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6\": container with ID starting with 6542bb1b776b9681447c8af7222afd0e4fd72032e63a511528fd31d2aca6e5b6 not found: ID does not exist"
Jul 07 04:48:55.648177 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.648154    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"]
Jul 07 04:48:55.655458 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.655438    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b11dd824-openshift-default-86f76df679-wvs76"]
Jul 07 04:48:55.708177 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.708152    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/956f6003-8207-47f3-b194-63a24744f1bb-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:48:55.708177 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.708173    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/956f6003-8207-47f3-b194-63a24744f1bb-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:48:55.708177 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.708181    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/956f6003-8207-47f3-b194-63a24744f1bb-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:48:55.708345 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.708193    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb5j8\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-kube-api-access-rb5j8\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:48:55.708345 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:55.708209    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/956f6003-8207-47f3-b194-63a24744f1bb-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:48:56.231571 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.231048    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"]
Jul 07 04:48:56.231803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.231691    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956f6003-8207-47f3-b194-63a24744f1bb" containerName="istio-proxy"
Jul 07 04:48:56.231803 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.231712    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="956f6003-8207-47f3-b194-63a24744f1bb" containerName="istio-proxy"
Jul 07 04:48:56.231937 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.231835    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="956f6003-8207-47f3-b194-63a24744f1bb" containerName="istio-proxy"
Jul 07 04:48:56.239445 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.239404    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.243695 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.243663    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5bdca307-openshift-default-dockercfg-kc5mw\""
Jul 07 04:48:56.250061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.250012    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"]
Jul 07 04:48:56.314942 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.314906    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9lqg\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-kube-api-access-s9lqg\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.315132 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.314948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-socket\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.315132 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.315055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053e9d52-78ea-499d-b4f5-980c90e870d1-istiod-ca-cert\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.315132 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.315091    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-token\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.315313 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.315177    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-podinfo\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.315313 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.315219    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-certs\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.315313 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.315263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-data\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.315494 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.315326    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-credential-socket\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.315494 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.315393    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-envoy\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.416778 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.416741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9lqg\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-kube-api-access-s9lqg\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.416778 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.416782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-socket\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.416991    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053e9d52-78ea-499d-b4f5-980c90e870d1-istiod-ca-cert\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417085 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417034    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-token\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417153 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-podinfo\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417153 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-certs\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417258 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417162    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-socket\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417258 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417192    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-data\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417258 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-credential-socket\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417470 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-envoy\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417669 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417643    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-certs\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417802 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417735    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-data\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417802 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417762    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-credential-socket\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.417913 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.417871    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053e9d52-78ea-499d-b4f5-980c90e870d1-istiod-ca-cert\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.419564 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.419547    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-envoy\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.419667 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.419651    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-podinfo\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.425060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.425037    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-token\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.425575 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.425555    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9lqg\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-kube-api-access-s9lqg\") pod \"e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") " pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.557098 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.557019    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:56.591263 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.591228    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="956f6003-8207-47f3-b194-63a24744f1bb" path="/var/lib/kubelet/pods/956f6003-8207-47f3-b194-63a24744f1bb/volumes"
Jul 07 04:48:56.698583 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.698560    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"]
Jul 07 04:48:56.700679 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:48:56.700653    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053e9d52_78ea_499d_b4f5_980c90e870d1.slice/crio-5f5146100760e40e33e69bba974b7419f37d3ff9e79078c3ef9687f525197c37 WatchSource:0}: Error finding container 5f5146100760e40e33e69bba974b7419f37d3ff9e79078c3ef9687f525197c37: Status 404 returned error can't find the container with id 5f5146100760e40e33e69bba974b7419f37d3ff9e79078c3ef9687f525197c37
Jul 07 04:48:56.703121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.703095    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:48:56.703231 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.703153    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:48:56.703231 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:56.703181    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:48:57.638992 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:57.638951    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn" event={"ID":"053e9d52-78ea-499d-b4f5-980c90e870d1","Type":"ContainerStarted","Data":"9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd"}
Jul 07 04:48:57.639490 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:57.639012    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn" event={"ID":"053e9d52-78ea-499d-b4f5-980c90e870d1","Type":"ContainerStarted","Data":"5f5146100760e40e33e69bba974b7419f37d3ff9e79078c3ef9687f525197c37"}
Jul 07 04:48:57.667657 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:57.667606    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn" podStartSLOduration=1.667589902 podStartE2EDuration="1.667589902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:48:57.666274573 +0000 UTC m=+1497.553813377" watchObservedRunningTime="2026-07-07 04:48:57.667589902 +0000 UTC m=+1497.555128703"
Jul 07 04:48:58.557888 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:58.557841    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:58.562872 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:58.562848    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:58.644405 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:58.644377    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:48:58.645233 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:48:58.645212    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:49:00.630391 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:00.630259    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:49:00.647900 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:00.631058    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:49:08.699787 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:08.699754    2568 generic.go:356] "Generic (PLEG): container finished" podID="053e9d52-78ea-499d-b4f5-980c90e870d1" containerID="9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd" exitCode=0
Jul 07 04:49:08.700283 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:08.699827    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn" event={"ID":"053e9d52-78ea-499d-b4f5-980c90e870d1","Type":"ContainerDied","Data":"9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd"}
Jul 07 04:49:08.700283 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:08.700245    2568 scope.go:117] "RemoveContainer" containerID="9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd"
Jul 07 04:49:08.701329 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:08.701302    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:49:08.701516 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:08.701398    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:49:08.701516 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:08.701435    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:49:08.914216 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:08.914178    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"]
Jul 07 04:49:09.706163 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:09.706129    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn" event={"ID":"053e9d52-78ea-499d-b4f5-980c90e870d1","Type":"ContainerStarted","Data":"004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22"}
Jul 07 04:49:09.706619 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:09.706211    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn" podUID="053e9d52-78ea-499d-b4f5-980c90e870d1" containerName="istio-proxy" containerID="cri-o://004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22" gracePeriod=30
Jul 07 04:49:13.644328 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:13.644293    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:49:14.957130 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:14.957097    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"]
Jul 07 04:49:14.961012 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:14.960988    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:14.963613 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:14.963594    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-93ca8cbb-openshift-default-dockercfg-dvf4q\""
Jul 07 04:49:14.972694 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:14.972558    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"]
Jul 07 04:49:14.975170 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:14.975151    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:49:15.001743 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.001718    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-data\") pod \"053e9d52-78ea-499d-b4f5-980c90e870d1\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") "
Jul 07 04:49:15.001887 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.001760    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-certs\") pod \"053e9d52-78ea-499d-b4f5-980c90e870d1\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") "
Jul 07 04:49:15.001887 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.001795    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9lqg\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-kube-api-access-s9lqg\") pod \"053e9d52-78ea-499d-b4f5-980c90e870d1\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") "
Jul 07 04:49:15.001887 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.001830    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-token\") pod \"053e9d52-78ea-499d-b4f5-980c90e870d1\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") "
Jul 07 04:49:15.001887 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.001869    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-socket\") pod \"053e9d52-78ea-499d-b4f5-980c90e870d1\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") "
Jul 07 04:49:15.002106 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.001895    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-credential-socket\") pod \"053e9d52-78ea-499d-b4f5-980c90e870d1\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") "
Jul 07 04:49:15.002106 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.001933    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-podinfo\") pod \"053e9d52-78ea-499d-b4f5-980c90e870d1\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") "
Jul 07 04:49:15.002106 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.001968    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-envoy\") pod \"053e9d52-78ea-499d-b4f5-980c90e870d1\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") "
Jul 07 04:49:15.002106 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002038    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "053e9d52-78ea-499d-b4f5-980c90e870d1" (UID: "053e9d52-78ea-499d-b4f5-980c90e870d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:15.002106 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002074    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053e9d52-78ea-499d-b4f5-980c90e870d1-istiod-ca-cert\") pod \"053e9d52-78ea-499d-b4f5-980c90e870d1\" (UID: \"053e9d52-78ea-499d-b4f5-980c90e870d1\") "
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002167    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "053e9d52-78ea-499d-b4f5-980c90e870d1" (UID: "053e9d52-78ea-499d-b4f5-980c90e870d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002236    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-podinfo\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-credential-socket\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002380    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpk5m\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-kube-api-access-fpk5m\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002417    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-data\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002488    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/053e9d52-78ea-499d-b4f5-980c90e870d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "053e9d52-78ea-499d-b4f5-980c90e870d1" (UID: "053e9d52-78ea-499d-b4f5-980c90e870d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002505    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6a5d13-942a-49bc-a106-f3128e62b06a-istiod-ca-cert\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002531    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-token\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002567    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "053e9d52-78ea-499d-b4f5-980c90e870d1" (UID: "053e9d52-78ea-499d-b4f5-980c90e870d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:15.002736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-socket\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.003276 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-certs\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.003276 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002763    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "053e9d52-78ea-499d-b4f5-980c90e870d1" (UID: "053e9d52-78ea-499d-b4f5-980c90e870d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:15.003276 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002783    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-envoy\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.003276 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002948    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/053e9d52-78ea-499d-b4f5-980c90e870d1-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:15.003276 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.002986    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:15.003276 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.003000    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:15.003276 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.003014    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:15.003276 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.003028    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:15.004179 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.004156    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-kube-api-access-s9lqg" (OuterVolumeSpecName: "kube-api-access-s9lqg") pod "053e9d52-78ea-499d-b4f5-980c90e870d1" (UID: "053e9d52-78ea-499d-b4f5-980c90e870d1"). InnerVolumeSpecName "kube-api-access-s9lqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:49:15.004386 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.004366    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "053e9d52-78ea-499d-b4f5-980c90e870d1" (UID: "053e9d52-78ea-499d-b4f5-980c90e870d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:49:15.004675 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.004650    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "053e9d52-78ea-499d-b4f5-980c90e870d1" (UID: "053e9d52-78ea-499d-b4f5-980c90e870d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:15.004740 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.004655    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "053e9d52-78ea-499d-b4f5-980c90e870d1" (UID: "053e9d52-78ea-499d-b4f5-980c90e870d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 04:49:15.103810 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.103768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-certs\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.103810 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.103813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-envoy\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104063 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.103851    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-podinfo\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104063 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.103877    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-credential-socket\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104063 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.103920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpk5m\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-kube-api-access-fpk5m\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104063 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.103966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-data\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104270 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104063    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6a5d13-942a-49bc-a106-f3128e62b06a-istiod-ca-cert\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104270 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104092    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-token\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104270 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-socket\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104270 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104213    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-certs\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104295    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9lqg\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-kube-api-access-s9lqg\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:15.104505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104313    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:15.104505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104329    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:15.104505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104345    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/053e9d52-78ea-499d-b4f5-980c90e870d1-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:15.104505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104381    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-data\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104505 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104403    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-credential-socket\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104704 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104591    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-socket\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.104762 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.104743    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6a5d13-942a-49bc-a106-f3128e62b06a-istiod-ca-cert\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.106720 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.106696    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-envoy\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.106850 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.106834    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-podinfo\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.111581 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.111556    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-token\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.111733 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.111716    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpk5m\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-kube-api-access-fpk5m\") pod \"e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") " pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.282649 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.282556    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:15.421059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.421033    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"]
Jul 07 04:49:15.423048 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:49:15.423023    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6a5d13_942a_49bc_a106_f3128e62b06a.slice/crio-a9086e0156f3d86cf9969addd6ccead5e9a57d770700fdd6814b863283414648 WatchSource:0}: Error finding container a9086e0156f3d86cf9969addd6ccead5e9a57d770700fdd6814b863283414648: Status 404 returned error can't find the container with id a9086e0156f3d86cf9969addd6ccead5e9a57d770700fdd6814b863283414648
Jul 07 04:49:15.425023 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.424992    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:49:15.425096 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.425051    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:49:15.425096 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.425082    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:49:15.746869 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.746829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j" event={"ID":"ce6a5d13-942a-49bc-a106-f3128e62b06a","Type":"ContainerStarted","Data":"f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9"}
Jul 07 04:49:15.747061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.746892    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j" event={"ID":"ce6a5d13-942a-49bc-a106-f3128e62b06a","Type":"ContainerStarted","Data":"a9086e0156f3d86cf9969addd6ccead5e9a57d770700fdd6814b863283414648"}
Jul 07 04:49:15.748888 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.748862    2568 generic.go:356] "Generic (PLEG): container finished" podID="053e9d52-78ea-499d-b4f5-980c90e870d1" containerID="004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22" exitCode=0
Jul 07 04:49:15.749025 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.748923    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"
Jul 07 04:49:15.749025 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.748938    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn" event={"ID":"053e9d52-78ea-499d-b4f5-980c90e870d1","Type":"ContainerDied","Data":"004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22"}
Jul 07 04:49:15.749025 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.748991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn" event={"ID":"053e9d52-78ea-499d-b4f5-980c90e870d1","Type":"ContainerDied","Data":"5f5146100760e40e33e69bba974b7419f37d3ff9e79078c3ef9687f525197c37"}
Jul 07 04:49:15.749025 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.749020    2568 scope.go:117] "RemoveContainer" containerID="004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22"
Jul 07 04:49:15.759518 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.759502    2568 scope.go:117] "RemoveContainer" containerID="9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd"
Jul 07 04:49:15.767295 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.767277    2568 scope.go:117] "RemoveContainer" containerID="004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22"
Jul 07 04:49:15.767660 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:49:15.767632    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22\": container with ID starting with 004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22 not found: ID does not exist" containerID="004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22"
Jul 07 04:49:15.767763 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.767672    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22"} err="failed to get container status \"004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22\": rpc error: code = NotFound desc = could not find container \"004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22\": container with ID starting with 004a95ab79ea27b33db07a57b4d3c696d9da163b1af37cb14f27b630ac98ec22 not found: ID does not exist"
Jul 07 04:49:15.767763 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.767696    2568 scope.go:117] "RemoveContainer" containerID="9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd"
Jul 07 04:49:15.768186 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:49:15.768129    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd\": container with ID starting with 9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd not found: ID does not exist" containerID="9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd"
Jul 07 04:49:15.768186 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.768160    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd"} err="failed to get container status \"9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd\": rpc error: code = NotFound desc = could not find container \"9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd\": container with ID starting with 9a1ecb84394779c2585206d58225f64277fbd43e84e5b849a16822c9c05ba4dd not found: ID does not exist"
Jul 07 04:49:15.771781 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.771735    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j" podStartSLOduration=1.7717184270000002 podStartE2EDuration="1.771718427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:49:15.768045291 +0000 UTC m=+1515.655584093" watchObservedRunningTime="2026-07-07 04:49:15.771718427 +0000 UTC m=+1515.659257234"
Jul 07 04:49:15.782475 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.782452    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"]
Jul 07 04:49:15.786636 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:15.786615    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5bdca307-openshift-default-5fd998bbcc-mh5nn"]
Jul 07 04:49:16.283223 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:16.283193    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:16.287990 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:16.287967    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:16.601938 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:16.601853    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053e9d52-78ea-499d-b4f5-980c90e870d1" path="/var/lib/kubelet/pods/053e9d52-78ea-499d-b4f5-980c90e870d1/volumes"
Jul 07 04:49:16.756406 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:16.756375    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:16.757412 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:16.757388    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:20.786556 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:20.786525    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"]
Jul 07 04:49:20.787014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:20.786686    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j" podUID="ce6a5d13-942a-49bc-a106-f3128e62b06a" containerName="istio-proxy" containerID="cri-o://f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9" gracePeriod=30
Jul 07 04:49:26.039739 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.039715    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:26.117752 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.117672    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-envoy\") pod \"ce6a5d13-942a-49bc-a106-f3128e62b06a\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") "
Jul 07 04:49:26.117752 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.117722    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-certs\") pod \"ce6a5d13-942a-49bc-a106-f3128e62b06a\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") "
Jul 07 04:49:26.117984 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.117769    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6a5d13-942a-49bc-a106-f3128e62b06a-istiod-ca-cert\") pod \"ce6a5d13-942a-49bc-a106-f3128e62b06a\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") "
Jul 07 04:49:26.117984 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.117817    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpk5m\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-kube-api-access-fpk5m\") pod \"ce6a5d13-942a-49bc-a106-f3128e62b06a\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") "
Jul 07 04:49:26.117984 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.117884    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-credential-socket\") pod \"ce6a5d13-942a-49bc-a106-f3128e62b06a\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") "
Jul 07 04:49:26.117984 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.117901    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-token\") pod \"ce6a5d13-942a-49bc-a106-f3128e62b06a\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") "
Jul 07 04:49:26.117984 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.117929    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-podinfo\") pod \"ce6a5d13-942a-49bc-a106-f3128e62b06a\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") "
Jul 07 04:49:26.117984 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.117946    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-socket\") pod \"ce6a5d13-942a-49bc-a106-f3128e62b06a\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") "
Jul 07 04:49:26.117984 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.117977    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-data\") pod \"ce6a5d13-942a-49bc-a106-f3128e62b06a\" (UID: \"ce6a5d13-942a-49bc-a106-f3128e62b06a\") "
Jul 07 04:49:26.118323 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.118031    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce6a5d13-942a-49bc-a106-f3128e62b06a" (UID: "ce6a5d13-942a-49bc-a106-f3128e62b06a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:26.118323 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.118138    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce6a5d13-942a-49bc-a106-f3128e62b06a" (UID: "ce6a5d13-942a-49bc-a106-f3128e62b06a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:26.118323 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.118272    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:26.118323 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.118292    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:26.118577 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.118338    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce6a5d13-942a-49bc-a106-f3128e62b06a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce6a5d13-942a-49bc-a106-f3128e62b06a" (UID: "ce6a5d13-942a-49bc-a106-f3128e62b06a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:49:26.118577 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.118423    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce6a5d13-942a-49bc-a106-f3128e62b06a" (UID: "ce6a5d13-942a-49bc-a106-f3128e62b06a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:26.118577 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.118438    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce6a5d13-942a-49bc-a106-f3128e62b06a" (UID: "ce6a5d13-942a-49bc-a106-f3128e62b06a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:26.119976 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.119946    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce6a5d13-942a-49bc-a106-f3128e62b06a" (UID: "ce6a5d13-942a-49bc-a106-f3128e62b06a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:49:26.120080 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.120011    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce6a5d13-942a-49bc-a106-f3128e62b06a" (UID: "ce6a5d13-942a-49bc-a106-f3128e62b06a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 04:49:26.120116 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.120108    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce6a5d13-942a-49bc-a106-f3128e62b06a" (UID: "ce6a5d13-942a-49bc-a106-f3128e62b06a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:49:26.120213 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.120192    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-kube-api-access-fpk5m" (OuterVolumeSpecName: "kube-api-access-fpk5m") pod "ce6a5d13-942a-49bc-a106-f3128e62b06a" (UID: "ce6a5d13-942a-49bc-a106-f3128e62b06a"). InnerVolumeSpecName "kube-api-access-fpk5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:49:26.219307 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.219276    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:26.219307 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.219302    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:26.219307 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.219314    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:26.219573 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.219322    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:26.219573 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.219330    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6a5d13-942a-49bc-a106-f3128e62b06a-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:26.219573 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.219339    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6a5d13-942a-49bc-a106-f3128e62b06a-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:26.219573 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.219366    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpk5m\" (UniqueName: \"kubernetes.io/projected/ce6a5d13-942a-49bc-a106-f3128e62b06a-kube-api-access-fpk5m\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:49:26.812557 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.812519    2568 generic.go:356] "Generic (PLEG): container finished" podID="ce6a5d13-942a-49bc-a106-f3128e62b06a" containerID="f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9" exitCode=0
Jul 07 04:49:26.812725 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.812562    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"
Jul 07 04:49:26.812725 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.812608    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j" event={"ID":"ce6a5d13-942a-49bc-a106-f3128e62b06a","Type":"ContainerDied","Data":"f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9"}
Jul 07 04:49:26.812725 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.812661    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j" event={"ID":"ce6a5d13-942a-49bc-a106-f3128e62b06a","Type":"ContainerDied","Data":"a9086e0156f3d86cf9969addd6ccead5e9a57d770700fdd6814b863283414648"}
Jul 07 04:49:26.812725 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.812683    2568 scope.go:117] "RemoveContainer" containerID="f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9"
Jul 07 04:49:26.821631 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.821613    2568 scope.go:117] "RemoveContainer" containerID="f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9"
Jul 07 04:49:26.821887 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:49:26.821859    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9\": container with ID starting with f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9 not found: ID does not exist" containerID="f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9"
Jul 07 04:49:26.821942 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.821895    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9"} err="failed to get container status \"f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9\": rpc error: code = NotFound desc = could not find container \"f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9\": container with ID starting with f39ffc503b520da15198ece2535bc3110b981d53abb37639916fcaccc703f7e9 not found: ID does not exist"
Jul 07 04:49:26.831980 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.831954    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"]
Jul 07 04:49:26.836571 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:26.836549    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-93ca8cbb-openshift-default-5b6b4bfc67-ftq6j"]
Jul 07 04:49:28.591982 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:49:28.591951    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6a5d13-942a-49bc-a106-f3128e62b06a" path="/var/lib/kubelet/pods/ce6a5d13-942a-49bc-a106-f3128e62b06a/volumes"
Jul 07 04:51:02.018034 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.017998    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"]
Jul 07 04:51:02.018506 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.018421    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053e9d52-78ea-499d-b4f5-980c90e870d1" containerName="istio-proxy"
Jul 07 04:51:02.018506 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.018434    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="053e9d52-78ea-499d-b4f5-980c90e870d1" containerName="istio-proxy"
Jul 07 04:51:02.018506 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.018453    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053e9d52-78ea-499d-b4f5-980c90e870d1" containerName="istio-proxy"
Jul 07 04:51:02.018506 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.018458    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="053e9d52-78ea-499d-b4f5-980c90e870d1" containerName="istio-proxy"
Jul 07 04:51:02.018506 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.018470    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6a5d13-942a-49bc-a106-f3128e62b06a" containerName="istio-proxy"
Jul 07 04:51:02.018506 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.018475    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6a5d13-942a-49bc-a106-f3128e62b06a" containerName="istio-proxy"
Jul 07 04:51:02.018704 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.018535    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="053e9d52-78ea-499d-b4f5-980c90e870d1" containerName="istio-proxy"
Jul 07 04:51:02.018704 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.018543    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6a5d13-942a-49bc-a106-f3128e62b06a" containerName="istio-proxy"
Jul 07 04:51:02.021404 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.021388    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.023937 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.023913    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dbd27213-openshift-default-dockercfg-x2fz8\""
Jul 07 04:51:02.044584 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.044548    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"]
Jul 07 04:51:02.127235 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.127199    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8dst\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-kube-api-access-k8dst\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.127444 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.127242    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-data\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.127444 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.127263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06b36cc2-3a61-4066-818d-c203b1579529-istio-podinfo\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.127444 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.127341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-envoy\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.127444 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.127430    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-certs\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.127599 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.127476    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-credential-socket\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.127599 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.127518    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06b36cc2-3a61-4066-818d-c203b1579529-istiod-ca-cert\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.127599 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.127553    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-istio-token\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.127599 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.127588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-socket\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.228804 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.228775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-certs\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.228978 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.228811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-credential-socket\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.228978 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.228869    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06b36cc2-3a61-4066-818d-c203b1579529-istiod-ca-cert\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.228978 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.228916    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-istio-token\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.228978 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.228950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-socket\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.229210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.228982    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8dst\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-kube-api-access-k8dst\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.229210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.229004    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-data\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.229210 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.229199    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-credential-socket\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.229395 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.229229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06b36cc2-3a61-4066-818d-c203b1579529-istio-podinfo\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.229395 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.229257    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-certs\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.229395 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.229284    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-envoy\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.229395 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.229368    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-data\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.229619 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.229409    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-socket\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.229677 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.229663    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06b36cc2-3a61-4066-818d-c203b1579529-istiod-ca-cert\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.231498 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.231476    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-envoy\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.231712 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.231694    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06b36cc2-3a61-4066-818d-c203b1579529-istio-podinfo\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.236640 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.236619    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8dst\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-kube-api-access-k8dst\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.236733 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.236654    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-istio-token\") pod \"e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") " pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.331452 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.331335    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:02.475901 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.475870    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"]
Jul 07 04:51:02.477847 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:51:02.477814    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b36cc2_3a61_4066_818d_c203b1579529.slice/crio-d4fc27fa51671847d597dd36c03d75df70d3fa157a9076ba9ef60b1321a192b6 WatchSource:0}: Error finding container d4fc27fa51671847d597dd36c03d75df70d3fa157a9076ba9ef60b1321a192b6: Status 404 returned error can't find the container with id d4fc27fa51671847d597dd36c03d75df70d3fa157a9076ba9ef60b1321a192b6
Jul 07 04:51:02.479931 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.479897    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:51:02.480024 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.479975    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:51:02.480088 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:02.480021    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:51:03.279339 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:03.279300    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" event={"ID":"06b36cc2-3a61-4066-818d-c203b1579529","Type":"ContainerStarted","Data":"d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0"}
Jul 07 04:51:03.279752 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:03.279378    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" event={"ID":"06b36cc2-3a61-4066-818d-c203b1579529","Type":"ContainerStarted","Data":"d4fc27fa51671847d597dd36c03d75df70d3fa157a9076ba9ef60b1321a192b6"}
Jul 07 04:51:03.301359 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:03.301309    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" podStartSLOduration=2.301289678 podStartE2EDuration="2.301289678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:51:03.299049498 +0000 UTC m=+1623.186588299" watchObservedRunningTime="2026-07-07 04:51:03.301289678 +0000 UTC m=+1623.188828480"
Jul 07 04:51:03.331960 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:03.331916    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:03.336394 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:03.336373    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:04.285342 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:04.285299    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:04.286192 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:04.286171    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:17.351931 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:17.351896    2568 generic.go:356] "Generic (PLEG): container finished" podID="06b36cc2-3a61-4066-818d-c203b1579529" containerID="d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0" exitCode=0
Jul 07 04:51:17.352321 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:17.351971    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" event={"ID":"06b36cc2-3a61-4066-818d-c203b1579529","Type":"ContainerDied","Data":"d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0"}
Jul 07 04:51:17.352427 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:17.352411    2568 scope.go:117] "RemoveContainer" containerID="d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0"
Jul 07 04:51:17.353426 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:17.353399    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:51:17.353482 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:17.353465    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:51:17.353541 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:17.353529    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:51:18.362644 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:18.362602    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" event={"ID":"06b36cc2-3a61-4066-818d-c203b1579529","Type":"ContainerStarted","Data":"7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3"}
Jul 07 04:51:19.286057 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:19.286023    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:19.332118 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:19.332085    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:19.333117 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:19.333091    2568 patch_prober.go:28] interesting pod/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 07 04:51:19.333225 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:19.333137    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 07 04:51:20.332689 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:20.332652    2568 patch_prober.go:28] interesting pod/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 07 04:51:20.333090 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:20.332719    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 07 04:51:21.331929 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:21.331890    2568 patch_prober.go:28] interesting pod/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 07 04:51:21.332111 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:21.331965    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 07 04:51:22.335975 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:22.335945    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:22.336964 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:22.336948    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:23.679552 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:23.679519    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"]
Jul 07 04:51:23.679973 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:23.679730    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy" containerID="cri-o://7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3" gracePeriod=30
Jul 07 04:51:28.927395 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.927371    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:28.988206 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988123    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-data\") pod \"06b36cc2-3a61-4066-818d-c203b1579529\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") "
Jul 07 04:51:28.988206 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988161    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-envoy\") pod \"06b36cc2-3a61-4066-818d-c203b1579529\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") "
Jul 07 04:51:28.988206 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988191    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-certs\") pod \"06b36cc2-3a61-4066-818d-c203b1579529\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") "
Jul 07 04:51:28.988489 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988229    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8dst\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-kube-api-access-k8dst\") pod \"06b36cc2-3a61-4066-818d-c203b1579529\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") "
Jul 07 04:51:28.988489 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988274    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-istio-token\") pod \"06b36cc2-3a61-4066-818d-c203b1579529\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") "
Jul 07 04:51:28.988489 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988319    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06b36cc2-3a61-4066-818d-c203b1579529-istio-podinfo\") pod \"06b36cc2-3a61-4066-818d-c203b1579529\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") "
Jul 07 04:51:28.988646 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988561    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06b36cc2-3a61-4066-818d-c203b1579529" (UID: "06b36cc2-3a61-4066-818d-c203b1579529"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:51:28.988646 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988565    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-socket\") pod \"06b36cc2-3a61-4066-818d-c203b1579529\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") "
Jul 07 04:51:28.988764 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988645    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06b36cc2-3a61-4066-818d-c203b1579529-istiod-ca-cert\") pod \"06b36cc2-3a61-4066-818d-c203b1579529\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") "
Jul 07 04:51:28.988764 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988734    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06b36cc2-3a61-4066-818d-c203b1579529" (UID: "06b36cc2-3a61-4066-818d-c203b1579529"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:51:28.988764 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988754    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-credential-socket\") pod \"06b36cc2-3a61-4066-818d-c203b1579529\" (UID: \"06b36cc2-3a61-4066-818d-c203b1579529\") "
Jul 07 04:51:28.989043 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.988997    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b36cc2-3a61-4066-818d-c203b1579529-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06b36cc2-3a61-4066-818d-c203b1579529" (UID: "06b36cc2-3a61-4066-818d-c203b1579529"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:51:28.989260 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.989111    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-data" (OuterVolumeSpecName: "istio-data") pod "06b36cc2-3a61-4066-818d-c203b1579529" (UID: "06b36cc2-3a61-4066-818d-c203b1579529"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:51:28.989260 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.989117    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:51:28.989260 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.989220    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06b36cc2-3a61-4066-818d-c203b1579529-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:51:28.989260 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.989221    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06b36cc2-3a61-4066-818d-c203b1579529" (UID: "06b36cc2-3a61-4066-818d-c203b1579529"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:51:28.989260 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.989236    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:51:28.990534 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.990509    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-istio-token" (OuterVolumeSpecName: "istio-token") pod "06b36cc2-3a61-4066-818d-c203b1579529" (UID: "06b36cc2-3a61-4066-818d-c203b1579529"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:51:28.990640 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.990565    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06b36cc2-3a61-4066-818d-c203b1579529-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06b36cc2-3a61-4066-818d-c203b1579529" (UID: "06b36cc2-3a61-4066-818d-c203b1579529"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 04:51:28.990926 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.990903    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06b36cc2-3a61-4066-818d-c203b1579529" (UID: "06b36cc2-3a61-4066-818d-c203b1579529"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:51:28.990973 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:28.990910    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-kube-api-access-k8dst" (OuterVolumeSpecName: "kube-api-access-k8dst") pod "06b36cc2-3a61-4066-818d-c203b1579529" (UID: "06b36cc2-3a61-4066-818d-c203b1579529"). InnerVolumeSpecName "kube-api-access-k8dst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:51:29.090466 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.090431    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:51:29.090466 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.090466    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:51:29.090664 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.090479    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8dst\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-kube-api-access-k8dst\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:51:29.090664 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.090489    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06b36cc2-3a61-4066-818d-c203b1579529-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:51:29.090664 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.090498    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06b36cc2-3a61-4066-818d-c203b1579529-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:51:29.090664 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.090506    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06b36cc2-3a61-4066-818d-c203b1579529-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:51:29.420626 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.420592    2568 generic.go:356] "Generic (PLEG): container finished" podID="06b36cc2-3a61-4066-818d-c203b1579529" containerID="7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3" exitCode=0
Jul 07 04:51:29.420828 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.420646    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"
Jul 07 04:51:29.420828 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.420674    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" event={"ID":"06b36cc2-3a61-4066-818d-c203b1579529","Type":"ContainerDied","Data":"7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3"}
Jul 07 04:51:29.420828 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.420738    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r" event={"ID":"06b36cc2-3a61-4066-818d-c203b1579529","Type":"ContainerDied","Data":"d4fc27fa51671847d597dd36c03d75df70d3fa157a9076ba9ef60b1321a192b6"}
Jul 07 04:51:29.420828 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.420770    2568 scope.go:117] "RemoveContainer" containerID="7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3"
Jul 07 04:51:29.429705 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.429686    2568 scope.go:117] "RemoveContainer" containerID="d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0"
Jul 07 04:51:29.437234 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.437215    2568 scope.go:117] "RemoveContainer" containerID="7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3"
Jul 07 04:51:29.437494 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:51:29.437477    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3\": container with ID starting with 7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3 not found: ID does not exist" containerID="7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3"
Jul 07 04:51:29.437556 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.437501    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3"} err="failed to get container status \"7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3\": rpc error: code = NotFound desc = could not find container \"7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3\": container with ID starting with 7e1a43f5c1ff51d6c96045f43fc9dc3440f94b94d9d463363260ba1402bbacf3 not found: ID does not exist"
Jul 07 04:51:29.437556 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.437519    2568 scope.go:117] "RemoveContainer" containerID="d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0"
Jul 07 04:51:29.437711 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:51:29.437695    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0\": container with ID starting with d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0 not found: ID does not exist" containerID="d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0"
Jul 07 04:51:29.437760 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.437716    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0"} err="failed to get container status \"d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0\": rpc error: code = NotFound desc = could not find container \"d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0\": container with ID starting with d21e603b932068dea9e3a8581fb20d3057f322c8e25f9afe12145a093dcc5ed0 not found: ID does not exist"
Jul 07 04:51:29.441553 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.441531    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"]
Jul 07 04:51:29.452061 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:29.446648    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dbd27213-openshift-default-65857d8b59-m9f4r"]
Jul 07 04:51:30.592945 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:30.592913    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06b36cc2-3a61-4066-818d-c203b1579529" path="/var/lib/kubelet/pods/06b36cc2-3a61-4066-818d-c203b1579529/volumes"
Jul 07 04:51:43.236526 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.236487    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"]
Jul 07 04:51:43.236975 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.236945    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy"
Jul 07 04:51:43.236975 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.236959    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy"
Jul 07 04:51:43.237048 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.237033    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy"
Jul 07 04:51:43.237048 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.237046    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="053e9d52-78ea-499d-b4f5-980c90e870d1" containerName="istio-proxy"
Jul 07 04:51:43.239154 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.239139    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.241962 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.241935    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-036fb253-openshift-default-dockercfg-5wbks\""
Jul 07 04:51:43.251449 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.251424    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"]
Jul 07 04:51:43.428304 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.428260    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83607a0-05b0-49af-8edf-5072da5cfc49-istiod-ca-cert\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.428304 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.428318    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-socket\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.428528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.428372    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-credential-socket\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.428528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.428395    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-envoy\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.428528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.428428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-podinfo\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.428528 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.428474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-data\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.428664 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.428591    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6flx\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-kube-api-access-h6flx\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.428664 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.428617    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-certs\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.428664 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.428637    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-token\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.529616 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.529525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-podinfo\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.529616 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.529575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-data\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.529847 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.529633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6flx\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-kube-api-access-h6flx\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.529847 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.529653    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-certs\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.529847 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.529671    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-token\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.529847 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.529702    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83607a0-05b0-49af-8edf-5072da5cfc49-istiod-ca-cert\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.529847 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.529744    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-socket\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.529847 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.529771    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-credential-socket\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.529847 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.529796    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-envoy\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.530214 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.530092    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-data\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.530214 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.530171    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-credential-socket\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.530323 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.530233    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-socket\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.530323 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.530312    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-certs\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.530544 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.530524    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83607a0-05b0-49af-8edf-5072da5cfc49-istiod-ca-cert\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.531979 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.531955    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-envoy\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.532083 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.532027    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-podinfo\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.540846 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.540825    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-token\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.541280 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.541262    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6flx\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-kube-api-access-h6flx\") pod \"e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") " pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.551179 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.551154    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:43.692063 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.692036    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"]
Jul 07 04:51:43.693835 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:51:43.693809    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83607a0_05b0_49af_8edf_5072da5cfc49.slice/crio-8c84406f22d5c30cab20cbfdc7b0e0d24e4619f34c3f2e8337adc1b8a0873a95 WatchSource:0}: Error finding container 8c84406f22d5c30cab20cbfdc7b0e0d24e4619f34c3f2e8337adc1b8a0873a95: Status 404 returned error can't find the container with id 8c84406f22d5c30cab20cbfdc7b0e0d24e4619f34c3f2e8337adc1b8a0873a95
Jul 07 04:51:43.695886 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.695854    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:51:43.695997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.695932    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:51:43.695997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:43.695973    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:51:44.492990 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:44.492952    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" event={"ID":"b83607a0-05b0-49af-8edf-5072da5cfc49","Type":"ContainerStarted","Data":"93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574"}
Jul 07 04:51:44.493370 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:44.493007    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" event={"ID":"b83607a0-05b0-49af-8edf-5072da5cfc49","Type":"ContainerStarted","Data":"8c84406f22d5c30cab20cbfdc7b0e0d24e4619f34c3f2e8337adc1b8a0873a95"}
Jul 07 04:51:44.528850 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:44.528805    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" podStartSLOduration=1.5287904650000002 podStartE2EDuration="1.528790465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:51:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:51:44.526985246 +0000 UTC m=+1664.414524048" watchObservedRunningTime="2026-07-07 04:51:44.528790465 +0000 UTC m=+1664.416329265"
Jul 07 04:51:44.551341 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:44.551308    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:44.556580 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:44.556555    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:45.498292 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:45.498249    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:51:45.499464 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:51:45.499446    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:52:00.216445 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:52:00.216404    2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83607a0_05b0_49af_8edf_5072da5cfc49.slice/crio-conmon-93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83607a0_05b0_49af_8edf_5072da5cfc49.slice/crio-93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574.scope\": RecentStats: unable to find data in memory cache]"
Jul 07 04:52:00.499736 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:00.499700    2568 patch_prober.go:28] interesting pod/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 07 04:52:00.499902 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:00.499765    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 07 04:52:00.578082 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:00.578051    2568 generic.go:356] "Generic (PLEG): container finished" podID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerID="93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574" exitCode=0
Jul 07 04:52:00.578252 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:00.578115    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" event={"ID":"b83607a0-05b0-49af-8edf-5072da5cfc49","Type":"ContainerDied","Data":"93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574"}
Jul 07 04:52:00.578569 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:00.578546    2568 scope.go:117] "RemoveContainer" containerID="93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574"
Jul 07 04:52:00.579458 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:00.579433    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:52:00.579522 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:00.579495    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:52:00.579570 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:00.579524    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:52:01.584843 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:01.584805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" event={"ID":"b83607a0-05b0-49af-8edf-5072da5cfc49","Type":"ContainerStarted","Data":"b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53"}
Jul 07 04:52:02.552429 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:02.552382    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:52:02.552712 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:02.552681    2568 patch_prober.go:28] interesting pod/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 07 04:52:02.552799 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:02.552741    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 07 04:52:03.551873 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:03.551832    2568 patch_prober.go:28] interesting pod/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 07 04:52:03.552395 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:03.551905    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 07 04:52:04.552462 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:04.552419    2568 patch_prober.go:28] interesting pod/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 07 04:52:04.553064 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:04.553028    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 07 04:52:05.555956 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:05.555923    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:52:05.556411 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:05.556223    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:52:05.556932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:52:05.556915    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:53:32.994830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:32.994796    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"]
Jul 07 04:53:32.995360 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:32.995008    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy" containerID="cri-o://b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53" gracePeriod=30
Jul 07 04:53:35.558976 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:35.558939    2568 patch_prober.go:28] interesting pod/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 04:53:35.559455 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:35.559013    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 04:53:38.255522 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.255460    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:53:38.438741 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.438702    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-data\") pod \"b83607a0-05b0-49af-8edf-5072da5cfc49\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") "
Jul 07 04:53:38.438939 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.438771    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-credential-socket\") pod \"b83607a0-05b0-49af-8edf-5072da5cfc49\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") "
Jul 07 04:53:38.438939 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.438806    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83607a0-05b0-49af-8edf-5072da5cfc49-istiod-ca-cert\") pod \"b83607a0-05b0-49af-8edf-5072da5cfc49\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") "
Jul 07 04:53:38.438939 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.438842    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-envoy\") pod \"b83607a0-05b0-49af-8edf-5072da5cfc49\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") "
Jul 07 04:53:38.438939 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.438861    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-socket\") pod \"b83607a0-05b0-49af-8edf-5072da5cfc49\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") "
Jul 07 04:53:38.438939 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.438889    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-token\") pod \"b83607a0-05b0-49af-8edf-5072da5cfc49\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") "
Jul 07 04:53:38.438939 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.438914    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-podinfo\") pod \"b83607a0-05b0-49af-8edf-5072da5cfc49\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") "
Jul 07 04:53:38.439282 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.438974    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-certs\") pod \"b83607a0-05b0-49af-8edf-5072da5cfc49\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") "
Jul 07 04:53:38.439282 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.439004    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6flx\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-kube-api-access-h6flx\") pod \"b83607a0-05b0-49af-8edf-5072da5cfc49\" (UID: \"b83607a0-05b0-49af-8edf-5072da5cfc49\") "
Jul 07 04:53:38.439632 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.439416    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b83607a0-05b0-49af-8edf-5072da5cfc49" (UID: "b83607a0-05b0-49af-8edf-5072da5cfc49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:53:38.439751 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.439675    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b83607a0-05b0-49af-8edf-5072da5cfc49" (UID: "b83607a0-05b0-49af-8edf-5072da5cfc49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:53:38.439751 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.439702    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b83607a0-05b0-49af-8edf-5072da5cfc49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b83607a0-05b0-49af-8edf-5072da5cfc49" (UID: "b83607a0-05b0-49af-8edf-5072da5cfc49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:53:38.439751 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.439716    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b83607a0-05b0-49af-8edf-5072da5cfc49" (UID: "b83607a0-05b0-49af-8edf-5072da5cfc49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:53:38.439949 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.439922    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-data" (OuterVolumeSpecName: "istio-data") pod "b83607a0-05b0-49af-8edf-5072da5cfc49" (UID: "b83607a0-05b0-49af-8edf-5072da5cfc49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:53:38.441364 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.441326    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b83607a0-05b0-49af-8edf-5072da5cfc49" (UID: "b83607a0-05b0-49af-8edf-5072da5cfc49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:53:38.441576 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.441552    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b83607a0-05b0-49af-8edf-5072da5cfc49" (UID: "b83607a0-05b0-49af-8edf-5072da5cfc49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 04:53:38.441675 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.441658    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-token" (OuterVolumeSpecName: "istio-token") pod "b83607a0-05b0-49af-8edf-5072da5cfc49" (UID: "b83607a0-05b0-49af-8edf-5072da5cfc49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:53:38.441867 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.441845    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-kube-api-access-h6flx" (OuterVolumeSpecName: "kube-api-access-h6flx") pod "b83607a0-05b0-49af-8edf-5072da5cfc49" (UID: "b83607a0-05b0-49af-8edf-5072da5cfc49"). InnerVolumeSpecName "kube-api-access-h6flx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:53:38.540244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.540154    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:53:38.540244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.540189    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6flx\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-kube-api-access-h6flx\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:53:38.540244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.540200    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:53:38.540244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.540208    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:53:38.540244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.540217    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b83607a0-05b0-49af-8edf-5072da5cfc49-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:53:38.540244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.540225    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:53:38.540244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.540233    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b83607a0-05b0-49af-8edf-5072da5cfc49-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:53:38.540244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.540240    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:53:38.540244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:38.540248    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b83607a0-05b0-49af-8edf-5072da5cfc49-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:53:39.063191 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.063154    2568 generic.go:356] "Generic (PLEG): container finished" podID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerID="b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53" exitCode=0
Jul 07 04:53:39.063385 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.063202    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"
Jul 07 04:53:39.063385 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.063205    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" event={"ID":"b83607a0-05b0-49af-8edf-5072da5cfc49","Type":"ContainerDied","Data":"b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53"}
Jul 07 04:53:39.063385 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.063329    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4" event={"ID":"b83607a0-05b0-49af-8edf-5072da5cfc49","Type":"ContainerDied","Data":"8c84406f22d5c30cab20cbfdc7b0e0d24e4619f34c3f2e8337adc1b8a0873a95"}
Jul 07 04:53:39.063385 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.063371    2568 scope.go:117] "RemoveContainer" containerID="b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53"
Jul 07 04:53:39.072202 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.072184    2568 scope.go:117] "RemoveContainer" containerID="93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574"
Jul 07 04:53:39.080391 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.080336    2568 scope.go:117] "RemoveContainer" containerID="b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53"
Jul 07 04:53:39.080638 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:53:39.080617    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53\": container with ID starting with b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53 not found: ID does not exist" containerID="b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53"
Jul 07 04:53:39.080694 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.080649    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53"} err="failed to get container status \"b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53\": rpc error: code = NotFound desc = could not find container \"b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53\": container with ID starting with b43ade5e669dad56502ceb51a79162e851a15a0ba1b8eb4fcb7ba2ab79d05a53 not found: ID does not exist"
Jul 07 04:53:39.080694 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.080666    2568 scope.go:117] "RemoveContainer" containerID="93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574"
Jul 07 04:53:39.080950 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:53:39.080932    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574\": container with ID starting with 93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574 not found: ID does not exist" containerID="93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574"
Jul 07 04:53:39.080995 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.080955    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574"} err="failed to get container status \"93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574\": rpc error: code = NotFound desc = could not find container \"93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574\": container with ID starting with 93d6ba0fda4513224cda40cbedf48c99834a298206ee2f556e115d23bac3e574 not found: ID does not exist"
Jul 07 04:53:39.082184 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.082164    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"]
Jul 07 04:53:39.085894 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:39.085861    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-036fb253-openshift-default-559d8cf6c-f9qd4"]
Jul 07 04:53:40.592363 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:53:40.592320    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" path="/var/lib/kubelet/pods/b83607a0-05b0-49af-8edf-5072da5cfc49/volumes"
Jul 07 04:54:00.666274 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:00.666246    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:54:00.666969 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:00.666950    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:54:27.488426 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.488383    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"]
Jul 07 04:54:27.489011 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.488989    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy"
Jul 07 04:54:27.489059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.489016    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy"
Jul 07 04:54:27.489059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.489027    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy"
Jul 07 04:54:27.489059 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.489037    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy"
Jul 07 04:54:27.489190 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.489177    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b36cc2-3a61-4066-818d-c203b1579529" containerName="istio-proxy"
Jul 07 04:54:27.489228 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.489193    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy"
Jul 07 04:54:27.489228 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.489203    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy"
Jul 07 04:54:27.491822 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.491797    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.494252 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.494223    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-94ebac-openshift-default-dockercfg-rgl4k\""
Jul 07 04:54:27.502640 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.502614    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"]
Jul 07 04:54:27.514098 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.514076    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-token\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.514298 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.514268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-credential-socket\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.514424 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.514318    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istiod-ca-cert\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.514424 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.514345    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-certs\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.514424 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.514394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-podinfo\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.514606 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.514455    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-envoy\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.514606 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.514483    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwgvf\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-kube-api-access-jwgvf\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.514606 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.514508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-data\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.514606 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.514533    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-socket\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.615488 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-token\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.615488 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-credential-socket\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.615744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615510    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istiod-ca-cert\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.615744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615535    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-certs\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.615744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615555    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-podinfo\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.615744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615581    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-envoy\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.615744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwgvf\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-kube-api-access-jwgvf\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.615744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615630    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-data\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.615744 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615663    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-socket\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.616121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.615947    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-credential-socket\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.616121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.616044    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-certs\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.616236 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.616156    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-socket\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.616236 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.616175    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-data\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.616345 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.616320    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istiod-ca-cert\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.617871 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.617850    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-envoy\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.618097 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.618080    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-podinfo\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.624242 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.624219    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwgvf\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-kube-api-access-jwgvf\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.624242 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.624239    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-token\") pod \"e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") " pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.802745 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.802655    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:27.941709 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.941684    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"]
Jul 07 04:54:27.944280 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:54:27.944251    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6af1b96_058d_4b5f_ade2_dbcbdb95eba8.slice/crio-01da88327c1127f56d47e5b31f7e18e604fd48b1bacbf073c0e6902de22e4ef3 WatchSource:0}: Error finding container 01da88327c1127f56d47e5b31f7e18e604fd48b1bacbf073c0e6902de22e4ef3: Status 404 returned error can't find the container with id 01da88327c1127f56d47e5b31f7e18e604fd48b1bacbf073c0e6902de22e4ef3
Jul 07 04:54:27.946463 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.946430    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:27.946570 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.946490    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:27.946570 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:27.946516    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:28.310537 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:28.310502    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" event={"ID":"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8","Type":"ContainerStarted","Data":"e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0"}
Jul 07 04:54:28.310729 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:28.310553    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" event={"ID":"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8","Type":"ContainerStarted","Data":"01da88327c1127f56d47e5b31f7e18e604fd48b1bacbf073c0e6902de22e4ef3"}
Jul 07 04:54:28.330547 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:28.330498    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" podStartSLOduration=1.330483218 podStartE2EDuration="1.330483218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:54:28.329297512 +0000 UTC m=+1828.216836313" watchObservedRunningTime="2026-07-07 04:54:28.330483218 +0000 UTC m=+1828.218022064"
Jul 07 04:54:28.803109 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:28.803074    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:29.808125 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:29.808093    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:30.321259 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:30.321216    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:30.323901 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:30.323876    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:35.373506 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.373472    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"]
Jul 07 04:54:35.374020 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.374001    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy"
Jul 07 04:54:35.374020 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.374021    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83607a0-05b0-49af-8edf-5072da5cfc49" containerName="istio-proxy"
Jul 07 04:54:35.376429 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.376408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.379418 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.379384    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ee0733-openshift-default-dockercfg-q297h\""
Jul 07 04:54:35.389181 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.389159    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"]
Jul 07 04:54:35.496303 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.496270    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-istio-token\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.496303 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.496307    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-envoy\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.496557 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.496327    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b82ae94-8545-421d-ac56-01db6da3425d-istio-podinfo\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.496557 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.496476    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-credential-socket\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.496557 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.496537    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b94r8\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-kube-api-access-b94r8\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.496671 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.496574    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-data\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.496671 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.496602    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-socket\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.496671 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.496623    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b82ae94-8545-421d-ac56-01db6da3425d-istiod-ca-cert\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.496671 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.496658    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-certs\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.597821 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.597785    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-data\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.597831    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-socket\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.597864    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b82ae94-8545-421d-ac56-01db6da3425d-istiod-ca-cert\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.597903    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-certs\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.597942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-istio-token\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.597957    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-envoy\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.597972    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b82ae94-8545-421d-ac56-01db6da3425d-istio-podinfo\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598031 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.598026    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-credential-socket\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598458 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.598074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b94r8\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-kube-api-access-b94r8\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598458 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.598339    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-socket\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598563 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.598466    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-certs\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598563 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.598501    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-data\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598563 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.598522    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-credential-socket\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.598707 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.598687    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b82ae94-8545-421d-ac56-01db6da3425d-istiod-ca-cert\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.600409 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.600380    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-envoy\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.600566 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.600550    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b82ae94-8545-421d-ac56-01db6da3425d-istio-podinfo\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.605522 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.605504    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-istio-token\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.605903 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.605871    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b94r8\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-kube-api-access-b94r8\") pod \"e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") " pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.688773 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.688737    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:35.832482 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.832455    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"]
Jul 07 04:54:35.833633 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:54:35.833609    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b82ae94_8545_421d_ac56_01db6da3425d.slice/crio-69a0ada2a8e4c607d84abb572e97c74f53343fddd6189b9523a74a5097b268b9 WatchSource:0}: Error finding container 69a0ada2a8e4c607d84abb572e97c74f53343fddd6189b9523a74a5097b268b9: Status 404 returned error can't find the container with id 69a0ada2a8e4c607d84abb572e97c74f53343fddd6189b9523a74a5097b268b9
Jul 07 04:54:35.835615 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.835583    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:35.835677 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.835649    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:35.835718 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:35.835675    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:36.351230 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:36.351192    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" event={"ID":"0b82ae94-8545-421d-ac56-01db6da3425d","Type":"ContainerStarted","Data":"3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe"}
Jul 07 04:54:36.351438 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:36.351256    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" event={"ID":"0b82ae94-8545-421d-ac56-01db6da3425d","Type":"ContainerStarted","Data":"69a0ada2a8e4c607d84abb572e97c74f53343fddd6189b9523a74a5097b268b9"}
Jul 07 04:54:36.371433 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:36.371381    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" podStartSLOduration=1.371338787 podStartE2EDuration="1.371338787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:54:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:54:36.370787281 +0000 UTC m=+1836.258326105" watchObservedRunningTime="2026-07-07 04:54:36.371338787 +0000 UTC m=+1836.258877585"
Jul 07 04:54:36.689309 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:36.689267    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:36.694264 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:36.694238    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:37.356236 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:37.356184    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:37.357029 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:37.357008    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:45.848812 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:45.848185    2568 patch_prober.go:28] interesting pod/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:56632->10.133.0.46:15021: read: connection reset by peer" start-of-body=
Jul 07 04:54:45.848812 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:45.848249    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:56632->10.133.0.46:15021: read: connection reset by peer"
Jul 07 04:54:46.407132 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:46.407097    2568 generic.go:356] "Generic (PLEG): container finished" podID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerID="e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0" exitCode=0
Jul 07 04:54:46.407541 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:46.407252    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" event={"ID":"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8","Type":"ContainerDied","Data":"e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0"}
Jul 07 04:54:46.408260 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:46.408231    2568 scope.go:117] "RemoveContainer" containerID="e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0"
Jul 07 04:54:46.409601 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:46.409564    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:46.409849 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:46.409824    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:46.410026 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:46.409996    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:47.415827 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:47.415792    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" event={"ID":"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8","Type":"ContainerStarted","Data":"82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e"}
Jul 07 04:54:47.803231 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:47.803139    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:47.803461 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:47.803439    2568 patch_prober.go:28] interesting pod/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 07 04:54:47.803556 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:47.803492    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 07 04:54:48.803080 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:48.803032    2568 patch_prober.go:28] interesting pod/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 07 04:54:48.803501 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:48.803099    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 07 04:54:49.803840 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:49.803796    2568 patch_prober.go:28] interesting pod/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 07 04:54:49.804340 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:49.803859    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 07 04:54:50.803626 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:50.803592    2568 patch_prober.go:28] interesting pod/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 07 04:54:50.803793 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:50.803648    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 07 04:54:51.803404 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:51.803366    2568 patch_prober.go:28] interesting pod/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 07 04:54:51.803860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:51.803421    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 07 04:54:52.807202 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:52.807173    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:52.807606 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:52.807445    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:52.808147 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:52.808131    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:54:53.397527 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:53.397489    2568 patch_prober.go:28] interesting pod/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 04:54:53.397678 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:53.397555    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 04:54:54.451190 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:54.451159    2568 generic.go:356] "Generic (PLEG): container finished" podID="0b82ae94-8545-421d-ac56-01db6da3425d" containerID="3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe" exitCode=0
Jul 07 04:54:54.451737 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:54.451239    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" event={"ID":"0b82ae94-8545-421d-ac56-01db6da3425d","Type":"ContainerDied","Data":"3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe"}
Jul 07 04:54:54.451809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:54.451733    2568 scope.go:117] "RemoveContainer" containerID="3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe"
Jul 07 04:54:54.452728 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:54.452703    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:54.452821 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:54.452766    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:54.452821 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:54.452799    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:54:55.464848 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:55.464804    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" event={"ID":"0b82ae94-8545-421d-ac56-01db6da3425d","Type":"ContainerStarted","Data":"f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152"}
Jul 07 04:54:55.689199 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:55.689160    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:55.689445 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:55.689420    2568 patch_prober.go:28] interesting pod/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 07 04:54:55.689527 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:55.689475    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 07 04:54:56.689838 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:56.689802    2568 patch_prober.go:28] interesting pod/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 07 04:54:56.690244 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:56.689856    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 07 04:54:57.689218 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:57.689179    2568 patch_prober.go:28] interesting pod/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 07 04:54:57.689431 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:57.689243    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 07 04:54:58.689419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:58.689380    2568 patch_prober.go:28] interesting pod/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 07 04:54:58.689825 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:58.689439    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 07 04:54:59.693509 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:59.693475    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:59.694017 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:59.693871    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:54:59.694712 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:54:59.694693    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:56:19.909381 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:19.909324    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"]
Jul 07 04:56:19.909954 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:19.909523    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy" containerID="cri-o://82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e" gracePeriod=30
Jul 07 04:56:22.809731 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:22.809689    2568 patch_prober.go:28] interesting pod/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 04:56:22.810193 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:22.809764    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 04:56:25.172326 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.172263    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:56:25.272929 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.272892    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwgvf\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-kube-api-access-jwgvf\") pod \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") "
Jul 07 04:56:25.273121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.272956    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-socket\") pod \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") "
Jul 07 04:56:25.273121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.272976    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istiod-ca-cert\") pod \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") "
Jul 07 04:56:25.273121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273095    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-data\") pod \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") "
Jul 07 04:56:25.273297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273160    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-token\") pod \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") "
Jul 07 04:56:25.273297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273204    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-certs\") pod \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") "
Jul 07 04:56:25.273297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273235    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-podinfo\") pod \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") "
Jul 07 04:56:25.273297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273246    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" (UID: "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:25.273297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273263    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-credential-socket\") pod \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") "
Jul 07 04:56:25.273581 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273312    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-envoy\") pod \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\" (UID: \"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8\") "
Jul 07 04:56:25.273581 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273374    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" (UID: "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:56:25.273581 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273511    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" (UID: "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:25.273746 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273628    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" (UID: "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:25.273801 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273764    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:25.273801 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273780    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:25.273801 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273796    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:25.273977 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273809    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:25.274014 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.273995    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" (UID: "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:25.275611 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.275588    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-kube-api-access-jwgvf" (OuterVolumeSpecName: "kube-api-access-jwgvf") pod "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" (UID: "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8"). InnerVolumeSpecName "kube-api-access-jwgvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:56:25.275731 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.275709    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" (UID: "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 04:56:25.275778 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.275711    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" (UID: "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:56:25.275861 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.275846    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" (UID: "d6af1b96-058d-4b5f-ade2-dbcbdb95eba8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:25.374360 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.374304    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:25.374360 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.374339    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:25.374360 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.374361    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwgvf\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-kube-api-access-jwgvf\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:25.374360 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.374370    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:25.374619 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.374379    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:25.914024 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.913990    2568 generic.go:356] "Generic (PLEG): container finished" podID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerID="82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e" exitCode=0
Jul 07 04:56:25.914214 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.914053    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"
Jul 07 04:56:25.914214 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.914069    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" event={"ID":"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8","Type":"ContainerDied","Data":"82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e"}
Jul 07 04:56:25.914214 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.914125    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2" event={"ID":"d6af1b96-058d-4b5f-ade2-dbcbdb95eba8","Type":"ContainerDied","Data":"01da88327c1127f56d47e5b31f7e18e604fd48b1bacbf073c0e6902de22e4ef3"}
Jul 07 04:56:25.914214 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.914150    2568 scope.go:117] "RemoveContainer" containerID="82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e"
Jul 07 04:56:25.923978 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.923962    2568 scope.go:117] "RemoveContainer" containerID="e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0"
Jul 07 04:56:25.934670 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.934627    2568 scope.go:117] "RemoveContainer" containerID="82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e"
Jul 07 04:56:25.934934 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:56:25.934911    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e\": container with ID starting with 82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e not found: ID does not exist" containerID="82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e"
Jul 07 04:56:25.935024 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.934942    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e"} err="failed to get container status \"82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e\": rpc error: code = NotFound desc = could not find container \"82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e\": container with ID starting with 82738bb3154797ed420b92d0a4e003c73a23f2a7ac09e62d9076d02a9e63394e not found: ID does not exist"
Jul 07 04:56:25.935024 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.934964    2568 scope.go:117] "RemoveContainer" containerID="e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0"
Jul 07 04:56:25.935192 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:56:25.935170    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0\": container with ID starting with e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0 not found: ID does not exist" containerID="e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0"
Jul 07 04:56:25.935253 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.935196    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0"} err="failed to get container status \"e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0\": rpc error: code = NotFound desc = could not find container \"e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0\": container with ID starting with e2b88e7336b21acb0fc322cc85da1ac6c7f8ff37b6cd876df5230a44cfc601b0 not found: ID does not exist"
Jul 07 04:56:25.937149 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.937129    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"]
Jul 07 04:56:25.942980 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:25.942955    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-94ebac-openshift-default-6bfff86d8f-ppjh2"]
Jul 07 04:56:26.591944 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:26.591913    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" path="/var/lib/kubelet/pods/d6af1b96-058d-4b5f-ade2-dbcbdb95eba8/volumes"
Jul 07 04:56:26.928106 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:26.928075    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"]
Jul 07 04:56:26.928310 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:26.928283    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy" containerID="cri-o://f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152" gracePeriod=30
Jul 07 04:56:27.818510 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.818478    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"]
Jul 07 04:56:27.818913 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.818856    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy"
Jul 07 04:56:27.818913 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.818870    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy"
Jul 07 04:56:27.818913 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.818901    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy"
Jul 07 04:56:27.818913 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.818910    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy"
Jul 07 04:56:27.819130 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.819014    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy"
Jul 07 04:56:27.819130 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.819025    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6af1b96-058d-4b5f-ade2-dbcbdb95eba8" containerName="istio-proxy"
Jul 07 04:56:27.823811 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.823791    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.826277 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.826260    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-073254-openshift-default-dockercfg-cdzvg\""
Jul 07 04:56:27.834374 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.834336    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"]
Jul 07 04:56:27.898678 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.898642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-istio-token\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.898854 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.898713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-socket\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.898854 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.898738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95add468-91a3-46db-96a5-4870f60e383a-istiod-ca-cert\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.898854 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.898766    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-certs\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.898854 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.898818    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-envoy\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.899070 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.898862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxnf\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-kube-api-access-ccxnf\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.899070 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.898982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-data\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.899070 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.899024    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95add468-91a3-46db-96a5-4870f60e383a-istio-podinfo\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.899213 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.899089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-credential-socket\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.999630 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.999600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-envoy\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.999848 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.999635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxnf\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-kube-api-access-ccxnf\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.999848 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.999677    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-data\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.999848 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.999699    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95add468-91a3-46db-96a5-4870f60e383a-istio-podinfo\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.999848 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.999726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-credential-socket\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:27.999848 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.999795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-istio-token\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.000103 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.999867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-socket\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.000103 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.999893    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95add468-91a3-46db-96a5-4870f60e383a-istiod-ca-cert\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.000103 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:27.999960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-certs\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.000253 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.000100    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-data\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.000253 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.000164    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-socket\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.000370 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.000326    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-credential-socket\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.000465 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.000449    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-certs\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.000671 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.000652    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95add468-91a3-46db-96a5-4870f60e383a-istiod-ca-cert\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.002194 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.002170    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-envoy\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.002289 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.002203    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95add468-91a3-46db-96a5-4870f60e383a-istio-podinfo\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.009215 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.009186    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-istio-token\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.009377 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.009327    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxnf\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-kube-api-access-ccxnf\") pod \"e2e-api-a-073254-openshift-default-6d85ffccc-s68h4\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") " pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.135102 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.135013    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:28.276000 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.275961    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"]
Jul 07 04:56:28.277247 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:56:28.277221    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95add468_91a3_46db_96a5_4870f60e383a.slice/crio-d95e27f111cb90185d3b2b5ee742a6bbaa8c904b56cfb7425b1df1d8ee371146 WatchSource:0}: Error finding container d95e27f111cb90185d3b2b5ee742a6bbaa8c904b56cfb7425b1df1d8ee371146: Status 404 returned error can't find the container with id d95e27f111cb90185d3b2b5ee742a6bbaa8c904b56cfb7425b1df1d8ee371146
Jul 07 04:56:28.279593 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.279560    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:28.279706 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.279629    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:28.279706 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.279663    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:28.933693 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.933657    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" event={"ID":"95add468-91a3-46db-96a5-4870f60e383a","Type":"ContainerStarted","Data":"8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938"}
Jul 07 04:56:28.934100 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.933718    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" event={"ID":"95add468-91a3-46db-96a5-4870f60e383a","Type":"ContainerStarted","Data":"d95e27f111cb90185d3b2b5ee742a6bbaa8c904b56cfb7425b1df1d8ee371146"}
Jul 07 04:56:28.956589 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:28.956535    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" podStartSLOduration=1.956517772 podStartE2EDuration="1.956517772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:56:28.955213573 +0000 UTC m=+1948.842752403" watchObservedRunningTime="2026-07-07 04:56:28.956517772 +0000 UTC m=+1948.844056574"
Jul 07 04:56:29.135658 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:29.135627    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:29.140452 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:29.140419    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:29.696748 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:29.696704    2568 patch_prober.go:28] interesting pod/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 04:56:29.696910 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:29.696762    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 04:56:29.942982 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:29.942503    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:29.943685 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:29.943665    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:32.181472 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.181447    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:56:32.241719 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.241628    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b82ae94-8545-421d-ac56-01db6da3425d-istiod-ca-cert\") pod \"0b82ae94-8545-421d-ac56-01db6da3425d\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") "
Jul 07 04:56:32.241719 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.241675    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-envoy\") pod \"0b82ae94-8545-421d-ac56-01db6da3425d\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") "
Jul 07 04:56:32.241719 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.241693    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-data\") pod \"0b82ae94-8545-421d-ac56-01db6da3425d\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") "
Jul 07 04:56:32.241997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.241737    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-certs\") pod \"0b82ae94-8545-421d-ac56-01db6da3425d\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") "
Jul 07 04:56:32.241997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.241772    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-credential-socket\") pod \"0b82ae94-8545-421d-ac56-01db6da3425d\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") "
Jul 07 04:56:32.241997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.241828    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b94r8\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-kube-api-access-b94r8\") pod \"0b82ae94-8545-421d-ac56-01db6da3425d\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") "
Jul 07 04:56:32.241997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.241853    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-istio-token\") pod \"0b82ae94-8545-421d-ac56-01db6da3425d\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") "
Jul 07 04:56:32.241997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.241902    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-socket\") pod \"0b82ae94-8545-421d-ac56-01db6da3425d\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") "
Jul 07 04:56:32.241997 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.241935    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b82ae94-8545-421d-ac56-01db6da3425d-istio-podinfo\") pod \"0b82ae94-8545-421d-ac56-01db6da3425d\" (UID: \"0b82ae94-8545-421d-ac56-01db6da3425d\") "
Jul 07 04:56:32.242299 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.242075    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b82ae94-8545-421d-ac56-01db6da3425d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b82ae94-8545-421d-ac56-01db6da3425d" (UID: "0b82ae94-8545-421d-ac56-01db6da3425d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:56:32.242299 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.242191    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b82ae94-8545-421d-ac56-01db6da3425d" (UID: "0b82ae94-8545-421d-ac56-01db6da3425d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:32.242299 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.242211    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b82ae94-8545-421d-ac56-01db6da3425d" (UID: "0b82ae94-8545-421d-ac56-01db6da3425d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:32.242595 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.242524    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b82ae94-8545-421d-ac56-01db6da3425d-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:32.242595 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.242551    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:32.242595 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.242566    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:32.242837 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.242603    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b82ae94-8545-421d-ac56-01db6da3425d" (UID: "0b82ae94-8545-421d-ac56-01db6da3425d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:32.242986 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.242901    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b82ae94-8545-421d-ac56-01db6da3425d" (UID: "0b82ae94-8545-421d-ac56-01db6da3425d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:32.244275 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.244245    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b82ae94-8545-421d-ac56-01db6da3425d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b82ae94-8545-421d-ac56-01db6da3425d" (UID: "0b82ae94-8545-421d-ac56-01db6da3425d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 04:56:32.244554 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.244531    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-kube-api-access-b94r8" (OuterVolumeSpecName: "kube-api-access-b94r8") pod "0b82ae94-8545-421d-ac56-01db6da3425d" (UID: "0b82ae94-8545-421d-ac56-01db6da3425d"). InnerVolumeSpecName "kube-api-access-b94r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:56:32.244706 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.244687    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b82ae94-8545-421d-ac56-01db6da3425d" (UID: "0b82ae94-8545-421d-ac56-01db6da3425d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:56:32.244914 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.244896    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b82ae94-8545-421d-ac56-01db6da3425d" (UID: "0b82ae94-8545-421d-ac56-01db6da3425d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:56:32.344060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.344023    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b94r8\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-kube-api-access-b94r8\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:32.344060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.344053    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b82ae94-8545-421d-ac56-01db6da3425d-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:32.344060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.344068    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:32.344297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.344080    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b82ae94-8545-421d-ac56-01db6da3425d-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:32.344297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.344092    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:32.344297 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.344102    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b82ae94-8545-421d-ac56-01db6da3425d-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:56:32.959469 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.959438    2568 generic.go:356] "Generic (PLEG): container finished" podID="0b82ae94-8545-421d-ac56-01db6da3425d" containerID="f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152" exitCode=0
Jul 07 04:56:32.959680 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.959492    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"
Jul 07 04:56:32.959680 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.959484    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" event={"ID":"0b82ae94-8545-421d-ac56-01db6da3425d","Type":"ContainerDied","Data":"f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152"}
Jul 07 04:56:32.959680 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.959624    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv" event={"ID":"0b82ae94-8545-421d-ac56-01db6da3425d","Type":"ContainerDied","Data":"69a0ada2a8e4c607d84abb572e97c74f53343fddd6189b9523a74a5097b268b9"}
Jul 07 04:56:32.959680 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.959649    2568 scope.go:117] "RemoveContainer" containerID="f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152"
Jul 07 04:56:32.968746 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.968729    2568 scope.go:117] "RemoveContainer" containerID="3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe"
Jul 07 04:56:32.976795 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.976775    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"]
Jul 07 04:56:32.976985 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.976969    2568 scope.go:117] "RemoveContainer" containerID="f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152"
Jul 07 04:56:32.977238 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:56:32.977220    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152\": container with ID starting with f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152 not found: ID does not exist" containerID="f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152"
Jul 07 04:56:32.977284 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.977245    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152"} err="failed to get container status \"f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152\": rpc error: code = NotFound desc = could not find container \"f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152\": container with ID starting with f25d9c47853c81a473baccd90ee68471c353c43d8546a4488bb80da8fef97152 not found: ID does not exist"
Jul 07 04:56:32.977284 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.977261    2568 scope.go:117] "RemoveContainer" containerID="3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe"
Jul 07 04:56:32.977506 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:56:32.977492    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe\": container with ID starting with 3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe not found: ID does not exist" containerID="3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe"
Jul 07 04:56:32.977558 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.977510    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe"} err="failed to get container status \"3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe\": rpc error: code = NotFound desc = could not find container \"3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe\": container with ID starting with 3f0de5e1bbb5248d86990f909e2aa1f00be9560c4a2aebfea15c41f0d2bfbefe not found: ID does not exist"
Jul 07 04:56:32.981096 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:32.981073    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ee0733-openshift-default-8cb969885-flmsv"]
Jul 07 04:56:34.591175 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:34.591143    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" path="/var/lib/kubelet/pods/0b82ae94-8545-421d-ac56-01db6da3425d/volumes"
Jul 07 04:56:36.089871 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.089830    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"]
Jul 07 04:56:36.090345 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.090275    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy"
Jul 07 04:56:36.090345 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.090291    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy"
Jul 07 04:56:36.090345 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.090316    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy"
Jul 07 04:56:36.090345 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.090322    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy"
Jul 07 04:56:36.090621 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.090418    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy"
Jul 07 04:56:36.090621 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.090428    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b82ae94-8545-421d-ac56-01db6da3425d" containerName="istio-proxy"
Jul 07 04:56:36.093747 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.093725    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.096266 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.096243    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-59dc16-openshift-default-dockercfg-9gn7z\""
Jul 07 04:56:36.106144 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.106121    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"]
Jul 07 04:56:36.187890 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.187840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-certs\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.187890 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.187897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8hs4\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-kube-api-access-h8hs4\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.188184 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.187939    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-socket\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.188184 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.187996    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-token\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.188184 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.188060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-data\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.188184 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.188091    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-credential-socket\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.188184 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.188119    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-envoy\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.188184 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.188142    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb6905-2f25-4fd6-ae69-f818f314e172-istiod-ca-cert\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.188184 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.188186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-podinfo\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289429 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289391    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8hs4\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-kube-api-access-h8hs4\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-socket\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-token\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289596 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-data\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289791 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-credential-socket\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289791 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289693    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-envoy\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289791 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289725    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb6905-2f25-4fd6-ae69-f818f314e172-istiod-ca-cert\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289791 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-podinfo\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289994 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-certs\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289994 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289924    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-socket\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.289994 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.289965    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-data\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.290152 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.290034    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-credential-socket\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.290249 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.290225    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-certs\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.290517 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.290491    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb6905-2f25-4fd6-ae69-f818f314e172-istiod-ca-cert\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.291958 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.291935    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-envoy\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.292298 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.292282    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-podinfo\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.299112 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.299085    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8hs4\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-kube-api-access-h8hs4\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.299335 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.299320    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-token\") pod \"e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") " pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.404949 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.404925    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:36.560260 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.560226    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"]
Jul 07 04:56:36.562047 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:56:36.562024    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5bb6905_2f25_4fd6_ae69_f818f314e172.slice/crio-de82a0c85103a93c37d5ef820d6f1773d96e14d27038aa95e29cf4122bc3502a WatchSource:0}: Error finding container de82a0c85103a93c37d5ef820d6f1773d96e14d27038aa95e29cf4122bc3502a: Status 404 returned error can't find the container with id de82a0c85103a93c37d5ef820d6f1773d96e14d27038aa95e29cf4122bc3502a
Jul 07 04:56:36.564722 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.564686    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:36.564802 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.564769    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:36.564842 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.564811    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:36.989869 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.989827    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" event={"ID":"c5bb6905-2f25-4fd6-ae69-f818f314e172","Type":"ContainerStarted","Data":"4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd"}
Jul 07 04:56:36.990044 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:36.989889    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" event={"ID":"c5bb6905-2f25-4fd6-ae69-f818f314e172","Type":"ContainerStarted","Data":"de82a0c85103a93c37d5ef820d6f1773d96e14d27038aa95e29cf4122bc3502a"}
Jul 07 04:56:37.011231 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:37.011185    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" podStartSLOduration=1.0111711859999999 podStartE2EDuration="1.011171186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:56:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:56:37.009935072 +0000 UTC m=+1956.897473875" watchObservedRunningTime="2026-07-07 04:56:37.011171186 +0000 UTC m=+1956.898709987"
Jul 07 04:56:37.405327 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:37.405291    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:37.406898 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:37.406867    2568 patch_prober.go:28] interesting pod/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 04:56:37.407039 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:37.406928    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 04:56:38.409957 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:38.409924    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:39.000491 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:39.000460    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:39.001532 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:39.001516    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:44.028480 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:44.028446    2568 generic.go:356] "Generic (PLEG): container finished" podID="95add468-91a3-46db-96a5-4870f60e383a" containerID="8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938" exitCode=0
Jul 07 04:56:44.028940 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:44.028494    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" event={"ID":"95add468-91a3-46db-96a5-4870f60e383a","Type":"ContainerDied","Data":"8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938"}
Jul 07 04:56:44.028940 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:44.028887    2568 scope.go:117] "RemoveContainer" containerID="8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938"
Jul 07 04:56:44.029907 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:44.029869    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:44.029978 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:44.029946    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:44.030021 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:44.029978    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:44.942749 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:44.942714    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:45.034987 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:45.034953    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" event={"ID":"95add468-91a3-46db-96a5-4870f60e383a","Type":"ContainerStarted","Data":"f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742"}
Jul 07 04:56:45.135663 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:45.135622    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:45.136630 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:45.136607    2568 patch_prober.go:28] interesting pod/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 04:56:45.136698 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:45.136653    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 04:56:46.135859 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:46.135820    2568 patch_prober.go:28] interesting pod/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 04:56:46.136241 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:46.135889    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 04:56:47.135696 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:47.135654    2568 patch_prober.go:28] interesting pod/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 04:56:47.135887 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:47.135720    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 04:56:48.136020 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:48.135976    2568 patch_prober.go:28] interesting pod/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 04:56:48.136542 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:48.136037    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 04:56:49.186391 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:49.186339    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:49.186866 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:49.186694    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:49.188017 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:49.187993    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:56:55.041566 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:55.041514    2568 patch_prober.go:28] interesting pod/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 04:56:55.042073 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:55.041620    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 04:56:56.104470 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:56.104439    2568 generic.go:356] "Generic (PLEG): container finished" podID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerID="4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd" exitCode=0
Jul 07 04:56:56.105027 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:56.104523    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" event={"ID":"c5bb6905-2f25-4fd6-ae69-f818f314e172","Type":"ContainerDied","Data":"4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd"}
Jul 07 04:56:56.105104 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:56.105029    2568 scope.go:117] "RemoveContainer" containerID="4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd"
Jul 07 04:56:56.106062 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:56.106033    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:56.106168 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:56.106098    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:56.106168 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:56.106128    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:56:57.112493 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:57.112456    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" event={"ID":"c5bb6905-2f25-4fd6-ae69-f818f314e172","Type":"ContainerStarted","Data":"3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768"}
Jul 07 04:56:57.405857 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:57.405821    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:56:57.406052 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:57.406023    2568 patch_prober.go:28] interesting pod/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 04:56:57.406107 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:57.406066    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 04:56:57.746430 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:57.745910    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"]
Jul 07 04:56:57.746430 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:57.746152    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy" containerID="cri-o://f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742" gracePeriod=30
Jul 07 04:56:58.405891 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:58.405849    2568 patch_prober.go:28] interesting pod/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 04:56:58.406288 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:58.405910    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 04:56:59.406311 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:59.406273    2568 patch_prober.go:28] interesting pod/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 04:56:59.406711 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:56:59.406329    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 04:57:00.406283 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:00.406247    2568 patch_prober.go:28] interesting pod/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 04:57:00.406491 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:00.406299    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 04:57:01.409265 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:01.409233    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:57:01.409659 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:01.409637    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:57:01.410221 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:01.410205    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:57:03.044431 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.044404    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:57:03.081780 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.081753    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-socket\") pod \"95add468-91a3-46db-96a5-4870f60e383a\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") "
Jul 07 04:57:03.081929 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.081793    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-data\") pod \"95add468-91a3-46db-96a5-4870f60e383a\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") "
Jul 07 04:57:03.081929 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.081814    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95add468-91a3-46db-96a5-4870f60e383a-istio-podinfo\") pod \"95add468-91a3-46db-96a5-4870f60e383a\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") "
Jul 07 04:57:03.081929 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.081829    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-credential-socket\") pod \"95add468-91a3-46db-96a5-4870f60e383a\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") "
Jul 07 04:57:03.081929 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.081870    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-certs\") pod \"95add468-91a3-46db-96a5-4870f60e383a\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") "
Jul 07 04:57:03.081929 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.081909    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccxnf\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-kube-api-access-ccxnf\") pod \"95add468-91a3-46db-96a5-4870f60e383a\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") "
Jul 07 04:57:03.082198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.081965    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95add468-91a3-46db-96a5-4870f60e383a-istiod-ca-cert\") pod \"95add468-91a3-46db-96a5-4870f60e383a\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") "
Jul 07 04:57:03.082198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.081988    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-envoy\") pod \"95add468-91a3-46db-96a5-4870f60e383a\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") "
Jul 07 04:57:03.082198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.082021    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-istio-token\") pod \"95add468-91a3-46db-96a5-4870f60e383a\" (UID: \"95add468-91a3-46db-96a5-4870f60e383a\") "
Jul 07 04:57:03.082198 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.082104    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95add468-91a3-46db-96a5-4870f60e383a" (UID: "95add468-91a3-46db-96a5-4870f60e383a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:03.082446 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.082322    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95add468-91a3-46db-96a5-4870f60e383a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95add468-91a3-46db-96a5-4870f60e383a" (UID: "95add468-91a3-46db-96a5-4870f60e383a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:57:03.082446 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.082342    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:03.082634 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.082594    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95add468-91a3-46db-96a5-4870f60e383a" (UID: "95add468-91a3-46db-96a5-4870f60e383a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:03.082753 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.082675    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-data" (OuterVolumeSpecName: "istio-data") pod "95add468-91a3-46db-96a5-4870f60e383a" (UID: "95add468-91a3-46db-96a5-4870f60e383a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:03.082753 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.082669    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95add468-91a3-46db-96a5-4870f60e383a" (UID: "95add468-91a3-46db-96a5-4870f60e383a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:03.084615 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.084583    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95add468-91a3-46db-96a5-4870f60e383a" (UID: "95add468-91a3-46db-96a5-4870f60e383a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:03.084705 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.084667    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-istio-token" (OuterVolumeSpecName: "istio-token") pod "95add468-91a3-46db-96a5-4870f60e383a" (UID: "95add468-91a3-46db-96a5-4870f60e383a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:57:03.084705 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.084670    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95add468-91a3-46db-96a5-4870f60e383a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95add468-91a3-46db-96a5-4870f60e383a" (UID: "95add468-91a3-46db-96a5-4870f60e383a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 04:57:03.085055 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.085029    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-kube-api-access-ccxnf" (OuterVolumeSpecName: "kube-api-access-ccxnf") pod "95add468-91a3-46db-96a5-4870f60e383a" (UID: "95add468-91a3-46db-96a5-4870f60e383a"). InnerVolumeSpecName "kube-api-access-ccxnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:57:03.143762 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.143733    2568 generic.go:356] "Generic (PLEG): container finished" podID="95add468-91a3-46db-96a5-4870f60e383a" containerID="f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742" exitCode=0
Jul 07 04:57:03.143910 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.143781    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"
Jul 07 04:57:03.143910 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.143819    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" event={"ID":"95add468-91a3-46db-96a5-4870f60e383a","Type":"ContainerDied","Data":"f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742"}
Jul 07 04:57:03.143910 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.143870    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4" event={"ID":"95add468-91a3-46db-96a5-4870f60e383a","Type":"ContainerDied","Data":"d95e27f111cb90185d3b2b5ee742a6bbaa8c904b56cfb7425b1df1d8ee371146"}
Jul 07 04:57:03.143910 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.143892    2568 scope.go:117] "RemoveContainer" containerID="f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742"
Jul 07 04:57:03.153333 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.153308    2568 scope.go:117] "RemoveContainer" containerID="8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938"
Jul 07 04:57:03.160826 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.160807    2568 scope.go:117] "RemoveContainer" containerID="f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742"
Jul 07 04:57:03.161114 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:57:03.161097    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742\": container with ID starting with f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742 not found: ID does not exist" containerID="f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742"
Jul 07 04:57:03.161156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.161125    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742"} err="failed to get container status \"f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742\": rpc error: code = NotFound desc = could not find container \"f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742\": container with ID starting with f5bfb3f4c19f2916d58ba6acabfc0b48b9e65498915fc66588d8ec3fe2929742 not found: ID does not exist"
Jul 07 04:57:03.161156 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.161141    2568 scope.go:117] "RemoveContainer" containerID="8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938"
Jul 07 04:57:03.161396 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:57:03.161376    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938\": container with ID starting with 8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938 not found: ID does not exist" containerID="8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938"
Jul 07 04:57:03.161461 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.161399    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938"} err="failed to get container status \"8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938\": rpc error: code = NotFound desc = could not find container \"8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938\": container with ID starting with 8a013d06d265277564efc65764e70ca3cd6fa11843e3f93b92d80a4ed95ea938 not found: ID does not exist"
Jul 07 04:57:03.166406 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.166386    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"]
Jul 07 04:57:03.172004 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.171984    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-073254-openshift-default-6d85ffccc-s68h4"]
Jul 07 04:57:03.183659 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.183632    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95add468-91a3-46db-96a5-4870f60e383a-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:03.183659 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.183659    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:03.183777 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.183671    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:03.183777 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.183683    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:03.183777 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.183697    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95add468-91a3-46db-96a5-4870f60e383a-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:03.183777 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.183710    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:03.183777 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.183727    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95add468-91a3-46db-96a5-4870f60e383a-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:03.183777 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:03.183741    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccxnf\" (UniqueName: \"kubernetes.io/projected/95add468-91a3-46db-96a5-4870f60e383a-kube-api-access-ccxnf\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:04.594340 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:04.594302    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95add468-91a3-46db-96a5-4870f60e383a" path="/var/lib/kubelet/pods/95add468-91a3-46db-96a5-4870f60e383a/volumes"
Jul 07 04:57:04.594715 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:04.594681    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"]
Jul 07 04:57:04.594860 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:04.594842    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy" containerID="cri-o://3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768" gracePeriod=30
Jul 07 04:57:05.447478 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.447444    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"]
Jul 07 04:57:05.447990 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.447964    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy"
Jul 07 04:57:05.448179 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.448157    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy"
Jul 07 04:57:05.448344 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.448332    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy"
Jul 07 04:57:05.451859 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.451841    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.454254 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.454238    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-41807c-openshift-default-dockercfg-frpcj\""
Jul 07 04:57:05.464820 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.463033    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"]
Jul 07 04:57:05.504664 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.504640    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-certs\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.504783 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.504670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/337965a2-7246-4717-8910-6c5322245eba-istiod-ca-cert\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.504783 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.504694    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/337965a2-7246-4717-8910-6c5322245eba-istio-podinfo\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.504861 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.504794    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj46m\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-kube-api-access-lj46m\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.504861 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.504826    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-credential-socket\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.504861 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.504844    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-istio-token\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.504955 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.504863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-envoy\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.504955 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.504918    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-data\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.505018 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.504972    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-socket\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.606376 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606331    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-certs\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.606376 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606378    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/337965a2-7246-4717-8910-6c5322245eba-istiod-ca-cert\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.606889 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/337965a2-7246-4717-8910-6c5322245eba-istio-podinfo\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.606889 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606455    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj46m\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-kube-api-access-lj46m\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.606889 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-credential-socket\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.606889 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606506    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-istio-token\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.606889 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606553    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-envoy\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.606889 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606790    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-certs\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.606889 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606863    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-credential-socket\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.607246 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.606943    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-data\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.607246 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.607019    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-socket\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.607246 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.607145    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/337965a2-7246-4717-8910-6c5322245eba-istiod-ca-cert\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.607419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.607251    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-data\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.607419 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.607337    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-socket\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.608865 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.608842    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-envoy\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.608988 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.608972    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/337965a2-7246-4717-8910-6c5322245eba-istio-podinfo\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.615004 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.614978    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-istio-token\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.615148 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.615131    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj46m\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-kube-api-access-lj46m\") pod \"e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") " pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.763021 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.762946    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:05.901022 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.900987    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"]
Jul 07 04:57:05.904257 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:57:05.904218    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337965a2_7246_4717_8910_6c5322245eba.slice/crio-6c8e61891af8160121728e411537625581eb0d147bb40f4bd8d1e7cb379fad45 WatchSource:0}: Error finding container 6c8e61891af8160121728e411537625581eb0d147bb40f4bd8d1e7cb379fad45: Status 404 returned error can't find the container with id 6c8e61891af8160121728e411537625581eb0d147bb40f4bd8d1e7cb379fad45
Jul 07 04:57:05.906508 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.906478    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:05.906589 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.906546    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:05.906589 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:05.906574    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:06.161045 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:06.161000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" event={"ID":"337965a2-7246-4717-8910-6c5322245eba","Type":"ContainerStarted","Data":"ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90"}
Jul 07 04:57:06.161213 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:06.161058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" event={"ID":"337965a2-7246-4717-8910-6c5322245eba","Type":"ContainerStarted","Data":"6c8e61891af8160121728e411537625581eb0d147bb40f4bd8d1e7cb379fad45"}
Jul 07 04:57:06.180915 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:06.180866    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" podStartSLOduration=1.180851202 podStartE2EDuration="1.180851202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:57:06.179146494 +0000 UTC m=+1986.066685296" watchObservedRunningTime="2026-07-07 04:57:06.180851202 +0000 UTC m=+1986.068390002"
Jul 07 04:57:06.763291 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:06.763261    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:06.768422 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:06.768399    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:07.165459 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:07.165427    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:07.166395 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:07.166374    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:09.855677 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.855615    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:57:09.952872 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.952826    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb6905-2f25-4fd6-ae69-f818f314e172-istiod-ca-cert\") pod \"c5bb6905-2f25-4fd6-ae69-f818f314e172\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") "
Jul 07 04:57:09.952872 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.952876    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-envoy\") pod \"c5bb6905-2f25-4fd6-ae69-f818f314e172\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") "
Jul 07 04:57:09.953078 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.952913    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-credential-socket\") pod \"c5bb6905-2f25-4fd6-ae69-f818f314e172\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") "
Jul 07 04:57:09.953078 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.952939    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8hs4\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-kube-api-access-h8hs4\") pod \"c5bb6905-2f25-4fd6-ae69-f818f314e172\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") "
Jul 07 04:57:09.953078 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953001    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-podinfo\") pod \"c5bb6905-2f25-4fd6-ae69-f818f314e172\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") "
Jul 07 04:57:09.953078 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953036    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-token\") pod \"c5bb6905-2f25-4fd6-ae69-f818f314e172\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") "
Jul 07 04:57:09.953078 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953056    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-data\") pod \"c5bb6905-2f25-4fd6-ae69-f818f314e172\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") "
Jul 07 04:57:09.953328 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953110    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-certs\") pod \"c5bb6905-2f25-4fd6-ae69-f818f314e172\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") "
Jul 07 04:57:09.953328 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953162    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-socket\") pod \"c5bb6905-2f25-4fd6-ae69-f818f314e172\" (UID: \"c5bb6905-2f25-4fd6-ae69-f818f314e172\") "
Jul 07 04:57:09.953328 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953278    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5bb6905-2f25-4fd6-ae69-f818f314e172" (UID: "c5bb6905-2f25-4fd6-ae69-f818f314e172"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:09.953532 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953506    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5bb6905-2f25-4fd6-ae69-f818f314e172" (UID: "c5bb6905-2f25-4fd6-ae69-f818f314e172"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:09.953532 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953283    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5bb6905-2f25-4fd6-ae69-f818f314e172-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5bb6905-2f25-4fd6-ae69-f818f314e172" (UID: "c5bb6905-2f25-4fd6-ae69-f818f314e172"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 04:57:09.953641 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953593    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5bb6905-2f25-4fd6-ae69-f818f314e172" (UID: "c5bb6905-2f25-4fd6-ae69-f818f314e172"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:09.953707 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953691    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:09.953769 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953710    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:09.953769 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953725    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:09.953769 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.953737    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5bb6905-2f25-4fd6-ae69-f818f314e172-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:09.954152 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.954129    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5bb6905-2f25-4fd6-ae69-f818f314e172" (UID: "c5bb6905-2f25-4fd6-ae69-f818f314e172"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:09.955240 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.955216    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5bb6905-2f25-4fd6-ae69-f818f314e172" (UID: "c5bb6905-2f25-4fd6-ae69-f818f314e172"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:57:09.955340 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.955257    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5bb6905-2f25-4fd6-ae69-f818f314e172" (UID: "c5bb6905-2f25-4fd6-ae69-f818f314e172"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 04:57:09.955340 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.955267    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-kube-api-access-h8hs4" (OuterVolumeSpecName: "kube-api-access-h8hs4") pod "c5bb6905-2f25-4fd6-ae69-f818f314e172" (UID: "c5bb6905-2f25-4fd6-ae69-f818f314e172"). InnerVolumeSpecName "kube-api-access-h8hs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 04:57:09.955478 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:09.955463    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5bb6905-2f25-4fd6-ae69-f818f314e172" (UID: "c5bb6905-2f25-4fd6-ae69-f818f314e172"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 04:57:10.054448 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.054410    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:10.054448 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.054444    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8hs4\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-kube-api-access-h8hs4\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:10.054635 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.054459    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:10.054635 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.054473    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:10.054635 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.054486    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5bb6905-2f25-4fd6-ae69-f818f314e172-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 04:57:10.180967 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.180934    2568 generic.go:356] "Generic (PLEG): container finished" podID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerID="3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768" exitCode=0
Jul 07 04:57:10.181121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.180990    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"
Jul 07 04:57:10.181121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.181023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" event={"ID":"c5bb6905-2f25-4fd6-ae69-f818f314e172","Type":"ContainerDied","Data":"3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768"}
Jul 07 04:57:10.181121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.181075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t" event={"ID":"c5bb6905-2f25-4fd6-ae69-f818f314e172","Type":"ContainerDied","Data":"de82a0c85103a93c37d5ef820d6f1773d96e14d27038aa95e29cf4122bc3502a"}
Jul 07 04:57:10.181121 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.181099    2568 scope.go:117] "RemoveContainer" containerID="3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768"
Jul 07 04:57:10.190187 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.190170    2568 scope.go:117] "RemoveContainer" containerID="4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd"
Jul 07 04:57:10.197551 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.197533    2568 scope.go:117] "RemoveContainer" containerID="3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768"
Jul 07 04:57:10.197792 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:57:10.197774    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768\": container with ID starting with 3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768 not found: ID does not exist" containerID="3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768"
Jul 07 04:57:10.197844 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.197801    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768"} err="failed to get container status \"3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768\": rpc error: code = NotFound desc = could not find container \"3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768\": container with ID starting with 3e80c104b0729649a15774b8c4b5add894ae0ab9cf6cafb48f6a798f5ad37768 not found: ID does not exist"
Jul 07 04:57:10.197844 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.197817    2568 scope.go:117] "RemoveContainer" containerID="4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd"
Jul 07 04:57:10.198060 ip-10-0-128-250 kubenswrapper[2568]: E0707 04:57:10.198044    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd\": container with ID starting with 4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd not found: ID does not exist" containerID="4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd"
Jul 07 04:57:10.198105 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.198066    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd"} err="failed to get container status \"4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd\": rpc error: code = NotFound desc = could not find container \"4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd\": container with ID starting with 4d26079f589a5b1f5ef0bfbcb4f15786c02f554302501cdb7e1caed5cbd972fd not found: ID does not exist"
Jul 07 04:57:10.206387 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.205013    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"]
Jul 07 04:57:10.212714 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.212209    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-59dc16-openshift-default-65d58d9c77-6rv9t"]
Jul 07 04:57:10.591300 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:10.591226    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" path="/var/lib/kubelet/pods/c5bb6905-2f25-4fd6-ae69-f818f314e172/volumes"
Jul 07 04:57:13.177249 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177208    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"]
Jul 07 04:57:13.177700 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177637    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy"
Jul 07 04:57:13.177700 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177650    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy"
Jul 07 04:57:13.177700 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177663    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy"
Jul 07 04:57:13.177700 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177669    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy"
Jul 07 04:57:13.177700 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177676    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy"
Jul 07 04:57:13.177700 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177681    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy"
Jul 07 04:57:13.177977 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177738    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy"
Jul 07 04:57:13.177977 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177746    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="95add468-91a3-46db-96a5-4870f60e383a" containerName="istio-proxy"
Jul 07 04:57:13.177977 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.177751    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5bb6905-2f25-4fd6-ae69-f818f314e172" containerName="istio-proxy"
Jul 07 04:57:13.182575 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.182555    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.185060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.185036    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5a77f6-openshift-default-dockercfg-2k8fs\""
Jul 07 04:57:13.192643 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.192387    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"]
Jul 07 04:57:13.283444 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.283407    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-token\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.283646 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.283459    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-credential-socket\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.283646 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.283490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istiod-ca-cert\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.283817 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.283662    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-podinfo\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.283817 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.283710    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97cgv\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-kube-api-access-97cgv\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.283817 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.283788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-envoy\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.283979 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.283843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-data\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.283979 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.283934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-socket\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.283979 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.283965    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-certs\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.385309 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385270    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-certs\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.385517 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-token\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.385517 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-credential-socket\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.385517 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385409    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istiod-ca-cert\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.385517 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385497    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-podinfo\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.385751 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97cgv\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-kube-api-access-97cgv\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.385812 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-envoy\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.385880 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-data\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.385880 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-socket\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.386013 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.385692    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-certs\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.386147 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.386124    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istiod-ca-cert\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.386251 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.386221    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-socket\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.386382 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.386261    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-credential-socket\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.386382 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.386281    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-data\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.388003 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.387978    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-envoy\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.388096 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.388024    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-podinfo\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.393622 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.393597    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97cgv\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-kube-api-access-97cgv\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.393834 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.393810    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-token\") pod \"e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") " pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.495066 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.494982    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:13.637484 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.637458    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"]
Jul 07 04:57:13.639581 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:57:13.639555    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9dbeed_dfbb_4576_9f9c_c384cf87fab3.slice/crio-a1aee5bc2e1a15ea610f3547bc3ffedd58ce6fdedb411c0bc097de9f6d8cab9c WatchSource:0}: Error finding container a1aee5bc2e1a15ea610f3547bc3ffedd58ce6fdedb411c0bc097de9f6d8cab9c: Status 404 returned error can't find the container with id a1aee5bc2e1a15ea610f3547bc3ffedd58ce6fdedb411c0bc097de9f6d8cab9c
Jul 07 04:57:13.641913 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.641880    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:13.642012 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.641948    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:13.642012 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:13.641976    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:14.203030 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:14.202991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" event={"ID":"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3","Type":"ContainerStarted","Data":"5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7"}
Jul 07 04:57:14.203529 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:14.203061    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" event={"ID":"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3","Type":"ContainerStarted","Data":"a1aee5bc2e1a15ea610f3547bc3ffedd58ce6fdedb411c0bc097de9f6d8cab9c"}
Jul 07 04:57:14.223738 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:14.223694    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" podStartSLOduration=1.223681442 podStartE2EDuration="1.223681442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:57:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:57:14.221493613 +0000 UTC m=+1994.109032415" watchObservedRunningTime="2026-07-07 04:57:14.223681442 +0000 UTC m=+1994.111220243"
Jul 07 04:57:14.495830 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:14.495732    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:14.500637 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:14.500612    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:15.208219 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:15.208182    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:15.209063 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:15.209045    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:23.208522 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:23.208488    2568 patch_prober.go:28] interesting pod/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 04:57:23.210735 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:23.208550    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 04:57:24.263233 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:24.263191    2568 generic.go:356] "Generic (PLEG): container finished" podID="337965a2-7246-4717-8910-6c5322245eba" containerID="ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90" exitCode=0
Jul 07 04:57:24.263753 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:24.263284    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" event={"ID":"337965a2-7246-4717-8910-6c5322245eba","Type":"ContainerDied","Data":"ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90"}
Jul 07 04:57:24.263853 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:24.263829    2568 scope.go:117] "RemoveContainer" containerID="ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90"
Jul 07 04:57:24.265523 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:24.265481    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:24.265636 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:24.265585    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:24.265636 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:24.265629    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:25.274216 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:25.274182    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" event={"ID":"337965a2-7246-4717-8910-6c5322245eba","Type":"ContainerStarted","Data":"2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe"}
Jul 07 04:57:25.763848 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:25.763804    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:25.764079 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:25.763938    2568 patch_prober.go:28] interesting pod/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 07 04:57:25.764079 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:25.763981    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 07 04:57:26.764342 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:26.764299    2568 patch_prober.go:28] interesting pod/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 07 04:57:26.765055 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:26.765020    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 07 04:57:27.765375 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:27.764008    2568 patch_prober.go:28] interesting pod/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 07 04:57:27.765375 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:27.764070    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 07 04:57:28.764087 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:28.763602    2568 patch_prober.go:28] interesting pod/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 07 04:57:28.764087 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:28.763670    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 07 04:57:29.768117 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:29.768085    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:29.768617 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:29.768469    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:29.769334 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:29.769312    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 04:57:31.249533 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:31.249487    2568 patch_prober.go:28] interesting pod/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 04:57:31.250877 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:31.249566    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 04:57:31.312809 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:31.312783    2568 generic.go:356] "Generic (PLEG): container finished" podID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerID="5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7" exitCode=0
Jul 07 04:57:31.312932 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:31.312854    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" event={"ID":"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3","Type":"ContainerDied","Data":"5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7"}
Jul 07 04:57:31.313469 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:31.313450    2568 scope.go:117] "RemoveContainer" containerID="5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7"
Jul 07 04:57:31.314723 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:31.314690    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:31.314818 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:31.314776    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:31.314818 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:31.314813    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 04:57:32.326624 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:32.326467    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" event={"ID":"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3","Type":"ContainerStarted","Data":"fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc"}
Jul 07 04:57:32.495509 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:32.495476    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:32.495743 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:32.495708    2568 patch_prober.go:28] interesting pod/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 07 04:57:32.495801 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:32.495759    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 07 04:57:33.496189 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:33.496156    2568 patch_prober.go:28] interesting pod/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 07 04:57:33.496594 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:33.496206    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 07 04:57:34.495697 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:34.495656    2568 patch_prober.go:28] interesting pod/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 07 04:57:34.495870 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:34.495713    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 07 04:57:35.496019 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:35.495980    2568 patch_prober.go:28] interesting pod/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 07 04:57:35.496506 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:35.496039    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 07 04:57:36.499301 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:36.499270    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:36.499722 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:36.499537    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:36.500188 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:36.500169    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 04:57:55.290819 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.290785    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"]
Jul 07 04:57:55.294517 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.294500    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.297928 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.297900    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5a77f6\"/\"default-dockercfg-2nv8p\""
Jul 07 04:57:55.298060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.297907    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5a77f6\"/\"openshift-service-ca.crt\""
Jul 07 04:57:55.298060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.297911    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5a77f6\"/\"kube-root-ca.crt\""
Jul 07 04:57:55.298060 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.297929    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5a77f6\"/\"auth-test-model-5a77f6-kserve-self-signed-certs\""
Jul 07 04:57:55.301166 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.301140    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"]
Jul 07 04:57:55.396748 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.396713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-home\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.396938 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.396754    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tls-certs\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.396938 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.396884    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-dshm\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.397041 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.396964    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tmp-dir\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.397041 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.396985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rp8p\" (UniqueName: \"kubernetes.io/projected/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-kube-api-access-8rp8p\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.397041 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.397007    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-model-cache\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.497994 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.497961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-dshm\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.498238 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.498034    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tmp-dir\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.498238 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.498062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rp8p\" (UniqueName: \"kubernetes.io/projected/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-kube-api-access-8rp8p\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.498238 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.498093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-model-cache\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.498238 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.498156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-home\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.498238 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.498180    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tls-certs\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.498558 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.498527    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tmp-dir\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.498622 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.498597    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-home\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.498666 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.498622    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-model-cache\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.500329 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.500301    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-dshm\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.500515 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.500499    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tls-certs\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.506420 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.506400    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rp8p\" (UniqueName: \"kubernetes.io/projected/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-kube-api-access-8rp8p\") pod \"auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") " pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.606154 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.606076    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:57:55.736780 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:55.736754    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"]
Jul 07 04:57:55.739112 ip-10-0-128-250 kubenswrapper[2568]: W0707 04:57:55.739075    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadf5d273_cd0b_4c8e_8293_2a0a882b2c55.slice/crio-68c0bb6862a77947a3b68dc4fc5302764273986418155338b1767e3849f82cd1 WatchSource:0}: Error finding container 68c0bb6862a77947a3b68dc4fc5302764273986418155338b1767e3849f82cd1: Status 404 returned error can't find the container with id 68c0bb6862a77947a3b68dc4fc5302764273986418155338b1767e3849f82cd1
Jul 07 04:57:56.448964 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:56.448927    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx" event={"ID":"adf5d273-cd0b-4c8e-8293-2a0a882b2c55","Type":"ContainerStarted","Data":"cdc19d6ca6d9af18a09826f22ef04379e293309348c1549ea99698e0d717ce26"}
Jul 07 04:57:56.449468 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:56.448978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx" event={"ID":"adf5d273-cd0b-4c8e-8293-2a0a882b2c55","Type":"ContainerStarted","Data":"68c0bb6862a77947a3b68dc4fc5302764273986418155338b1767e3849f82cd1"}
Jul 07 04:57:56.466922 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:57:56.466870    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx" podStartSLOduration=1.466856172 podStartE2EDuration="1.466856172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 04:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 04:57:56.464278111 +0000 UTC m=+2036.351816959" watchObservedRunningTime="2026-07-07 04:57:56.466856172 +0000 UTC m=+2036.354394973"
Jul 07 04:58:05.606840 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:58:05.606800    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:58:05.607327 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:58:05.606862    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:58:05.619921 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:58:05.619893    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:58:06.509497 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:58:06.509468    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 04:59:00.702701 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:59:00.702670    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:59:00.705403 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:59:00.705381    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 04:59:56.899915 ip-10-0-128-250 kubenswrapper[2568]: I0707 04:59:56.899831    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"]
Jul 07 05:00:11.920230 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:11.920169    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx" podUID="adf5d273-cd0b-4c8e-8293-2a0a882b2c55" containerName="main" containerID="cri-o://cdc19d6ca6d9af18a09826f22ef04379e293309348c1549ea99698e0d717ce26" gracePeriod=45
Jul 07 05:00:12.118803 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.118764    2568 generic.go:356] "Generic (PLEG): container finished" podID="adf5d273-cd0b-4c8e-8293-2a0a882b2c55" containerID="cdc19d6ca6d9af18a09826f22ef04379e293309348c1549ea99698e0d717ce26" exitCode=0
Jul 07 05:00:12.118949 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.118810    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx" event={"ID":"adf5d273-cd0b-4c8e-8293-2a0a882b2c55","Type":"ContainerDied","Data":"cdc19d6ca6d9af18a09826f22ef04379e293309348c1549ea99698e0d717ce26"}
Jul 07 05:00:12.171208 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.171149    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 05:00:12.245087 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245059    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tls-certs\") pod \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") "
Jul 07 05:00:12.245271 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245101    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rp8p\" (UniqueName: \"kubernetes.io/projected/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-kube-api-access-8rp8p\") pod \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") "
Jul 07 05:00:12.245271 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245140    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-home\") pod \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") "
Jul 07 05:00:12.245271 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245252    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-model-cache\") pod \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") "
Jul 07 05:00:12.245492 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245376    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tmp-dir\") pod \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") "
Jul 07 05:00:12.245492 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245420    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-dshm\") pod \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\" (UID: \"adf5d273-cd0b-4c8e-8293-2a0a882b2c55\") "
Jul 07 05:00:12.245492 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245422    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-home" (OuterVolumeSpecName: "home") pod "adf5d273-cd0b-4c8e-8293-2a0a882b2c55" (UID: "adf5d273-cd0b-4c8e-8293-2a0a882b2c55"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:00:12.245672 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245498    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-model-cache" (OuterVolumeSpecName: "model-cache") pod "adf5d273-cd0b-4c8e-8293-2a0a882b2c55" (UID: "adf5d273-cd0b-4c8e-8293-2a0a882b2c55"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:00:12.245672 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245629    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "adf5d273-cd0b-4c8e-8293-2a0a882b2c55" (UID: "adf5d273-cd0b-4c8e-8293-2a0a882b2c55"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:00:12.245790 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245771    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-home\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:00:12.245845 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245790    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-model-cache\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:00:12.245845 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.245800    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tmp-dir\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:00:12.247515 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.247485    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-kube-api-access-8rp8p" (OuterVolumeSpecName: "kube-api-access-8rp8p") pod "adf5d273-cd0b-4c8e-8293-2a0a882b2c55" (UID: "adf5d273-cd0b-4c8e-8293-2a0a882b2c55"). InnerVolumeSpecName "kube-api-access-8rp8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 05:00:12.247618 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.247506    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-dshm" (OuterVolumeSpecName: "dshm") pod "adf5d273-cd0b-4c8e-8293-2a0a882b2c55" (UID: "adf5d273-cd0b-4c8e-8293-2a0a882b2c55"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:00:12.247618 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.247556    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "adf5d273-cd0b-4c8e-8293-2a0a882b2c55" (UID: "adf5d273-cd0b-4c8e-8293-2a0a882b2c55"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 05:00:12.346488 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.346453    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-tls-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:00:12.346488 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.346487    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rp8p\" (UniqueName: \"kubernetes.io/projected/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-kube-api-access-8rp8p\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:00:12.346725 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:12.346502    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf5d273-cd0b-4c8e-8293-2a0a882b2c55-dshm\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:00:13.125031 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:13.125001    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"
Jul 07 05:00:13.125031 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:13.125026    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx" event={"ID":"adf5d273-cd0b-4c8e-8293-2a0a882b2c55","Type":"ContainerDied","Data":"68c0bb6862a77947a3b68dc4fc5302764273986418155338b1767e3849f82cd1"}
Jul 07 05:00:13.125602 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:13.125077    2568 scope.go:117] "RemoveContainer" containerID="cdc19d6ca6d9af18a09826f22ef04379e293309348c1549ea99698e0d717ce26"
Jul 07 05:00:13.142259 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:13.142230    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"]
Jul 07 05:00:13.145670 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:13.145646    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5a77f6/auth-test-model-5a77f6-kserve-5b9d88579f-tgxcx"]
Jul 07 05:00:14.592026 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:00:14.591991    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf5d273-cd0b-4c8e-8293-2a0a882b2c55" path="/var/lib/kubelet/pods/adf5d273-cd0b-4c8e-8293-2a0a882b2c55/volumes"
Jul 07 05:01:14.188749 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.188698    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"]
Jul 07 05:01:14.189298 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.189141    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf5d273-cd0b-4c8e-8293-2a0a882b2c55" containerName="main"
Jul 07 05:01:14.189298 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.189158    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf5d273-cd0b-4c8e-8293-2a0a882b2c55" containerName="main"
Jul 07 05:01:14.189298 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.189296    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf5d273-cd0b-4c8e-8293-2a0a882b2c55" containerName="main"
Jul 07 05:01:14.192049 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.192034    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.195398 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.195366    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-41807c\"/\"kube-root-ca.crt\""
Jul 07 05:01:14.195503 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.195423    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-41807c\"/\"openshift-service-ca.crt\""
Jul 07 05:01:14.195503 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.195423    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-41807c\"/\"default-dockercfg-lvbv2\""
Jul 07 05:01:14.195503 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.195463    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-41807c\"/\"rate-test-model-41807c-kserve-self-signed-certs\""
Jul 07 05:01:14.201627 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.201606    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"]
Jul 07 05:01:14.330547 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.330509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42cdd\" (UniqueName: \"kubernetes.io/projected/b4429238-bf44-4332-84e9-6e0794e25a05-kube-api-access-42cdd\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.330547 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.330558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4429238-bf44-4332-84e9-6e0794e25a05-tls-certs\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.330795 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.330635    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-model-cache\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.330795 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.330673    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-home\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.330795 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.330739    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-dshm\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.330795 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.330763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-tmp-dir\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.431330 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.431298    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-home\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.431609 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.431377    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-dshm\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.431609 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.431398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-tmp-dir\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.431609 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.431460    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42cdd\" (UniqueName: \"kubernetes.io/projected/b4429238-bf44-4332-84e9-6e0794e25a05-kube-api-access-42cdd\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.431609 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.431490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4429238-bf44-4332-84e9-6e0794e25a05-tls-certs\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.431609 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.431569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-model-cache\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.431920 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.431724    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-home\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.431920 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.431901    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-tmp-dir\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.432056 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.432036    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-model-cache\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.433983 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.433954    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-dshm\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.434128 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.434045    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4429238-bf44-4332-84e9-6e0794e25a05-tls-certs\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.439795 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.439731    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42cdd\" (UniqueName: \"kubernetes.io/projected/b4429238-bf44-4332-84e9-6e0794e25a05-kube-api-access-42cdd\") pod \"rate-test-model-41807c-kserve-6db9986b59-gnq2b\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") " pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.501340 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.501293    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:14.634393 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:14.634367    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"]
Jul 07 05:01:14.636248 ip-10-0-128-250 kubenswrapper[2568]: W0707 05:01:14.636215    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4429238_bf44_4332_84e9_6e0794e25a05.slice/crio-1eef90cbc76d3a3de90435ddf27c9fd590edd54c903ffd36453ae573a534a38d WatchSource:0}: Error finding container 1eef90cbc76d3a3de90435ddf27c9fd590edd54c903ffd36453ae573a534a38d: Status 404 returned error can't find the container with id 1eef90cbc76d3a3de90435ddf27c9fd590edd54c903ffd36453ae573a534a38d
Jul 07 05:01:15.441817 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:15.441772    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b" event={"ID":"b4429238-bf44-4332-84e9-6e0794e25a05","Type":"ContainerStarted","Data":"e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408"}
Jul 07 05:01:15.442289 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:15.441825    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b" event={"ID":"b4429238-bf44-4332-84e9-6e0794e25a05","Type":"ContainerStarted","Data":"1eef90cbc76d3a3de90435ddf27c9fd590edd54c903ffd36453ae573a534a38d"}
Jul 07 05:01:15.459883 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:15.459839    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b" podStartSLOduration=1.4598248 podStartE2EDuration="1.4598248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 05:01:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 05:01:15.459409736 +0000 UTC m=+2235.346948538" watchObservedRunningTime="2026-07-07 05:01:15.4598248 +0000 UTC m=+2235.347363606"
Jul 07 05:01:24.502084 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:24.502008    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:24.502084 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:24.502052    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:24.514714 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:24.514693    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:01:25.510840 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:01:25.510812    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:02:35.999174 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:35.999137    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"]
Jul 07 05:02:51.020632 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.020574    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b" podUID="b4429238-bf44-4332-84e9-6e0794e25a05" containerName="main" containerID="cri-o://e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408" gracePeriod=45
Jul 07 05:02:51.283528 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.283464    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:02:51.412180 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412138    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-dshm\") pod \"b4429238-bf44-4332-84e9-6e0794e25a05\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") "
Jul 07 05:02:51.412413 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412201    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42cdd\" (UniqueName: \"kubernetes.io/projected/b4429238-bf44-4332-84e9-6e0794e25a05-kube-api-access-42cdd\") pod \"b4429238-bf44-4332-84e9-6e0794e25a05\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") "
Jul 07 05:02:51.412413 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412255    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-tmp-dir\") pod \"b4429238-bf44-4332-84e9-6e0794e25a05\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") "
Jul 07 05:02:51.412413 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412313    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-home\") pod \"b4429238-bf44-4332-84e9-6e0794e25a05\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") "
Jul 07 05:02:51.412413 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412343    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4429238-bf44-4332-84e9-6e0794e25a05-tls-certs\") pod \"b4429238-bf44-4332-84e9-6e0794e25a05\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") "
Jul 07 05:02:51.412413 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412397    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-model-cache\") pod \"b4429238-bf44-4332-84e9-6e0794e25a05\" (UID: \"b4429238-bf44-4332-84e9-6e0794e25a05\") "
Jul 07 05:02:51.412725 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412599    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b4429238-bf44-4332-84e9-6e0794e25a05" (UID: "b4429238-bf44-4332-84e9-6e0794e25a05"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:02:51.412784 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412703    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-home" (OuterVolumeSpecName: "home") pod "b4429238-bf44-4332-84e9-6e0794e25a05" (UID: "b4429238-bf44-4332-84e9-6e0794e25a05"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:02:51.412784 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412746    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-model-cache" (OuterVolumeSpecName: "model-cache") pod "b4429238-bf44-4332-84e9-6e0794e25a05" (UID: "b4429238-bf44-4332-84e9-6e0794e25a05"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:02:51.412890 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412861    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-tmp-dir\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:02:51.412890 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412880    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-home\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:02:51.412997 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.412894    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-model-cache\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:02:51.414588 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.414560    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4429238-bf44-4332-84e9-6e0794e25a05-kube-api-access-42cdd" (OuterVolumeSpecName: "kube-api-access-42cdd") pod "b4429238-bf44-4332-84e9-6e0794e25a05" (UID: "b4429238-bf44-4332-84e9-6e0794e25a05"). InnerVolumeSpecName "kube-api-access-42cdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 05:02:51.414588 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.414566    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4429238-bf44-4332-84e9-6e0794e25a05-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b4429238-bf44-4332-84e9-6e0794e25a05" (UID: "b4429238-bf44-4332-84e9-6e0794e25a05"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 05:02:51.414741 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.414588    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-dshm" (OuterVolumeSpecName: "dshm") pod "b4429238-bf44-4332-84e9-6e0794e25a05" (UID: "b4429238-bf44-4332-84e9-6e0794e25a05"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:02:51.514058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.514023    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4429238-bf44-4332-84e9-6e0794e25a05-dshm\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:02:51.514058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.514053    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42cdd\" (UniqueName: \"kubernetes.io/projected/b4429238-bf44-4332-84e9-6e0794e25a05-kube-api-access-42cdd\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:02:51.514263 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.514074    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4429238-bf44-4332-84e9-6e0794e25a05-tls-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:02:51.924609 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.924578    2568 generic.go:356] "Generic (PLEG): container finished" podID="b4429238-bf44-4332-84e9-6e0794e25a05" containerID="e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408" exitCode=0
Jul 07 05:02:51.924789 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.924621    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"
Jul 07 05:02:51.924789 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.924622    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b" event={"ID":"b4429238-bf44-4332-84e9-6e0794e25a05","Type":"ContainerDied","Data":"e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408"}
Jul 07 05:02:51.924789 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.924739    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b" event={"ID":"b4429238-bf44-4332-84e9-6e0794e25a05","Type":"ContainerDied","Data":"1eef90cbc76d3a3de90435ddf27c9fd590edd54c903ffd36453ae573a534a38d"}
Jul 07 05:02:51.924789 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.924756    2568 scope.go:117] "RemoveContainer" containerID="e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408"
Jul 07 05:02:51.933735 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.933715    2568 scope.go:117] "RemoveContainer" containerID="e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408"
Jul 07 05:02:51.934004 ip-10-0-128-250 kubenswrapper[2568]: E0707 05:02:51.933984    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408\": container with ID starting with e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408 not found: ID does not exist" containerID="e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408"
Jul 07 05:02:51.934054 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.934011    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408"} err="failed to get container status \"e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408\": rpc error: code = NotFound desc = could not find container \"e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408\": container with ID starting with e5b43dc8f5e5dbeb4b7ab45767ee85570cac97b9ff2ccef5870a3be4da841408 not found: ID does not exist"
Jul 07 05:02:51.948587 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.948543    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"]
Jul 07 05:02:51.952112 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:51.952086    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-41807c/rate-test-model-41807c-kserve-6db9986b59-gnq2b"]
Jul 07 05:02:52.591698 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:02:52.591666    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4429238-bf44-4332-84e9-6e0794e25a05" path="/var/lib/kubelet/pods/b4429238-bf44-4332-84e9-6e0794e25a05/volumes"
Jul 07 05:03:20.471764 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:20.471727    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"]
Jul 07 05:03:20.472675 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:20.471991    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy" containerID="cri-o://2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe" gracePeriod=30
Jul 07 05:03:25.733543 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.733516    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 05:03:25.851760 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.851662    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-istio-token\") pod \"337965a2-7246-4717-8910-6c5322245eba\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") "
Jul 07 05:03:25.851760 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.851742    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-socket\") pod \"337965a2-7246-4717-8910-6c5322245eba\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") "
Jul 07 05:03:25.852011 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.851790    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-data\") pod \"337965a2-7246-4717-8910-6c5322245eba\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") "
Jul 07 05:03:25.852011 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.851839    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/337965a2-7246-4717-8910-6c5322245eba-istiod-ca-cert\") pod \"337965a2-7246-4717-8910-6c5322245eba\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") "
Jul 07 05:03:25.852011 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.851868    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-certs\") pod \"337965a2-7246-4717-8910-6c5322245eba\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") "
Jul 07 05:03:25.852011 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.851892    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-envoy\") pod \"337965a2-7246-4717-8910-6c5322245eba\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") "
Jul 07 05:03:25.853058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.852435    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "337965a2-7246-4717-8910-6c5322245eba" (UID: "337965a2-7246-4717-8910-6c5322245eba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:25.853058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.852490    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337965a2-7246-4717-8910-6c5322245eba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "337965a2-7246-4717-8910-6c5322245eba" (UID: "337965a2-7246-4717-8910-6c5322245eba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 05:03:25.853058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.852578    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/337965a2-7246-4717-8910-6c5322245eba-istio-podinfo\") pod \"337965a2-7246-4717-8910-6c5322245eba\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") "
Jul 07 05:03:25.853058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.852634    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-credential-socket\") pod \"337965a2-7246-4717-8910-6c5322245eba\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") "
Jul 07 05:03:25.853058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.852682    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj46m\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-kube-api-access-lj46m\") pod \"337965a2-7246-4717-8910-6c5322245eba\" (UID: \"337965a2-7246-4717-8910-6c5322245eba\") "
Jul 07 05:03:25.853058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.852903    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "337965a2-7246-4717-8910-6c5322245eba" (UID: "337965a2-7246-4717-8910-6c5322245eba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:25.853058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.853008    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-data" (OuterVolumeSpecName: "istio-data") pod "337965a2-7246-4717-8910-6c5322245eba" (UID: "337965a2-7246-4717-8910-6c5322245eba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:25.853614 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.853151    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:25.853614 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.853172    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:25.853614 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.853186    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:25.853614 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.853200    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/337965a2-7246-4717-8910-6c5322245eba-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:25.853614 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.853260    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "337965a2-7246-4717-8910-6c5322245eba" (UID: "337965a2-7246-4717-8910-6c5322245eba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:25.854515 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.854487    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-istio-token" (OuterVolumeSpecName: "istio-token") pod "337965a2-7246-4717-8910-6c5322245eba" (UID: "337965a2-7246-4717-8910-6c5322245eba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 05:03:25.854828 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.854804    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "337965a2-7246-4717-8910-6c5322245eba" (UID: "337965a2-7246-4717-8910-6c5322245eba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:25.855210 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.855185    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/337965a2-7246-4717-8910-6c5322245eba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "337965a2-7246-4717-8910-6c5322245eba" (UID: "337965a2-7246-4717-8910-6c5322245eba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 05:03:25.855315 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.855287    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-kube-api-access-lj46m" (OuterVolumeSpecName: "kube-api-access-lj46m") pod "337965a2-7246-4717-8910-6c5322245eba" (UID: "337965a2-7246-4717-8910-6c5322245eba"). InnerVolumeSpecName "kube-api-access-lj46m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 05:03:25.954213 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.954176    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:25.954213 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.954214    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:25.954436 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.954228    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/337965a2-7246-4717-8910-6c5322245eba-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:25.954436 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.954240    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/337965a2-7246-4717-8910-6c5322245eba-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:25.954436 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:25.954253    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj46m\" (UniqueName: \"kubernetes.io/projected/337965a2-7246-4717-8910-6c5322245eba-kube-api-access-lj46m\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:26.094905 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.094873    2568 generic.go:356] "Generic (PLEG): container finished" podID="337965a2-7246-4717-8910-6c5322245eba" containerID="2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe" exitCode=0
Jul 07 05:03:26.095079 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.094922    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"
Jul 07 05:03:26.095079 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.094964    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" event={"ID":"337965a2-7246-4717-8910-6c5322245eba","Type":"ContainerDied","Data":"2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe"}
Jul 07 05:03:26.095079 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.095022    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6" event={"ID":"337965a2-7246-4717-8910-6c5322245eba","Type":"ContainerDied","Data":"6c8e61891af8160121728e411537625581eb0d147bb40f4bd8d1e7cb379fad45"}
Jul 07 05:03:26.095079 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.095045    2568 scope.go:117] "RemoveContainer" containerID="2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe"
Jul 07 05:03:26.104638 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.104620    2568 scope.go:117] "RemoveContainer" containerID="ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90"
Jul 07 05:03:26.112490 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.112471    2568 scope.go:117] "RemoveContainer" containerID="2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe"
Jul 07 05:03:26.112754 ip-10-0-128-250 kubenswrapper[2568]: E0707 05:03:26.112735    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe\": container with ID starting with 2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe not found: ID does not exist" containerID="2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe"
Jul 07 05:03:26.112801 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.112763    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe"} err="failed to get container status \"2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe\": rpc error: code = NotFound desc = could not find container \"2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe\": container with ID starting with 2df836745b1dbb147061791005ec4f6d7bc2f8329f9af1ee2ff667630a4b7bbe not found: ID does not exist"
Jul 07 05:03:26.112801 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.112781    2568 scope.go:117] "RemoveContainer" containerID="ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90"
Jul 07 05:03:26.113030 ip-10-0-128-250 kubenswrapper[2568]: E0707 05:03:26.113012    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90\": container with ID starting with ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90 not found: ID does not exist" containerID="ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90"
Jul 07 05:03:26.113072 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.113036    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90"} err="failed to get container status \"ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90\": rpc error: code = NotFound desc = could not find container \"ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90\": container with ID starting with ac700ca07933f71984ebc233013af60bfcb0809ce27a0524ece9e66be4c6be90 not found: ID does not exist"
Jul 07 05:03:26.117702 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.117679    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"]
Jul 07 05:03:26.123734 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.123714    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-41807c-openshift-default-5b9bc96667-jhcm6"]
Jul 07 05:03:26.593437 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:26.593402    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="337965a2-7246-4717-8910-6c5322245eba" path="/var/lib/kubelet/pods/337965a2-7246-4717-8910-6c5322245eba/volumes"
Jul 07 05:03:27.597229 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:27.597194    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"]
Jul 07 05:03:27.597657 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:27.597427    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy" containerID="cri-o://fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc" gracePeriod=30
Jul 07 05:03:32.858217 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:32.858193    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 05:03:32.910788 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:32.910762    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r96qx_9eaab48d-a857-48cc-9b42-695c96119a49/manager/0.log"
Jul 07 05:03:33.022769 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.022730    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istiod-ca-cert\") pod \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") "
Jul 07 05:03:33.022769 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.022775    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-podinfo\") pod \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") "
Jul 07 05:03:33.022989 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.022810    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-socket\") pod \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") "
Jul 07 05:03:33.022989 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.022862    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-token\") pod \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") "
Jul 07 05:03:33.022989 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.022896    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-data\") pod \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") "
Jul 07 05:03:33.022989 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.022926    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-credential-socket\") pod \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") "
Jul 07 05:03:33.022989 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.022966    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-envoy\") pod \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") "
Jul 07 05:03:33.023262 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.023031    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-certs\") pod \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") "
Jul 07 05:03:33.023262 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.023056    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97cgv\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-kube-api-access-97cgv\") pod \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\" (UID: \"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3\") "
Jul 07 05:03:33.023262 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.023198    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" (UID: "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 05:03:33.023451 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.023314    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" (UID: "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:33.023507 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.023465    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" (UID: "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:33.023562 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.023540    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" (UID: "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:33.023615 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.023600    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istiod-ca-cert\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:33.023661 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.023618    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:33.023661 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.023631    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-workload-certs\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:33.024135 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.024110    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" (UID: "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:33.025505 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.025478    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" (UID: "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 05:03:33.025615 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.025513    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-kube-api-access-97cgv" (OuterVolumeSpecName: "kube-api-access-97cgv") pod "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" (UID: "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3"). InnerVolumeSpecName "kube-api-access-97cgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 05:03:33.025667 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.025607    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" (UID: "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 05:03:33.025667 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.025606    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" (UID: "ee9dbeed-dfbb-4576-9f9c-c384cf87fab3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 05:03:33.124285 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.124252    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-podinfo\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:33.124285 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.124279    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-token\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:33.124285 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.124289    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-data\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:33.124544 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.124296    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-credential-socket\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:33.124544 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.124304    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-istio-envoy\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:33.124544 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.124314    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97cgv\" (UniqueName: \"kubernetes.io/projected/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3-kube-api-access-97cgv\") on node \"ip-10-0-128-250.ec2.internal\" DevicePath \"\""
Jul 07 05:03:33.135801 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.135766    2568 generic.go:356] "Generic (PLEG): container finished" podID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerID="fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc" exitCode=0
Jul 07 05:03:33.135953 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.135811    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"
Jul 07 05:03:33.135953 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.135847    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" event={"ID":"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3","Type":"ContainerDied","Data":"fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc"}
Jul 07 05:03:33.135953 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.135904    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw" event={"ID":"ee9dbeed-dfbb-4576-9f9c-c384cf87fab3","Type":"ContainerDied","Data":"a1aee5bc2e1a15ea610f3547bc3ffedd58ce6fdedb411c0bc097de9f6d8cab9c"}
Jul 07 05:03:33.135953 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.135928    2568 scope.go:117] "RemoveContainer" containerID="fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc"
Jul 07 05:03:33.145807 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.145790    2568 scope.go:117] "RemoveContainer" containerID="5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7"
Jul 07 05:03:33.155247 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.155225    2568 scope.go:117] "RemoveContainer" containerID="fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc"
Jul 07 05:03:33.155574 ip-10-0-128-250 kubenswrapper[2568]: E0707 05:03:33.155549    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc\": container with ID starting with fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc not found: ID does not exist" containerID="fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc"
Jul 07 05:03:33.155657 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.155582    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc"} err="failed to get container status \"fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc\": rpc error: code = NotFound desc = could not find container \"fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc\": container with ID starting with fd2a7cf377ee4c8896578d6bc36d48cbdfd653198e9c20e3074d2dd5419b81bc not found: ID does not exist"
Jul 07 05:03:33.155657 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.155601    2568 scope.go:117] "RemoveContainer" containerID="5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7"
Jul 07 05:03:33.155976 ip-10-0-128-250 kubenswrapper[2568]: E0707 05:03:33.155948    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7\": container with ID starting with 5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7 not found: ID does not exist" containerID="5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7"
Jul 07 05:03:33.156087 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.155982    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7"} err="failed to get container status \"5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7\": rpc error: code = NotFound desc = could not find container \"5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7\": container with ID starting with 5073e9127e0b4969f1d87d188009d1c1d88071f5c85f14e94f1ec26f04d88aa7 not found: ID does not exist"
Jul 07 05:03:33.158823 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.158796    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"]
Jul 07 05:03:33.162722 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:33.162669    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5a77f6-openshift-default-5464895d67-6l9kw"]
Jul 07 05:03:34.133618 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:34.133591    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b7c66b5-w7qbj_4daa6319-36d1-435e-8b38-e6622dbf6202/copy-manifests/0.log"
Jul 07 05:03:34.147187 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:34.147157    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b7c66b5-w7qbj_4daa6319-36d1-435e-8b38-e6622dbf6202/manager/0.log"
Jul 07 05:03:34.259175 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:34.259140    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vmvjg_a182e427-d216-4124-a3b9-86dfa71fcadf/postgres/0.log"
Jul 07 05:03:34.591280 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:34.591247    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" path="/var/lib/kubelet/pods/ee9dbeed-dfbb-4576-9f9c-c384cf87fab3/volumes"
Jul 07 05:03:35.781009 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:35.780983    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5bgld_005e4338-5bb5-48eb-a0ad-7150608bf8d4/manager/0.log"
Jul 07 05:03:36.009692 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:36.009660    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4tb6c_d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a/registry-server/0.log"
Jul 07 05:03:36.135858 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:36.135782    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4j5vx_f4176ab9-959b-4a08-8725-44025fc86184/manager/0.log"
Jul 07 05:03:36.741236 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:36.741205    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678w9l4s_139d6ebd-2a9d-41ad-8c72-cbd457d56818/istio-proxy/0.log"
Jul 07 05:03:37.213471 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:37.213440    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9jx4n_57c96426-1f87-443e-910d-5a5cd63ec822/istio-proxy/1.log"
Jul 07 05:03:37.328671 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:37.328640    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qpgxh_27152c28-10b1-4c4b-9267-66e6ff8e4300/payload-pre-processing/0.log"
Jul 07 05:03:37.452546 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:37.452514    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dz6wf_ef36e489-2c3a-4c5a-a51c-04db26044234/payload-processing/0.log"
Jul 07 05:03:38.026608 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:38.026574    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-g6gbh_a00fe8dd-9b1b-492a-beca-c250b3d4a485/main/0.log"
Jul 07 05:03:38.133545 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:38.133514    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2g6jz_9d6ac7d9-4b23-4764-befe-4717ab56c983/main/0.log"
Jul 07 05:03:38.470774 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:38.470745    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-hnp6v_a829ec32-34ca-4045-8399-0a1614fac1cc/main/0.log"
Jul 07 05:03:46.169129 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:46.169093    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qlnzn_b93b525a-aebf-47a0-a974-319583d88a5d/global-pull-secret-syncer/0.log"
Jul 07 05:03:46.335361 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:46.335318    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p77tx_d7395655-13b9-4c94-80ea-f371a9687b58/konnectivity-agent/0.log"
Jul 07 05:03:46.356085 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:46.356059    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-250.ec2.internal_5e122e28a36009eb5aa8349191a2630e/haproxy/0.log"
Jul 07 05:03:51.763072 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:51.763040    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5bgld_005e4338-5bb5-48eb-a0ad-7150608bf8d4/manager/0.log"
Jul 07 05:03:51.839446 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:51.839419    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4tb6c_d8b52f0a-78ee-4cfc-8ea1-224b33fd8f9a/registry-server/0.log"
Jul 07 05:03:51.954171 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:51.954136    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4j5vx_f4176ab9-959b-4a08-8725-44025fc86184/manager/0.log"
Jul 07 05:03:53.976284 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:53.976183    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zs4rd_2e3705f8-703d-43ef-8d73-5d2bfd62b023/kube-state-metrics/0.log"
Jul 07 05:03:53.994232 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:53.994189    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zs4rd_2e3705f8-703d-43ef-8d73-5d2bfd62b023/kube-rbac-proxy-main/0.log"
Jul 07 05:03:54.017234 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.017209    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zs4rd_2e3705f8-703d-43ef-8d73-5d2bfd62b023/kube-rbac-proxy-self/0.log"
Jul 07 05:03:54.042327 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.042302    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dc5448788-pp4dj_c033d94c-efec-4552-955d-5077a9dee85a/metrics-server/0.log"
Jul 07 05:03:54.095359 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.095322    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcxs2_d597e577-8198-4c9b-ade3-15d893ec86ae/node-exporter/0.log"
Jul 07 05:03:54.115299 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.115271    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcxs2_d597e577-8198-4c9b-ade3-15d893ec86ae/kube-rbac-proxy/0.log"
Jul 07 05:03:54.135886 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.135863    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcxs2_d597e577-8198-4c9b-ade3-15d893ec86ae/init-textfile/0.log"
Jul 07 05:03:54.321701 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.321619    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9nmtb_3e89c1bd-83c9-44c1-953c-c5b50fe68656/kube-rbac-proxy-main/0.log"
Jul 07 05:03:54.341372 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.341327    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9nmtb_3e89c1bd-83c9-44c1-953c-c5b50fe68656/kube-rbac-proxy-self/0.log"
Jul 07 05:03:54.360652 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.360625    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9nmtb_3e89c1bd-83c9-44c1-953c-c5b50fe68656/openshift-state-metrics/0.log"
Jul 07 05:03:54.408726 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.408699    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48b1c3ea-7afe-4fa8-81e1-db71cc63a869/prometheus/0.log"
Jul 07 05:03:54.431374 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.431336    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48b1c3ea-7afe-4fa8-81e1-db71cc63a869/config-reloader/0.log"
Jul 07 05:03:54.454322 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.454302    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48b1c3ea-7afe-4fa8-81e1-db71cc63a869/thanos-sidecar/0.log"
Jul 07 05:03:54.476222 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.476200    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48b1c3ea-7afe-4fa8-81e1-db71cc63a869/kube-rbac-proxy-web/0.log"
Jul 07 05:03:54.496287 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.496267    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48b1c3ea-7afe-4fa8-81e1-db71cc63a869/kube-rbac-proxy/0.log"
Jul 07 05:03:54.516589 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.516564    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48b1c3ea-7afe-4fa8-81e1-db71cc63a869/kube-rbac-proxy-thanos/0.log"
Jul 07 05:03:54.537662 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.537645    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_48b1c3ea-7afe-4fa8-81e1-db71cc63a869/init-config-reloader/0.log"
Jul 07 05:03:54.564303 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.564278    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-mfsgv_5004aad3-41a5-4c1f-a866-f859f222c789/prometheus-operator/0.log"
Jul 07 05:03:54.582255 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.582187    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-mfsgv_5004aad3-41a5-4c1f-a866-f859f222c789/kube-rbac-proxy/0.log"
Jul 07 05:03:54.605259 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:54.605228    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-pbxkd_122e8c04-6923-4273-b19c-d4ce68a4d2df/prometheus-operator-admission-webhook/0.log"
Jul 07 05:03:56.528880 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.528843    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"]
Jul 07 05:03:56.529305 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529207    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy"
Jul 07 05:03:56.529305 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529218    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy"
Jul 07 05:03:56.529305 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529233    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4429238-bf44-4332-84e9-6e0794e25a05" containerName="main"
Jul 07 05:03:56.529305 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529238    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4429238-bf44-4332-84e9-6e0794e25a05" containerName="main"
Jul 07 05:03:56.529305 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529257    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy"
Jul 07 05:03:56.529305 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529263    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy"
Jul 07 05:03:56.529305 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529268    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy"
Jul 07 05:03:56.529305 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529274    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy"
Jul 07 05:03:56.529675 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529328    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4429238-bf44-4332-84e9-6e0794e25a05" containerName="main"
Jul 07 05:03:56.529675 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529336    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy"
Jul 07 05:03:56.529675 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529342    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy"
Jul 07 05:03:56.529675 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529366    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="337965a2-7246-4717-8910-6c5322245eba" containerName="istio-proxy"
Jul 07 05:03:56.529675 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.529375    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee9dbeed-dfbb-4576-9f9c-c384cf87fab3" containerName="istio-proxy"
Jul 07 05:03:56.532794 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.532773    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.535238 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.535221    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh4c7\"/\"kube-root-ca.crt\""
Jul 07 05:03:56.536216 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.536195    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jh4c7\"/\"default-dockercfg-hblzf\""
Jul 07 05:03:56.536321 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.536231    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh4c7\"/\"openshift-service-ca.crt\""
Jul 07 05:03:56.540810 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.540787    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"]
Jul 07 05:03:56.641639 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.641597    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-podres\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.641849 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.641659    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-sys\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.641849 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.641740    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-lib-modules\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.641849 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.641784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-proc\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.641849 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.641806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq8hx\" (UniqueName: \"kubernetes.io/projected/3c41d626-11a5-4cd5-880b-a06bb7c775cc-kube-api-access-lq8hx\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.742937 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.742888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-sys\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.743116 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.742957    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-lib-modules\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.743116 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.742999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-proc\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.743116 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.743016    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-sys\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.743116 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.743022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq8hx\" (UniqueName: \"kubernetes.io/projected/3c41d626-11a5-4cd5-880b-a06bb7c775cc-kube-api-access-lq8hx\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.743116 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.743101    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-lib-modules\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.743292 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.743115    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-proc\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.743292 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.743132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-podres\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.743292 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.743202    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c41d626-11a5-4cd5-880b-a06bb7c775cc-podres\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.751337 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.751308    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq8hx\" (UniqueName: \"kubernetes.io/projected/3c41d626-11a5-4cd5-880b-a06bb7c775cc-kube-api-access-lq8hx\") pod \"perf-node-gather-daemonset-w2qdv\" (UID: \"3c41d626-11a5-4cd5-880b-a06bb7c775cc\") " pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.843563 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.843465    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:56.976025 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:56.975998    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"]
Jul 07 05:03:56.977879 ip-10-0-128-250 kubenswrapper[2568]: W0707 05:03:56.977840    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3c41d626_11a5_4cd5_880b_a06bb7c775cc.slice/crio-3dbb9d0eeaedd25ecf1248ed87c22c43ae633d12030c80e2b222f68485eddddc WatchSource:0}: Error finding container 3dbb9d0eeaedd25ecf1248ed87c22c43ae633d12030c80e2b222f68485eddddc: Status 404 returned error can't find the container with id 3dbb9d0eeaedd25ecf1248ed87c22c43ae633d12030c80e2b222f68485eddddc
Jul 07 05:03:57.037041 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:57.037023    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d864cbc48-dn4hc_ed2b19cb-2b2a-4128-8241-b518f4c76d0d/console/0.log"
Jul 07 05:03:57.071246 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:57.071220    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-2p96g_cbb4cf33-73d9-4ea9-b70a-a5f0a3be25e7/download-server/0.log"
Jul 07 05:03:57.255106 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:57.255069    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv" event={"ID":"3c41d626-11a5-4cd5-880b-a06bb7c775cc","Type":"ContainerStarted","Data":"910592e44ffe96f9bd7081af0cc059864d5d3c0812b314b085a051322dfea394"}
Jul 07 05:03:57.255302 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:57.255124    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:03:57.255302 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:57.255146    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv" event={"ID":"3c41d626-11a5-4cd5-880b-a06bb7c775cc","Type":"ContainerStarted","Data":"3dbb9d0eeaedd25ecf1248ed87c22c43ae633d12030c80e2b222f68485eddddc"}
Jul 07 05:03:57.271585 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:57.271538    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv" podStartSLOduration=1.271523598 podStartE2EDuration="1.271523598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 05:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 05:03:57.270020407 +0000 UTC m=+2397.157559208" watchObservedRunningTime="2026-07-07 05:03:57.271523598 +0000 UTC m=+2397.159062399"
Jul 07 05:03:58.798942 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:58.798912    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-skwl7_a8f14ab7-2568-41dd-a26d-def63b5b0991/dns/0.log"
Jul 07 05:03:58.822008 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:58.821982    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-skwl7_a8f14ab7-2568-41dd-a26d-def63b5b0991/kube-rbac-proxy/0.log"
Jul 07 05:03:58.931727 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:58.931696    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xv5rb_607766ce-6c56-44f6-9d7e-4f250460b207/dns-node-resolver/0.log"
Jul 07 05:03:59.478798 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:03:59.478768    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7bqc5_23ca5ba7-765b-4bc7-af6e-6c2e01b78f4d/node-ca/0.log"
Jul 07 05:04:00.484058 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:00.484032    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678w9l4s_139d6ebd-2a9d-41ad-8c72-cbd457d56818/istio-proxy/0.log"
Jul 07 05:04:00.735446 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:00.735366    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 05:04:00.738204 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:00.738183    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-npkcf_491a93ac-9c61-4d51-a90d-0d32ee991667/ovn-acl-logging/0.log"
Jul 07 05:04:00.752798 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:00.752732    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9jx4n_57c96426-1f87-443e-910d-5a5cd63ec822/istio-proxy/0.log"
Jul 07 05:04:00.778966 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:00.778944    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9jx4n_57c96426-1f87-443e-910d-5a5cd63ec822/istio-proxy/1.log"
Jul 07 05:04:00.809403 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:00.809375    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qpgxh_27152c28-10b1-4c4b-9267-66e6ff8e4300/payload-pre-processing/0.log"
Jul 07 05:04:00.855337 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:00.855301    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dz6wf_ef36e489-2c3a-4c5a-a51c-04db26044234/payload-processing/0.log"
Jul 07 05:04:01.542557 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:01.542530    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kjljj_ac4060ca-fe4c-4777-8a89-1d2c938825df/serve-healthcheck-canary/0.log"
Jul 07 05:04:02.127365 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:02.127330    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mtng6_57080347-9922-436d-9437-83ae84d55f24/kube-rbac-proxy/0.log"
Jul 07 05:04:02.146299 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:02.146274    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mtng6_57080347-9922-436d-9437-83ae84d55f24/exporter/0.log"
Jul 07 05:04:02.167818 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:02.167791    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mtng6_57080347-9922-436d-9437-83ae84d55f24/extractor/0.log"
Jul 07 05:04:03.270797 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:03.270767    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jh4c7/perf-node-gather-daemonset-w2qdv"
Jul 07 05:04:04.357500 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:04.357469    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r96qx_9eaab48d-a857-48cc-9b42-695c96119a49/manager/0.log"
Jul 07 05:04:05.146290 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:05.146259    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b7c66b5-w7qbj_4daa6319-36d1-435e-8b38-e6622dbf6202/manager/0.log"
Jul 07 05:04:05.163655 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:05.163631    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b7c66b5-w7qbj_4daa6319-36d1-435e-8b38-e6622dbf6202/copy-manifests/0.log"
Jul 07 05:04:05.187642 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:05.187618    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vmvjg_a182e427-d216-4124-a3b9-86dfa71fcadf/postgres/0.log"
Jul 07 05:04:06.711510 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:06.711481    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-687876b94d-45hmc_5bab7cc6-eb43-4fc7-abde-2c07f3421d1f/manager/0.log"
Jul 07 05:04:06.969514 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:06.969432    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678w9l4s_139d6ebd-2a9d-41ad-8c72-cbd457d56818/istio-proxy/0.log"
Jul 07 05:04:07.203948 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:07.203913    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9jx4n_57c96426-1f87-443e-910d-5a5cd63ec822/istio-proxy/0.log"
Jul 07 05:04:07.232774 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:07.232692    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9jx4n_57c96426-1f87-443e-910d-5a5cd63ec822/istio-proxy/1.log"
Jul 07 05:04:07.254994 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:07.254965    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qpgxh_27152c28-10b1-4c4b-9267-66e6ff8e4300/payload-pre-processing/0.log"
Jul 07 05:04:07.292530 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:07.292501    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dz6wf_ef36e489-2c3a-4c5a-a51c-04db26044234/payload-processing/0.log"
Jul 07 05:04:08.499292 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:08.499264    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678w9l4s_139d6ebd-2a9d-41ad-8c72-cbd457d56818/istio-proxy/0.log"
Jul 07 05:04:08.753664 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:08.753589    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9jx4n_57c96426-1f87-443e-910d-5a5cd63ec822/istio-proxy/0.log"
Jul 07 05:04:08.783169 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:08.783142    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9jx4n_57c96426-1f87-443e-910d-5a5cd63ec822/istio-proxy/1.log"
Jul 07 05:04:08.804769 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:08.804738    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qpgxh_27152c28-10b1-4c4b-9267-66e6ff8e4300/payload-pre-processing/0.log"
Jul 07 05:04:08.844041 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:08.844015    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dz6wf_ef36e489-2c3a-4c5a-a51c-04db26044234/payload-processing/0.log"
Jul 07 05:04:13.233234 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.233203    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7fzv_7bdd1ad5-7005-4c96-8005-4983545d62d9/kube-multus-additional-cni-plugins/0.log"
Jul 07 05:04:13.254300 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.254273    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7fzv_7bdd1ad5-7005-4c96-8005-4983545d62d9/egress-router-binary-copy/0.log"
Jul 07 05:04:13.274018 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.273992    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7fzv_7bdd1ad5-7005-4c96-8005-4983545d62d9/cni-plugins/0.log"
Jul 07 05:04:13.294183 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.294149    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7fzv_7bdd1ad5-7005-4c96-8005-4983545d62d9/bond-cni-plugin/0.log"
Jul 07 05:04:13.313547 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.313511    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7fzv_7bdd1ad5-7005-4c96-8005-4983545d62d9/routeoverride-cni/0.log"
Jul 07 05:04:13.332582 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.332553    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7fzv_7bdd1ad5-7005-4c96-8005-4983545d62d9/whereabouts-cni-bincopy/0.log"
Jul 07 05:04:13.357070 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.357040    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7fzv_7bdd1ad5-7005-4c96-8005-4983545d62d9/whereabouts-cni/0.log"
Jul 07 05:04:13.579416 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.579325    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q5kxz_a65c2a9d-2394-473d-bd17-db7eec281c80/kube-multus/0.log"
Jul 07 05:04:13.715015 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.714987    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tp8x8_74bf3def-bf1b-4616-b263-6053719e4b63/network-metrics-daemon/0.log"
Jul 07 05:04:13.733653 ip-10-0-128-250 kubenswrapper[2568]: I0707 05:04:13.733627    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tp8x8_74bf3def-bf1b-4616-b263-6053719e4b63/kube-rbac-proxy/0.log"